00000100:00100000:3.0F:1788541311.273767:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541311.273828:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0F:1788541311.273956:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955945088 00000100:00100000:1.0:1788541311.273973:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955945088 00000100:00100000:1.0:1788541311.274036:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 165 00000100:00100000:1.0:1788541311.274047:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8172f99-f71c-41fa-8527-cb3efe1827fc+13:2395:x1875420955945088:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541311.274120:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8172f99-f71c-41fa-8527-cb3efe1827fc+13:2395:x1875420955945088:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 75us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541311.274128:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 165 00000100:00100000:3.0:1788541311.274318:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541311.282684:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541311.282728:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541311.282754:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0F:1788541311.282812:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955945216 00000100:00100000:0.0:1788541311.282834:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955945216 00000100:00100000:0.0:1788541311.282923:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955945344 00000100:00100000:0.0:1788541311.282927:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955945344 00000100:00100000:0.0:1788541311.282956:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 57 00000100:00100000:0.0:1788541311.282967:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+22:2394:x1875420955945216:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541311.283043:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+22:2394:x1875420955945216:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 78us (9214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541311.283050:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 57 00000100:00100000:0.0:1788541311.283067:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 58 00000100:00100000:0.0:1788541311.283074:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+5:2395:x1875420955945344:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541311.283100:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+5:2395:x1875420955945344:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (8784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541311.283106:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 58 00000100:00080000:0.0:1788541311.283126:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788541311.283130:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541311.289792:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541311.289837:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541311.289897:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541311.289940:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955945472 00000100:00100000:3.0:1788541311.289949:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955945472 00000100:00100000:3.0:1788541311.290005:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955945600 00000100:00100000:3.0:1788541311.290008:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955945600 00000100:00100000:3.0:1788541311.290021:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955945984 00000100:00100000:3.0:1788541311.290023:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955945984 00000100:00100000:3.0:1788541311.290037:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955946112 00000100:00100000:3.0:1788541311.290039:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955946112 00000100:00100000:3.0:1788541311.290053:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 19 00000100:00100000:3.0:1788541311.290063:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+5:2394:x1875420955945472:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541311.290132:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+5:2394:x1875420955945472:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 70us (7458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541311.290138:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 19 00000100:00100000:3.0:1788541311.290155:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 20 00000100:00100000:3.0:1788541311.290161:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+5:2395:x1875420955945600:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541311.290182:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+5:2395:x1875420955945600:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (7456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541311.290188:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 20 00000100:00100000:3.0:1788541311.290198:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00100000:3.0:1788541311.290213:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74d244c9-cb0c-4783-8214-d6a87bde15a9+5:2396:x1875420955945984:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541311.290237:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74d244c9-cb0c-4783-8214-d6a87bde15a9+5:2396:x1875420955945984:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541311.290243:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00100000:3.0:1788541311.290253:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 22 00000100:00100000:3.0:1788541311.290258:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74d244c9-cb0c-4783-8214-d6a87bde15a9+5:2396:x1875420955946112:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541311.290277:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74d244c9-cb0c-4783-8214-d6a87bde15a9+5:2396:x1875420955946112:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 19us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541311.290282:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 22 00000100:00100000:1.0:1788541311.290375:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955945728 00000100:00100000:1.0:1788541311.290381:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955945728 00000100:00080000:0.0:1788541311.290490:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788541311.290495:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788541311.290497:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788541311.290508:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955945856 00000100:00100000:0.0:1788541311.290511:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955945856 00000100:00100000:0.0:1788541311.290552:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 59 00000100:00100000:0.0:1788541311.290559:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74d244c9-cb0c-4783-8214-d6a87bde15a9+5:2396:x1875420955945856:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541311.290609:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74d244c9-cb0c-4783-8214-d6a87bde15a9+5:2396:x1875420955945856:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 50us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541311.290615:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 59 00000100:00100000:1.0:1788541311.290801:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 60 00000100:00100000:1.0:1788541311.290811:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74d244c9-cb0c-4783-8214-d6a87bde15a9+6:2394:x1875420955945728:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541311.290859:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74d244c9-cb0c-4783-8214-d6a87bde15a9+6:2394:x1875420955945728:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 50us (8103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541311.290867:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 60 00000100:00080000:3.0:1788541311.293919:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788541311.435460:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788541311.435486:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981186944:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788541311.435573:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541311.435642:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981186944 00000100:00100000:3.0:1788541311.435650:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981186944 00000100:00100000:3.0:1788541311.435699:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788541311.435717:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708311180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981186944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788541311.435754:0:17203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788541311.435802:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708311180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981186944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541311.435810:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788541311.435858:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981186944:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788541311.443666:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708312300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981187072:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788541311.443790:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541311.450643:0:18270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981187072 00000100:00100000:1.0:1788541311.450659:0:18270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981187072 00000100:00100000:3.0:1788541311.450862:0:18270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788541311.450892:0:18270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981187072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788541311.450933:0:18270:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788541311.451037:0:18270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981187072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 165us (7246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541311.451044:0:18270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788541311.451678:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708312300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981187072:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788541311.819933:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0F:1788541312.522068:0:17231:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788541312.522090:0:17231:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788541312.522121:0:17231:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788541312.522130:0:17231:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788541312.842076:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541312.971128:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4746c063-6c88-4476-b99b-02bb8e8d54f7:3643:1875420981187200:0@lo:400:kworker.0 00000100:00100000:0.0:1788541312.971207:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541312.971256:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981187712:0@lo:400:kworker.0 00000100:00100000:0.0:1788541312.971284:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541312.971302:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981188224:0@lo:400:kworker.0 00000100:00100000:0.0:1788541312.971340:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541312.971359:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981188736:0@lo:400:kworker.0 00000100:00100000:0.0:1788541312.971380:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541312.971404:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788541312.971410:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981187328:0@lo:400:kworker.0 00000100:00100000:0.0:1788541312.971437:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541312.971457:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981187840:0@lo:400:kworker.0 00000100:00100000:0.0:1788541312.971479:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541312.971496:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875420981188352:0@lo:400:kworker.0 00000100:00100000:0.0:1788541312.971515:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541312.971544:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707885f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981187456:0@lo:400:kworker.0 00000100:00100000:0.0:1788541312.971569:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541312.971590:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981187968:0@lo:400:kworker.0 00000100:00100000:0.0:1788541312.971630:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541312.971652:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707885500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981188480:0@lo:400:kworker.0 00000100:00100000:0.0:1788541312.971676:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541312.971690:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788541312.971736:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981187584:0@lo:400:kworker.0 00000100:00100000:0.0:1788541312.971760:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541312.971780:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981188096:0@lo:400:kworker.0 00000100:00100000:0.0:1788541312.971802:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541312.971819:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875420981188608:0@lo:400:kworker.0 00000100:00100000:0.0:1788541312.971839:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541312.971862:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981187200 00000100:00100000:0.0:1788541312.971890:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981187200 00000100:00100000:0.0:1788541312.971940:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788541312.971948:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:3643:x1875420981187200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541312.971999:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:3643:x1875420981187200:12345-0@lo:400:kworker.0 Request processed in 51us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541312.972007:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788541312.972037:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981187712 00000100:00100000:0.0:1788541312.972041:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981187712 00000100:00100000:0.0:1788541312.972059:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981188224 00000100:00100000:0.0:1788541312.972062:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981188224 00000100:00100000:0.0:1788541312.972070:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981188736 00000100:00100000:0.0:1788541312.972072:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981188736 00000100:00100000:0.0:1788541312.972092:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981188352 00000100:00100000:0.0:1788541312.972094:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981188352 00000100:00100000:0.0:1788541312.972105:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981188480 00000100:00100000:0.0:1788541312.972107:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981188480 00000100:00100000:0.0:1788541312.972131:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981188608 00000100:00100000:0.0:1788541312.972134:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981188608 00000100:00100000:0.0:1788541312.972149:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788541312.972154:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981187712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541312.972186:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981187712:12345-0@lo:400:kworker.0 Request processed in 32us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541312.972203:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788541312.972218:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788541312.972224:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981188224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541312.972254:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981188224:12345-0@lo:400:kworker.0 Request processed in 31us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541312.972260:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788541312.972271:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788541312.972277:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981188736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541312.972303:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981188736:12345-0@lo:400:kworker.0 Request processed in 27us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541312.972310:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788541312.972320:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788541312.972327:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707819f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875420981188352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541312.972352:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707819f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875420981188352:12345-0@lo:400:kworker.0 Request processed in 26us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541312.972358:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788541312.972370:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788541312.972375:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981188480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541312.972404:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981188480:12345-0@lo:400:kworker.0 Request processed in 29us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541312.972410:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788541312.972421:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788541312.972427:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875420981188608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541312.972453:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875420981188608:12345-0@lo:400:kworker.0 Request processed in 26us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541312.972466:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788541312.972492:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981187328 00000100:00100000:0.0:1788541312.972495:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981187328 00000100:00100000:0.0:1788541312.972519:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981187840 00000100:00100000:0.0:1788541312.972522:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981187840 00000100:00100000:0.0:1788541312.972535:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788541312.972540:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981187328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541312.972574:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981187328:12345-0@lo:400:kworker.0 Request processed in 33us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541312.972580:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788541312.972592:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788541312.972598:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981187840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541312.972625:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981187840:12345-0@lo:400:kworker.0 Request processed in 28us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541312.972631:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788541312.972657:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981187456 00000100:00100000:0.0:1788541312.972661:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981187456 00000100:00100000:0.0:1788541312.972685:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981187968 00000100:00100000:0.0:1788541312.972687:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981187968 00000100:00100000:0.0:1788541312.972713:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981187584 00000100:00100000:0.0:1788541312.972716:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981187584 00000100:00100000:0.0:1788541312.972728:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981188096 00000100:00100000:0.0:1788541312.972730:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981188096 00000100:00100000:0.0:1788541312.972741:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788541312.972746:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707819500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981187456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541312.972774:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707819500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981187456:12345-0@lo:400:kworker.0 Request processed in 28us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541312.972779:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788541312.972799:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788541312.972804:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981187968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541312.972831:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981187968:12345-0@lo:400:kworker.0 Request processed in 27us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541312.972837:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788541312.972846:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788541312.972852:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981187584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541312.972906:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981187584:12345-0@lo:400:kworker.0 Request processed in 53us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541312.972912:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788541312.972922:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788541312.972928:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981188096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541312.972952:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981188096:12345-0@lo:400:kworker.0 Request processed in 25us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541312.972958:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788541312.972982:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788541312.972985:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788541312.972988:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788541312.972990:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788541312.973021:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981187584:0@lo:400:kworker.0 00000100:00100000:0.0:1788541312.973032:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981188096:0@lo:400:kworker.0 00000100:00100000:0.0:1788541312.973042:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875420981188608:0@lo:400:kworker.0 00000100:00100000:0.0:1788541312.973051:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707885f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981187456:0@lo:400:kworker.0 00000100:00100000:0.0:1788541312.973060:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981187968:0@lo:400:kworker.0 00010000:00080000:0.0:1788541312.973086:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707885500 x1875420981188480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541312.973097:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707885500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981188480:0@lo:400:kworker.0 00000100:00100000:0.0:1788541312.973145:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981187328:0@lo:400:kworker.0 00000100:00100000:0.0:1788541312.973154:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981187840:0@lo:400:kworker.0 00000100:00100000:0.0:1788541312.973163:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875420981188352:0@lo:400:kworker.0 00000100:00100000:0.0:1788541312.973172:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4746c063-6c88-4476-b99b-02bb8e8d54f7:3643:1875420981187200:0@lo:400:kworker.0 00000100:00100000:0.0:1788541312.973182:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981187712:0@lo:400:kworker.0 00000100:00100000:0.0:1788541312.973193:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981188224:0@lo:400:kworker.0 00010000:00080000:0.0:1788541312.973202:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707886680 x1875420981188736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541312.973210:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981188736:0@lo:400:kworker.0 00000100:00100000:3.0:1788541312.977981:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708312300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981188864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788541312.978045:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541312.978091:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981188864 00000100:00100000:3.0:1788541312.978097:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981188864 00000100:00100000:3.0:1788541312.978140:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788541312.978148:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981188864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788541312.978174:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788541312.978211:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981188864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541312.978218:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788541312.978258:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708312300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981188864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788541312.979975:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981188992:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788541312.980036:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541312.980085:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981188992 00000100:00100000:3.0:1788541312.980090:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981188992 00000100:00100000:3.0:1788541312.980123:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788541312.980130:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708312300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981188992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788541312.980156:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788541312.980190:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708312300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981188992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541312.980197:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788541312.980233:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981188992:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788541312.982069:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981189120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788541312.982140:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541312.982599:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981189120 00000100:00100000:3.0:1788541312.982613:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981189120 00000100:00100000:3.0:1788541312.982664:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788541312.982673:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981189120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788541312.982705:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000001:00080000:2.0:1788541312.987152:0:17178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:2.0:1788541312.987168:0:17178:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a6803281e40 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:2.0:1788541312.987173:0:17178:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a682bebd500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a6803281780 00000020:00080000:2.0:1788541312.987177:0:17178:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a682bebd100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a681e585a00 00010000:00010000:0.0:1788541312.987335:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a8fbc lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541312.987346:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a8fbc lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541312.987354:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a8fbc lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541312.987359:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842048e00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541312.987363:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a8fbc lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541312.987381:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a8fbc lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541312.987402:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6803869400) 00010000:00010000:0.0:1788541312.987406:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541312.987410:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a8fbc lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541312.987416:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a8fbc lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788541312.991964:0:17237:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:2.0:1788541312.992057:0:17237:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:3.0:1788541312.992232:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981189120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9554us (10086us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541312.992245:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788541312.998211:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981189120:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788541313.866454:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541314.379774:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541314.379904:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955946240 00000100:00100000:2.0:1788541314.379915:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955946240 00000100:00100000:2.0:1788541314.379986:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 65 00000100:00100000:2.0:1788541314.379998:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+13:15594:x1875420955946240:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788541314.380122:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+13:15594:x1875420955946240:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 Request processed in 126us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541314.380130:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 65 00000100:00080000:0.0:1788541314.380345:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788541314.388759:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541314.389052:0:19663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955946368 00000100:00100000:0.0:1788541314.389064:0:19663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955946368 00000100:00100000:2.0:1788541314.389264:0:19663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 66 00000100:00100000:2.0:1788541314.389288:0:19663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16a226c0-f2f2-449b-91c5-316ce9e9c327+5:15594:x1875420955946368:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788541314.389415:0:19663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16a226c0-f2f2-449b-91c5-316ce9e9c327+5:15594:x1875420955946368:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 Request processed in 130us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541314.389423:0:19663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 66 00000100:00080000:0.0:1788541314.389566:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788541314.398221:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541314.398427:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955946624 00000100:00100000:2.0:1788541314.398437:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955946624 00000100:00100000:2.0:1788541314.398496:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 12 00000100:00100000:2.0:1788541314.398506:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+13:15594:x1875420955946624:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788541314.398912:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+14:15594:x1875420955946624:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 407us (700us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1788541314.398920:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 12 00010000:00010000:1.0:1788541314.890470:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541315.914249:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541316.046003:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788541316.046030:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981189248:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788541316.046123:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541316.047909:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981189248 00000100:00100000:2.0:1788541316.047923:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981189248 00000100:00100000:2.0:1788541316.048080:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788541316.048092:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981189248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788541316.048126:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788541316.048290:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981189248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 201us (2167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541316.048308:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1788541316.053013:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788541316.053142:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981189248:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788541316.391319:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541316.391418:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541316.391455:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541316.391917:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955947008 00000100:00100000:0.0:1788541316.391929:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955947008 00000100:00100000:0.0:1788541316.392005:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955946880 00000100:00100000:0.0:1788541316.392008:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955946880 00000100:00100000:0.0:1788541316.392040:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 67 00000100:00100000:0.0:1788541316.392053:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+5:2396:x1875420955947008:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541316.392158:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+5:2396:x1875420955947008:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 109us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541316.392168:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 67 00000100:00100000:0.0:1788541316.392207:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 68 00000100:00100000:0.0:1788541316.392214:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+14:2396:x1875420955946880:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541316.392260:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+14:2396:x1875420955946880:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 47us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541316.392267:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 68 00000100:00080000:3.0:1788541316.394095:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788541316.394107:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788541316.394743:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541316.394776:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541316.394805:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541316.394841:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541316.394868:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541316.394914:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541316.395051:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955947136 00000100:00100000:2.0:1788541316.395061:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955947136 00000100:00100000:2.0:1788541316.395122:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955947648 00000100:00100000:2.0:1788541316.395125:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955947648 00000100:00100000:2.0:1788541316.395139:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955947776 00000100:00100000:2.0:1788541316.395142:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955947776 00000100:00100000:2.0:1788541316.395152:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955947264 00000100:00100000:2.0:1788541316.395155:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955947264 00000100:00100000:2.0:1788541316.395171:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 27 00000100:00100000:2.0:1788541316.395180:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68354e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+5:2397:x1875420955947264:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541316.395262:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68354e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+5:2397:x1875420955947264:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 82us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541316.395270:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 27 00000100:00100000:2.0:1788541316.395287:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 27 00000100:00100000:2.0:1788541316.395293:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+5:2393:x1875420955947136:12345-192.168.202.56@tcp:9:kworker.0 00000020:00000080:2.0:1788541316.395322:0:18716:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8ceb 00000100:00080000:2.0:1788541316.395338:0:18716:0:(import.c:65:import_set_state_nolock()) ffff9a670667a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788541316.395391:0:18716:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788541316.395527:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+2:2393:x1875420955947136:12345-192.168.202.56@tcp:9:kworker.0 Request processed in 233us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541316.395534:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 27 00000100:00100000:2.0:1788541316.395546:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 28 00000100:00100000:2.0:1788541316.395552:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74d244c9-cb0c-4783-8214-d6a87bde15a9+5:2393:x1875420955947648:12345-192.168.202.56@tcp:9:kworker.0 00000020:00000080:2.0:1788541316.395563:0:18716:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8d2a 00000100:00080000:2.0:1788541316.395568:0:18716:0:(import.c:65:import_set_state_nolock()) ffff9a6701908800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788541316.395596:0:18716:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788541316.395728:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74d244c9-cb0c-4783-8214-d6a87bde15a9+2:2393:x1875420955947648:12345-192.168.202.56@tcp:9:kworker.0 Request processed in 174us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541316.395735:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 28 00000100:00100000:2.0:1788541316.395747:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 29 00000100:00100000:2.0:1788541316.395754:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74d244c9-cb0c-4783-8214-d6a87bde15a9+5:2393:x1875420955947776:12345-192.168.202.56@tcp:9:kworker.0 00000020:00000080:2.0:1788541316.395765:0:18716:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8d31 00000100:00080000:2.0:1788541316.395771:0:18716:0:(import.c:65:import_set_state_nolock()) ffff9a6701909800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788541316.395796:0:18716:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1788541316.395860:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74d244c9-cb0c-4783-8214-d6a87bde15a9+2:2393:x1875420955947776:12345-192.168.202.56@tcp:9:kworker.0 Request processed in 106us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541316.395867:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 29 00010000:00010000:2.0:1788541316.395921:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541316.395929:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541316.396100:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541316.396263:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955947520 00000100:00100000:0.0:1788541316.396269:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955947520 00000100:00100000:0.0:1788541316.396309:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955947392 00000100:00100000:0.0:1788541316.396312:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955947392 00000100:00100000:0.0:1788541316.396337:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 69 00000100:00100000:0.0:1788541316.396346:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68354e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74d244c9-cb0c-4783-8214-d6a87bde15a9+5:2397:x1875420955947520:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541316.396384:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68354e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74d244c9-cb0c-4783-8214-d6a87bde15a9+5:2397:x1875420955947520:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 40us (1515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541316.396390:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 69 00000100:00100000:0.0:1788541316.396403:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 70 00000100:00100000:0.0:1788541316.396409:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68354e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74d244c9-cb0c-4783-8214-d6a87bde15a9+6:2397:x1875420955947392:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541316.396430:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68354e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74d244c9-cb0c-4783-8214-d6a87bde15a9+6:2397:x1875420955947392:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 21us (1515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541316.396436:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 70 00000100:00080000:3.0:1788541316.397539:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788541316.397547:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788541316.397559:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788541316.397562:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788541316.400293:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955946752 00000100:00100000:1.0:1788541316.400322:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955946752 00000100:00100000:1.0:1788541316.400431:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 167 00000100:00100000:1.0:1788541316.400441:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8172f99-f71c-41fa-8527-cb3efe1827fc+13:2396:x1875420955946752:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541316.400536:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8172f99-f71c-41fa-8527-cb3efe1827fc+13:2396:x1875420955946752:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 96us (9230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541316.400543:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 167 00000100:00100000:0.0:1788541316.554263:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788541316.554293:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68354e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981189376:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788541316.554388:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541316.559358:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788541316.559386:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981189504:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788541316.559460:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541316.562753:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981189376 00000100:00100000:3.0:1788541316.562768:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981189376 00000100:00100000:0.0:1788541316.562897:0:18270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981189504 00000100:00100000:0.0:1788541316.562902:0:18270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981189504 00000100:00100000:0.0:1788541316.563857:0:18270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788541316.563891:0:18270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981189504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788541316.563954:0:18270:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1788541316.564077:0:18270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981189504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 210us (4616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541316.564085:0:18270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788541316.564103:0:18270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788541316.564109:0:18270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981189376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788541316.564126:0:18270:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788541316.564166:0:18270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981189376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (9778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541316.564172:0:18270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788541316.568340:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981189504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788541316.568420:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68354e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981189376:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788541316.941123:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788541317.643014:0:17950:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788541317.962495:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541318.092768:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68354e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981189632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788541318.092853:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541318.092908:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981189632 00000100:00100000:3.0:1788541318.092917:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981189632 00000100:00100000:3.0:1788541318.092985:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788541318.092994:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981189632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788541318.093037:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788541318.093087:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981189632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541318.093094:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788541318.093114:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788541318.093214:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981189888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788541318.093243:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541318.093269:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788541318.093275:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981189760:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788541318.093298:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541318.093370:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981189888 00000100:00100000:0.0:1788541318.093374:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981189888 00000100:00100000:0.0:1788541318.093398:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981189760 00000100:00100000:0.0:1788541318.093401:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981189760 00000100:00100000:0.0:1788541318.093413:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788541318.093418:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981189888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788541318.093434:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788541318.093482:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981189888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541318.093488:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788541318.093508:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788541318.093513:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981189760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788541318.093524:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788541318.093549:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981189760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541318.093555:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1788541318.093566:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788541318.093598:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981189760:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788541318.093611:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981189888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788541318.093979:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981190272:0@lo:400:kworker.0 00000100:00100000:0.0:1788541318.094009:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541318.094039:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981190272 00000100:00100000:0.0:1788541318.094042:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981190272 00000100:00100000:0.0:1788541318.094070:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788541318.094077:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981190272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541318.094112:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981190272:12345-0@lo:400:kworker.0 Request processed in 36us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541318.094118:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788541318.094146:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981190272:0@lo:400:kworker.0 00000100:00100000:0.0:1788541318.094177:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981190400:0@lo:400:kworker.0 00000100:00100000:0.0:1788541318.094202:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541318.094231:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981190400 00000100:00100000:0.0:1788541318.094234:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981190400 00000100:00100000:0.0:1788541318.094260:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788541318.094266:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981190400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541318.094309:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981190400:12345-0@lo:400:kworker.0 Request processed in 43us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541318.094315:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788541318.094344:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981190400:0@lo:400:kworker.0 00000100:00100000:0.0:1788541318.094383:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875420981190784:0@lo:400:kworker.0 00000100:00100000:0.0:1788541318.094403:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541318.094426:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981190784 00000100:00100000:0.0:1788541318.094430:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981190784 00000100:00100000:0.0:1788541318.094455:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788541318.094460:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875420981190784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541318.094489:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875420981190784:12345-0@lo:400:kworker.0 Request processed in 29us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541318.094494:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1788541318.094508:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788541318.094523:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875420981190784:0@lo:400:kworker.0 00000100:00100000:0.0:1788541318.094551:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875420981190912:0@lo:400:kworker.0 00000100:00100000:0.0:1788541318.094572:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541318.094594:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981190912 00000100:00100000:0.0:1788541318.094597:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981190912 00000100:00100000:0.0:1788541318.094620:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788541318.094626:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875420981190912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541318.094670:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875420981190912:12345-0@lo:400:kworker.0 Request processed in 44us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541318.094676:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1788541318.094691:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788541318.094719:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68355f4700 x1875420981190912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541318.094730:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875420981190912:0@lo:400:kworker.0 00000100:00100000:3.0:1788541318.094795:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4746c063-6c88-4476-b99b-02bb8e8d54f7:3641:1875420981190016:0@lo:400:kworker.0 00000100:00100000:3.0:1788541318.094828:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541318.094862:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981190528:0@lo:400:kworker.0 00000100:00100000:3.0:1788541318.094903:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541318.094923:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875420981191040:0@lo:400:kworker.0 00000100:00100000:3.0:1788541318.094942:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541318.094958:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788541318.094963:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981190144:0@lo:400:kworker.0 00000100:00100000:3.0:1788541318.094984:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541318.095065:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981190656:0@lo:400:kworker.0 00000100:00100000:2.0:1788541318.095077:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68354e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981189632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788541318.095086:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541318.095100:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875420981191168:0@lo:400:kworker.0 00000100:00100000:3.0:1788541318.095117:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541318.095152:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981190528 00000100:00100000:3.0:1788541318.095156:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981190528 00000100:00100000:2.0:1788541318.095166:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981191040 00000100:00100000:2.0:1788541318.095169:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981191040 00000100:00100000:2.0:1788541318.095188:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981190656 00000100:00100000:2.0:1788541318.095191:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981190656 00000100:00100000:2.0:1788541318.095202:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981191168 00000100:00100000:3.0:1788541318.095203:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788541318.095204:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981191168 00000100:00100000:2.0:1788541318.095217:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788541318.095222:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68354e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875420981191040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541318.095258:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68354e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875420981191040:12345-0@lo:400:kworker.0 Request processed in 36us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541318.095264:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788541318.095276:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788541318.095280:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68354e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981190656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541318.095304:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68354e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981190656:12345-0@lo:400:kworker.0 Request processed in 24us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541318.095309:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788541318.095320:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788541318.095325:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68354e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875420981191168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541318.095339:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68354e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981190528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541318.095350:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68354e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875420981191168:12345-0@lo:400:kworker.0 Request processed in 25us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541318.095363:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788541318.095377:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68354e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981190528:12345-0@lo:400:kworker.0 Request processed in 157us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541318.095384:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788541318.095409:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981190016 00000100:00100000:0.0:1788541318.095413:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981190016 00000100:00100000:3.0:1788541318.095419:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981190656:0@lo:400:kworker.0 00010000:00080000:3.0:1788541318.095428:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707886680 x1875420981191168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541318.095437:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875420981191168:0@lo:400:kworker.0 00000100:00100000:3.0:1788541318.095446:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981190528:0@lo:400:kworker.0 00000100:00100000:3.0:1788541318.095454:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875420981191040:0@lo:400:kworker.0 00000100:00100000:0.0:1788541318.095483:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788541318.095490:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:3641:x1875420981190016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541318.095528:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:3641:x1875420981190016:12345-0@lo:400:kworker.0 Request processed in 38us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541318.095534:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788541318.095623:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4746c063-6c88-4476-b99b-02bb8e8d54f7:3641:1875420981190016:0@lo:400:kworker.0 00000100:00100000:3.0:1788541318.095970:0:18270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981190144 00000100:00100000:3.0:1788541318.095975:0:18270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981190144 00000100:00100000:3.0:1788541318.096007:0:18270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788541318.096015:0:18270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68354e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981190144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541318.096059:0:18270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68354e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981190144:12345-0@lo:400:kworker.0 Request processed in 44us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541318.096065:0:18270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788541318.096100:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981190144:0@lo:400:kworker.0 00000100:00080000:2.0:1788541318.103736:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788541318.103747:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788541318.103750:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1788541318.474576:0:20586:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 13:01:56 (1788541316) 00010000:00010000:1.0:1788541318.986175:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788541319.115933:0:17178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:2.0:1788541319.115948:0:17178:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:1.0:1788541319.116007:0:17237:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:1.0:1788541319.116022:0:17237:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00010000:00010000:0.0:1788541320.019265:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541321.035204:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541321.163357:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788541321.163446:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f2cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981191296:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788541321.163517:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541321.163806:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981191296 00000100:00100000:2.0:1788541321.163815:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981191296 00000100:00100000:2.0:1788541321.163901:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788541321.163911:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981191296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788541321.163941:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788541321.163999:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981191296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541321.164006:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788541321.164129:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f2cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981191296:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788541321.166861:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541321.510388:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541321.510451:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541321.510479:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541321.510521:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541321.510554:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541321.510600:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541321.510647:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955948160 00000100:00100000:3.0:1788541321.510660:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955948160 00000100:00100000:3.0:1788541321.510726:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955948416 00000100:00100000:3.0:1788541321.510743:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955948416 00000100:00100000:3.0:1788541321.510760:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955948032 00000100:00100000:3.0:1788541321.510762:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955948032 00000100:00100000:3.0:1788541321.510775:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955948544 00000100:00100000:3.0:1788541321.510778:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955948544 00000100:00100000:3.0:1788541321.510795:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 77 00000100:00100000:3.0:1788541321.510806:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68354e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+5:2396:x1875420955948160:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541321.510951:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68354e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+5:2396:x1875420955948160:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 146us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541321.510960:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 77 00000100:00100000:3.0:1788541321.510980:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 78 00000100:00100000:3.0:1788541321.510986:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68354e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74d244c9-cb0c-4783-8214-d6a87bde15a9+6:2396:x1875420955948416:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541321.511011:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68354e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74d244c9-cb0c-4783-8214-d6a87bde15a9+6:2396:x1875420955948416:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541321.511017:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 78 00000100:00100000:3.0:1788541321.511027:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 79 00000100:00100000:3.0:1788541321.511033:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68354e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+13:2396:x1875420955948032:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541321.511056:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68354e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+13:2396:x1875420955948032:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541321.511063:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 79 00000100:00100000:3.0:1788541321.511074:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 80 00000100:00100000:3.0:1788541321.511080:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68354e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74d244c9-cb0c-4783-8214-d6a87bde15a9+5:2396:x1875420955948544:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541321.511101:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68354e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74d244c9-cb0c-4783-8214-d6a87bde15a9+5:2396:x1875420955948544:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 21us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541321.511108:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 80 00000100:00100000:1.0:1788541321.511235:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955947904 00000100:00100000:1.0:1788541321.511240:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955947904 00000100:00100000:1.0:1788541321.511292:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 169 00000100:00100000:1.0:1788541321.511301:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8172f99-f71c-41fa-8527-cb3efe1827fc+13:2396:x1875420955947904:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541321.511336:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8172f99-f71c-41fa-8527-cb3efe1827fc+13:2396:x1875420955947904:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 37us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541321.511343:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 169 00000100:00100000:0.0:1788541321.511783:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955948288 00000100:00100000:0.0:1788541321.511790:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955948288 00000100:00100000:0.0:1788541321.511853:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 29 00000100:00100000:0.0:1788541321.511862:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68354e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+5:2396:x1875420955948288:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541321.511954:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68354e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+5:2396:x1875420955948288:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 93us (1399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541321.511961:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 29 00000100:00080000:0.0:1788541321.511983:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788541321.511989:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788541321.511992:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788541321.674565:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981191424:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788541321.674825:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541321.675521:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68354e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981191552:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788541321.675571:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541321.675747:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981191424 00000100:00100000:0.0:1788541321.675759:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981191424 00000100:00100000:0.0:1788541321.675825:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981191552 00000100:00100000:0.0:1788541321.675829:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981191552 00000100:00100000:0.0:1788541321.675848:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788541321.676046:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981191424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788541321.676096:0:17203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1788541321.676164:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981191424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (1338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541321.676281:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981191424:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788541321.679043:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788541321.679088:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f2cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981191552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788541321.679363:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788541321.679581:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f2cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981191552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 519us (4007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541321.679590:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788541321.682443:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68354e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981191552:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788541321.682973:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:1.0:1788541322.061953:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788541322.194218:0:19530:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 74d244c9-cb0c-4783-8214-d6a87bde15a9 00000020:00000080:1.0:1788541322.194235:0:19530:0:(genops.c:885:class_export_put()) final put ffff9a6701909000/74d244c9-cb0c-4783-8214-d6a87bde15a9 00000020:00000080:2.0:1788541322.194336:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6701909000/74d244c9-cb0c-4783-8214-d6a87bde15a9 for lustre-OST0001 00000020:00000080:2.0:1788541322.194419:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6701909800 for lustre-OST0001 00000001:00100000:3.0:1788541322.194577:0:18713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 74d244c9-cb0c-4783-8214-d6a87bde15a9 00000020:00000080:3.0:1788541322.194582:0:18713:0:(genops.c:885:class_export_put()) final put ffff9a670190d800/74d244c9-cb0c-4783-8214-d6a87bde15a9 00000001:00100000:3.0:1788541322.194607:0:18713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 16a226c0-f2f2-449b-91c5-316ce9e9c327 00000020:00000080:3.0:1788541322.194618:0:18713:0:(genops.c:885:class_export_put()) final put ffff9a670667f800/16a226c0-f2f2-449b-91c5-316ce9e9c327 00000020:00000080:2.0:1788541322.194716:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a670190d800/74d244c9-cb0c-4783-8214-d6a87bde15a9 for lustre-OST0000 00000020:00000080:2.0:1788541322.194751:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a670667f800/16a226c0-f2f2-449b-91c5-316ce9e9c327 for lustre-OST0000 00000020:00000080:2.0:1788541322.194792:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6701908800 for lustre-OST0000 00000020:00000080:2.0:1788541322.194797:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a670667a000 for lustre-OST0000 00000040:00080000:0.0:1788541322.762195:0:17231:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788541322.762209:0:17231:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788541322.762244:0:17231:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788541322.762256:0:17231:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788541323.082123:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541323.210288:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f2cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981191680:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788541323.210334:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68354e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981192064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788541323.210476:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4746c063-6c88-4476-b99b-02bb8e8d54f7:3643:1875420981191936:0@lo:400:kworker.0 00000100:00100000:1.0:1788541323.216106:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541323.218265:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420981192576:0@lo:400:kworker.0 00000100:00100000:1.0:1788541323.218368:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541323.218421:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875420981193088:0@lo:400:kworker.0 00000100:00100000:1.0:1788541323.218449:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541323.218478:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875420981193600:0@lo:400:kworker.0 00000100:00100000:1.0:1788541323.218504:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541323.218580:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981192576 00000100:00100000:1.0:1788541323.218591:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981192576 00000100:00100000:1.0:1788541323.218673:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981193088 00000100:00100000:1.0:1788541323.218677:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981193088 00000100:00100000:1.0:1788541323.218691:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981193600 00000100:00100000:1.0:1788541323.218695:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981193600 00000100:00100000:2.0:1788541323.219666:0:19663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788541323.219689:0:19663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420981192576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541323.219806:0:19663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420981192576:12345-0@lo:400:kworker.0 Request processed in 126us (1438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541323.219815:0:19663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788541323.219845:0:19663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788541323.219852:0:19663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875420981193088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541323.219963:0:19663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875420981193088:12345-0@lo:400:kworker.0 Request processed in 111us (1512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541323.219969:0:19663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788541323.219996:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981192064 00000100:00100000:2.0:1788541323.220003:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981192064 00000100:00100000:3.0:1788541323.220080:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541323.220095:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788541323.220103:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875420981193600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541323.220120:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981191680 00000100:00100000:3.0:1788541323.220124:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981191680 00000100:00100000:0.0:1788541323.220235:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541323.220264:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981191936 00000100:00100000:0.0:1788541323.220268:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981191936 00000100:00100000:0.0:1788541323.220303:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788541323.220311:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:3643:x1875420981191936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541323.220339:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788541323.220344:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:3643:x1875420981191936:12345-0@lo:400:kworker.0 Request processed in 35us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541323.220346:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981192064:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788541323.220351:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00002000:00000024:2.0:1788541323.220376:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788541323.220412:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981192064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (4319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541323.220413:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4746c063-6c88-4476-b99b-02bb8e8d54f7:3643:1875420981191936:0@lo:400:kworker.0 00000100:00100000:2.0:1788541323.220418:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788541323.220426:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981192448:0@lo:400:kworker.0 00000100:00100000:0.0:1788541323.220457:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541323.220470:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981192192:0@lo:400:kworker.0 00000100:00100000:0.0:1788541323.220480:0:19250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981192448 00000100:00100000:0.0:1788541323.220483:0:19250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981192448 00000100:00100000:2.0:1788541323.220501:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541323.220515:0:19250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788541323.220521:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981192704:0@lo:400:kworker.0 00000100:00100000:0.0:1788541323.220521:0:19250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981192448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541323.220542:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541323.220546:0:19250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981192448:12345-0@lo:400:kworker.0 Request processed in 26us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541323.220560:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981193216:0@lo:400:kworker.0 00000100:00100000:0.0:1788541323.220571:0:19250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788541323.220593:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541323.220598:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981192448:0@lo:400:kworker.0 00000100:00100000:0.0:1788541323.220623:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981193216 00000100:00100000:0.0:1788541323.220626:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981193216 00000100:00100000:2.0:1788541323.220632:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788541323.220639:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981192832:0@lo:400:kworker.0 00000100:00100000:0.0:1788541323.220646:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788541323.220651:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f2cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981193216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541323.220663:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541323.220678:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f2cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981193216:12345-0@lo:400:kworker.0 Request processed in 27us (85us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541323.220681:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981193344:0@lo:400:kworker.0 00000100:00100000:0.0:1788541323.220684:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788541323.220700:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981192960:0@lo:400:kworker.0 00000100:00100000:2.0:1788541323.220702:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541323.220728:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981193344 00000100:00100000:2.0:1788541323.220729:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981193216:0@lo:400:kworker.0 00000100:00100000:0.0:1788541323.220731:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981193344 00000100:00100000:0.0:1788541323.220750:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788541323.220755:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f2cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981193344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541323.220759:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981192192 00000100:00100000:2.0:1788541323.220762:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981192192 00000100:00100000:2.0:1788541323.220783:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981192704 00000100:00100000:2.0:1788541323.220787:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981192704 00000100:00100000:0.0:1788541323.220788:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f2cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981193344:12345-0@lo:400:kworker.0 Request processed in 32us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541323.220794:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788541323.220800:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788541323.220805:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f2ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981192192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541323.220810:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788541323.220815:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f2cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981192704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541323.220843:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f2cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981192704:12345-0@lo:400:kworker.0 Request processed in 28us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541323.220850:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788541323.220852:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f2ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981192192:12345-0@lo:400:kworker.0 Request processed in 47us (350us total) trans 0 rc 0/0 00010000:00080000:0.0:1788541323.220901:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67080d6300 x1875420981193344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541323.220913:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981193344:0@lo:400:kworker.0 00000100:00100000:0.0:1788541323.220933:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981192192:0@lo:400:kworker.0 00000100:00100000:0.0:1788541323.220941:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981192704:0@lo:400:kworker.0 00000100:00100000:0.0:1788541323.220972:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541323.220995:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981192832 00000100:00100000:0.0:1788541323.220999:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981192832 00000100:00100000:0.0:1788541323.221025:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981192960 00000100:00100000:0.0:1788541323.221028:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981192960 00000100:00100000:0.0:1788541323.221044:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788541323.221049:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f2cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981192832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541323.221093:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f2cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981192832:12345-0@lo:400:kworker.0 Request processed in 43us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541323.221099:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788541323.221110:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788541323.221116:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3643:x1875420981192960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541323.221139:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3643:x1875420981192960:12345-0@lo:400:kworker.0 Request processed in 24us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541323.221144:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788541323.221172:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981192832:0@lo:400:kworker.0 00000100:00100000:0.0:1788541323.221193:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981192960:0@lo:400:kworker.0 00000100:00100000:0.0:1788541323.221200:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875420981193472:0@lo:400:kworker.0 00000100:00100000:0.0:1788541323.221224:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541323.221242:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981193472 00000100:00100000:0.0:1788541323.221246:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981193472 00000100:00100000:0.0:1788541323.221264:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788541323.221269:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875420981193472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541323.221276:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788541323.221283:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68354e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981191680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788541323.221303:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788541323.221305:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875420981193472:12345-0@lo:400:kworker.0 Request processed in 35us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541323.221311:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788541323.221333:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875420981193472:0@lo:400:kworker.0 00000100:00100000:3.0:1788541323.221334:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68354e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981191680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541323.221340:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788541323.221407:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f2cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981191680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788541323.221414:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981191808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541323.221439:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541323.221456:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981191808 00000100:00100000:3.0:1788541323.221459:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981191808 00000100:00080000:0.0:1788541323.221473:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541323.221477:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1788541323.221478:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788541323.221480:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541323.221482:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68354e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981191808:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788541323.221483:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00002000:00000024:3.0:1788541323.221492:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788541323.221509:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68354e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981192064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788541323.221514:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68354e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981191808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (74us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541323.221519:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788541323.221523:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420981192576:0@lo:400:kworker.0 00000100:00100000:0.0:1788541323.221536:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875420981193088:0@lo:400:kworker.0 00000100:00100000:3.0:1788541323.221543:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981191808:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788541323.221549:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67080d5f80 x1875420981193600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541323.221556:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981192320:0@lo:400:kworker.0 00000100:00100000:0.0:1788541323.221559:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875420981193600:0@lo:400:kworker.0 00000100:00100000:3.0:1788541323.221578:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541323.221595:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981192320 00000100:00100000:3.0:1788541323.221599:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981192320 00000100:00100000:3.0:1788541323.221633:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788541323.221640:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68354e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981192320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541323.221667:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68354e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981192320:12345-0@lo:400:kworker.0 Request processed in 28us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541323.221674:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788541323.221698:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981192320:0@lo:400:kworker.0 00000100:00100000:2.0:1788541323.221784:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788541323.222065:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875420981193600:12345-0@lo:400:kworker.0 Request processed in 39us (1636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541323.222085:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788541323.245634:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541323.246283:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955948800 00000100:00100000:2.0:1788541323.246298:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955948800 00000100:00100000:2.0:1788541323.246393:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 13 00000100:00100000:2.0:1788541323.246406:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68354e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+13:16356:x1875420955948800:12345-192.168.202.56@tcp:35:umount.0 00000001:00080000:2.0:1788541323.246733:0:17202:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1788541323.246850:0:17202:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00080000:0.0:1788541323.247257:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788541323.249725:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68354e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+16:16356:x1875420955948800:12345-192.168.202.56@tcp:35:umount.0 Request processed in 3307us (4091us total) trans 8589934626 rc 0/0 00000100:00100000:2.0:1788541323.249743:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 13 00000020:00080000:2.0:1788541323.249750:0:17202:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788541323.254123:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541323.254187:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541323.254414:0:20350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955949056 00000100:00100000:2.0:1788541323.254440:0:20350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955949056 00000100:00100000:2.0:1788541323.254525:0:20350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955948928 00000100:00100000:2.0:1788541323.254529:0:20350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955948928 00000100:00100000:2.0:1788541323.254704:0:20350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 3 00000100:00100000:2.0:1788541323.254718:0:20350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68354e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8172f99-f71c-41fa-8527-cb3efe1827fc+14:2394:x1875420955949056:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541323.254744:0:20350:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541323.254774:0:20350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a683551ac00/0x2aac941e5f4a8ccf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3315ef expref: 14 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541323.254799:0:20350:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541323.254951:0:20350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68354e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8172f99-f71c-41fa-8527-cb3efe1827fc+13:2394:x1875420955949056:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 235us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541323.254960:0:20350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 3 00000100:00100000:2.0:1788541323.254984:0:20350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 4 00000100:00100000:2.0:1788541323.255310:0:20350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378aac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8172f99-f71c-41fa-8527-cb3efe1827fc+12:2394:x1875420955948928:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541323.255322:0:20350:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541323.255334:0:20350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6706957200/0x2aac941e5f4a8cc8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3315be expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541323.255346:0:20350:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541323.255369:0:20350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378aac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8172f99-f71c-41fa-8527-cb3efe1827fc+11:2394:x1875420955948928:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 378us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541323.255376:0:20350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 4 00000100:00100000:0.0:1788541323.283424:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541323.283575:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541323.284248:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955949184 00000100:00100000:2.0:1788541323.284264:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955949184 00000100:00100000:2.0:1788541323.284365:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 30 00000100:00100000:2.0:1788541323.284378:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+5:2393:x1875420955949184:12345-192.168.202.56@tcp:9:umount.0 00000020:00000080:2.0:1788541323.284464:0:18717:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8cf2 00000100:00080000:2.0:1788541323.284476:0:18717:0:(import.c:65:import_set_state_nolock()) ffff9a682fedc000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788541323.284539:0:18717:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1788541323.284765:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+2:2393:x1875420955949184:12345-192.168.202.56@tcp:9:umount.0 Request processed in 388us (1355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541323.284774:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 30 00010000:00010000:2.0:1788541323.284803:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788541323.286464:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788541323.290370:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955949312 00000100:00100000:1.0:1788541323.290394:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955949312 00000100:00100000:1.0:1788541323.290513:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 5 00000100:00100000:1.0:1788541323.290526:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707885500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8172f99-f71c-41fa-8527-cb3efe1827fc+11:2395:x1875420955949312:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788541323.290550:0:17183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541323.290578:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a8d8c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3316a5 expref: 11 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541323.290615:0:17183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541323.290714:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707885500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8172f99-f71c-41fa-8527-cb3efe1827fc+10:2395:x1875420955949312:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 189us (7138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541323.290723:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 5 00000100:00100000:0.0:1788541323.302542:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541323.305495:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955950208 00000100:00100000:2.0:1788541323.305527:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955950208 00000100:00100000:3.0:1788541323.309462:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 67 00000100:00100000:3.0:1788541323.309483:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+16:2393:x1875420955950208:12345-192.168.202.56@tcp:39:umount.0 00000020:00000080:3.0:1788541323.309542:0:17200:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8cdd 00000020:00010000:3.0:1788541323.309583:0:17200:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a682fedd000: total 0 00000100:00080000:3.0:1788541323.309590:0:17200:0:(import.c:65:import_set_state_nolock()) ffff9a682fede000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788541323.309702:0:17200:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:3.0:1788541323.309975:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+15:2393:x1875420955950208:12345-192.168.202.56@tcp:39:umount.0 Request processed in 496us (7449us total) trans 8589934627 rc 0/0 00000100:00100000:3.0:1788541323.309985:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 67 00000020:00010000:1.0:1788541323.313009:0:17187:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a682fedd000: total 0 00010000:00010000:1.0:1788541323.313024:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541323.313124:0:17187:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a682fedd000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1788541323.313175:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6803869100) 00010000:00010000:1.0:1788541323.313181:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788541323.313199:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957800/0x2aac941e5f4a8e03 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3316c1 expref: 14 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541323.313228:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6803869400) 00010000:00010000:1.0:1788541323.313230:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788541323.313235:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172400/0x2aac941e5f4a8f92 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33173f expref: 13 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541323.313259:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a6803869b00) 00010000:00010000:1.0:1788541323.313282:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788541323.313289:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957a00/0x2aac941e5f4a8da8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3316ac expref: 12 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541323.313309:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6835327100) 00010000:00010000:1.0:1788541323.313311:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788541323.313316:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957c00/0x2aac941e5f4a8e88 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3316eb expref: 11 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541323.313335:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6835327200) 00010000:00010000:1.0:1788541323.313338:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788541323.313342:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a8f37 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33172a expref: 10 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541323.313357:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6835327200) 00010000:00010000:1.0:1788541323.313361:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788541323.313364:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8f06 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331715 expref: 9 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541323.313378:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6835327200) 00010000:00010000:1.0:1788541323.313380:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788541323.313384:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68043cdc00/0x2aac941e5f4a8ff4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331762 expref: 8 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541323.313401:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a68350c0000) 00010000:00010000:1.0:1788541323.313403:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541323.313407:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049800/0x2aac941e5f4a8dc4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3316b3 expref: 7 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541323.313436:0:17187:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a682fedd000, canceled 8 locks, left on hash table 0. 00010000:00010000:1.0:1788541323.313451:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541323.313453:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541323.313456:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541323.325796:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541323.326126:0:19663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955950336 00000100:00100000:0.0:1788541323.326142:0:19663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955950336 00000100:00100000:0.0:1788541323.326305:0:19663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 68 00000100:00100000:0.0:1788541323.326320:0:19663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68354e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16a226c0-f2f2-449b-91c5-316ce9e9c327+5:2393:x1875420955950336:12345-192.168.202.56@tcp:39:umount.0 00000020:00000080:0.0:1788541323.326374:0:19663:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8ce4 00000100:00080000:0.0:1788541323.326396:0:19663:0:(import.c:65:import_set_state_nolock()) ffff9a6839113800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788541323.326461:0:19663:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1788541323.326715:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541323.327035:0:19663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68354e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16a226c0-f2f2-449b-91c5-316ce9e9c327+3:2393:x1875420955950336:12345-192.168.202.56@tcp:39:umount.0 Request processed in 716us (1253us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788541323.327045:0:19663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 68 00000100:00080000:2.0:1788541323.327866:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788541324.106334:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541325.130201:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541325.260820:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541325.261004:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541325.261144:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541325.261204:0:20350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955950592 00000100:00100000:2.0:1788541325.261218:0:20350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955950592 00000100:00100000:2.0:1788541325.261295:0:20350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955950464 00000100:00100000:2.0:1788541325.261300:0:20350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955950464 00000100:00100000:2.0:1788541325.261330:0:20350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 6 00000100:00100000:2.0:1788541325.261342:0:20350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707885f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8172f99-f71c-41fa-8527-cb3efe1827fc+11:2395:x1875420955950592:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541325.261361:0:20350:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541325.261389:0:20350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a683551be00/0x2aac941e5f4a8d0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33165f expref: 11 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541325.261407:0:20350:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541325.261487:0:20350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707885f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8172f99-f71c-41fa-8527-cb3efe1827fc+10:2395:x1875420955950592:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 146us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541325.261495:0:20350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 6 00000100:00100000:2.0:1788541325.261516:0:20350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:2.0:1788541325.261524:0:20350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707884380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8172f99-f71c-41fa-8527-cb3efe1827fc+9:2394:x1875420955950464:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541325.261566:0:20350:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541325.261577:0:20350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a683551b000/0x2aac941e5f4a8d07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33162e expref: 9 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541325.261597:0:20350:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541325.261619:0:20350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707884380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8172f99-f71c-41fa-8527-cb3efe1827fc+8:2394:x1875420955950464:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 96us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541325.261627:0:20350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:2.0:1788541325.262342:0:20350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955950720 00000100:00100000:2.0:1788541325.262349:0:20350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955950720 00000100:00100000:2.0:1788541325.262397:0:20350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 8 00000100:00100000:2.0:1788541325.262415:0:20350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707884a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8172f99-f71c-41fa-8527-cb3efe1827fc+8:2394:x1875420955950720:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541325.262426:0:20350:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541325.262439:0:20350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68043cc200/0x2aac941e5f4a8d85 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33169e expref: 8 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541325.262453:0:20350:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541325.262500:0:20350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707884a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8172f99-f71c-41fa-8527-cb3efe1827fc+7:2394:x1875420955950720:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 96us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541325.262507:0:20350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 8 00000100:00100000:2.0:1788541325.269013:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541325.269145:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955950976 00000100:00100000:0.0:1788541325.269160:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955950976 00000100:00100000:0.0:1788541325.269291:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 69 00000100:00100000:0.0:1788541325.269304:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f2cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74d244c9-cb0c-4783-8214-d6a87bde15a9+6:2393:x1875420955950976:12345-192.168.202.56@tcp:39:umount.0 00000020:00000080:0.0:1788541325.269360:0:17199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8d1c 00000020:00010000:0.0:1788541325.269372:0:17199:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a681e533000: total 0 00000100:00080000:0.0:1788541325.269378:0:17199:0:(import.c:65:import_set_state_nolock()) ffff9a681e530000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788541325.269430:0:17199:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:0.0:1788541325.269651:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f2cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74d244c9-cb0c-4783-8214-d6a87bde15a9+5:2393:x1875420955950976:12345-192.168.202.56@tcp:39:umount.0 Request processed in 348us (654us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1788541325.269660:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 69 00000020:00010000:1.0:1788541325.270944:0:17186:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a681e533000: total 0 00010000:00010000:1.0:1788541325.271027:0:17186:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a681e533000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788541325.271071:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6803869100) 00010000:00010000:1.0:1788541325.271076:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788541325.271090:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68043cd200/0x2aac941e5f4a8e11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3316c8 expref: 4 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541325.271122:0:17186:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a681e533000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788541325.271135:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541325.271137:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541325.271149:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788541325.271704:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788541325.277692:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541325.278009:0:19663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955951104 00000100:00100000:0.0:1788541325.278024:0:19663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955951104 00000100:00100000:0.0:1788541325.278120:0:19663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 70 00000100:00100000:0.0:1788541325.278134:0:19663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74d244c9-cb0c-4783-8214-d6a87bde15a9+5:2393:x1875420955951104:12345-192.168.202.56@tcp:39:umount.0 00000020:00000080:0.0:1788541325.278199:0:19663:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8d23 00000100:00080000:0.0:1788541325.278212:0:19663:0:(import.c:65:import_set_state_nolock()) ffff9a681e537000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788541325.278307:0:19663:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:0.0:1788541325.278521:0:19663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74d244c9-cb0c-4783-8214-d6a87bde15a9+3:2393:x1875420955951104:12345-192.168.202.56@tcp:39:umount.0 Request processed in 389us (843us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788541325.278562:0:19663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 70 00000100:00080000:2.0:1788541325.278908:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788541325.279980:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541325.317621:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541325.318526:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955951360 00000100:00100000:3.0:1788541325.318615:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955951360 00000100:00100000:3.0:1788541325.318692:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 171 00000100:00100000:3.0:1788541325.318705:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8172f99-f71c-41fa-8527-cb3efe1827fc+7:2393:x1875420955951360:12345-192.168.202.56@tcp:251:umount.0 00000020:00000080:3.0:1788541325.318765:0:17193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8cba 00000020:00010000:3.0:1788541325.318774:0:17193:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a682e795000: total 0 00000100:00080000:3.0:1788541325.318780:0:17193:0:(import.c:65:import_set_state_nolock()) ffff9a682e792800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788541325.318967:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8172f99-f71c-41fa-8527-cb3efe1827fc+3:2393:x1875420955951360:12345-192.168.202.56@tcp:251:umount.0 Request processed in 265us (1359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541325.318976:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 171 00000020:00010000:1.0:1788541325.326379:0:17187:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a682e795000: total 0 00010000:00010000:1.0:1788541325.326507:0:17187:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a682e795000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788541325.326767:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6706956e00/0x2aac941e5f4a8cc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3315b7 expref: 2 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541325.326793:0:17187:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a682e795000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788541325.326809:0:17187:0:(genops.c:885:class_export_put()) final put ffff9a682e795000/b8172f99-f71c-41fa-8527-cb3efe1827fc 00010000:00010000:1.0:1788541325.326836:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541325.326839:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541325.326841:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788541325.326938:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682e795000/b8172f99-f71c-41fa-8527-cb3efe1827fc for MGS 00000020:00000080:2.0:1788541325.327007:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a682e792800 for MGS 00010000:00010000:0.0:1788541326.154051:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541326.289498:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788541326.289537:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f2cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981193728:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788541326.289660:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541326.289993:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981193728 00000100:00100000:2.0:1788541326.290007:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981193728 00000100:00100000:3.0:1788541326.292146:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788541326.292165:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981193728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788541326.292216:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00080000:0.0:1788541326.292279:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541326.292339:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981193728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 179us (2680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541326.292348:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788541326.292410:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f2cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981193728:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788541326.794974:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788541326.795005:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981193856:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788541326.795111:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541326.795623:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981193856 00000100:00100000:1.0:1788541326.795662:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981193856 00000100:00100000:1.0:1788541326.795745:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788541326.795757:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981193856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788541326.795804:0:17203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788541326.795894:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981193856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541326.795983:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788541326.796925:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981193856:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788541326.798388:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f2cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981193984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788541326.798481:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541326.798604:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981193984 00000100:00100000:2.0:1788541326.798641:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981193984 00000100:00100000:2.0:1788541326.798706:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788541326.798716:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981193984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788541326.798776:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788541326.798837:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981193984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541326.798844:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788541326.799935:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f2cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981193984:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788541327.178155:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788541327.224336:0:20781:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788541327.245272:0:20781:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788541327.245366:0:20781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551a200/0x2aac941e5f4a887d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8884 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541327.245386:0:20781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551a200/0x2aac941e5f4a887d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a8884 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541327.245396:0:20781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551a200/0x2aac941e5f4a887d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a8884 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541327.245403:0:20781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9a683551a200/0x2aac941e5f4a887d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a8884 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541327.245460:0:20781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788541327.245468:0:20781:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788541327.245500:0:20781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788541327.245506:0:20781:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788541327.245514:0:20781:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788541327.245548:0:20781:0:(import.c:65:import_set_state_nolock()) ffff9a6835181000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788541327.245664:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541327.245673:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a683551a200/0x2aac941e5f4a887d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a8884 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541327.245681:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551a200 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:1.0:1788541327.245686:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a683551a200/0x2aac941e5f4a887d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a8884 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541327.245697:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a683551a200/0x2aac941e5f4a887d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x2aac941e5f4a8884 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788541327.245705:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a683551a200/0x2aac941e5f4a887d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x2aac941e5f4a8884 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788541327.245711:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788541327.245715:0:17187:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788541327.245718:0:17187:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788541327.245752:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a683551a200/0x2aac941e5f4a887d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a8884 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541327.245759:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788541327.245820:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4746c063-6c88-4476-b99b-02bb8e8d54f7:3644:1875420981194240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788541327.245960:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788541327.246063:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a683551a200/0x2aac941e5f4a887d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a8884 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541327.246087:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a683551a200/0x2aac941e5f4a887d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a8884 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541327.246102:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541327.246104:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541327.246106:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541327.246125:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981194240 00000100:00100000:1.0:1788541327.246134:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981194240 00000100:00100000:1.0:1788541327.246198:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788541327.246209:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707886680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:3644:x1875420981194240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788541327.246227:0:17183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541327.246246:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6800031e00/0x2aac941e5f4a8884 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a887d expref: 24 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541327.246263:0:17183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541327.246473:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875420981194112:0@lo:39:umount.0 00000100:00100000:2.0:1788541327.246556:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541327.247211:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981194112 00000100:00100000:3.0:1788541327.247221:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981194112 00000100:00100000:3.0:1788541327.247282:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788541327.247294:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f2cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875420981194112:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788541327.247329:0:17199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a88ae 00000100:00080000:3.0:1788541327.247341:0:17199:0:(import.c:65:import_set_state_nolock()) ffff9a6837915800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788541327.247442:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f2cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3640:x1875420981194112:12345-0@lo:39:umount.0 Request processed in 151us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541327.247468:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:3.0:1788541327.247481:0:17199:0:(genops.c:885:class_export_put()) final put ffff9a6835183000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1788541327.247513:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788541327.247531:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6835183000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:2.0:1788541327.247582:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6835181000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788541327.247609:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875420981194112:0@lo:39:umount.0 00000020:00000080:3.0:1788541327.247634:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6837915800 for lustre-MDT0000 00000100:00100000:1.0:1788541327.251987:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707886680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4746c063-6c88-4476-b99b-02bb8e8d54f7+23:3644:x1875420981194240:12345-0@lo:103:ldlm_bl.0 Request processed in 5758us (6005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541327.252012:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788541327.252337:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4746c063-6c88-4476-b99b-02bb8e8d54f7:3644:1875420981194240:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788541327.252384:0:20781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788541327.252391:0:20781:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788541327.252398:0:20781:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788541327.254079:0:20781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075ad000/0x2aac941e5f4a87ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a87d5 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541327.254104:0:20781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075ad000/0x2aac941e5f4a87ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a87d5 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541327.254113:0:20781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075ad000/0x2aac941e5f4a87ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a87d5 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541327.254120:0:20781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9a67075ad000/0x2aac941e5f4a87ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a87d5 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541327.254189:0:20781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541327.254196:0:20781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68043cda00/0x2aac941e5f4a8b16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8b1d expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541327.254222:0:20781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68043cda00/0x2aac941e5f4a8b16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a8b1d expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541327.254229:0:20781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68043cda00/0x2aac941e5f4a8b16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a8b1d expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541327.254236:0:20781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9a68043cda00/0x2aac941e5f4a8b16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a8b1d expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541327.258548:0:19546:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788541327.258581:0:19546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a67075ad000/0x2aac941e5f4a87ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a87d5 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541327.258607:0:19546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ad000 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:3.0:1788541327.258614:0:19546:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a67075ad000/0x2aac941e5f4a87ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a87d5 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541327.258629:0:19546:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a67075ad000/0x2aac941e5f4a87ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x2aac941e5f4a87d5 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788541327.258637:0:19546:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a67075ad000/0x2aac941e5f4a87ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x2aac941e5f4a87d5 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541327.258643:0:19546:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788541327.258647:0:19546:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788541327.258711:0:19546:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a67075ad000/0x2aac941e5f4a87ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a87d5 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541327.258718:0:19546:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788541327.258828:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4746c063-6c88-4476-b99b-02bb8e8d54f7:3641:1875420981194368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788541327.258947:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788541327.259062:0:19546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a67075ad000/0x2aac941e5f4a87ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a87d5 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541327.259072:0:19546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a67075ad000/0x2aac941e5f4a87ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a87d5 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541327.259119:0:19546:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541327.259124:0:19546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a68043cda00/0x2aac941e5f4a8b16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a8b1d expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541327.259129:0:19546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68043cda00 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:3.0:1788541327.259132:0:19546:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a68043cda00/0x2aac941e5f4a8b16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a8b1d expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541327.259140:0:19546:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a68043cda00/0x2aac941e5f4a8b16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2aac941e5f4a8b1d expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788541327.259147:0:19546:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a68043cda00/0x2aac941e5f4a8b16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2aac941e5f4a8b1d expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541327.259153:0:19546:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788541327.259160:0:19546:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1788541327.259177:0:19546:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a68043cda00/0x2aac941e5f4a8b16 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a8b1d expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541327.259183:0:19546:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788541327.259290:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981194368 00000100:00100000:2.0:1788541327.259307:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981194368 00000100:00100000:2.0:1788541327.259386:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788541327.259398:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4746c063-6c88-4476-b99b-02bb8e8d54f7+23:3641:x1875420981194368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788541327.259414:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541327.259433:0:20781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788541327.259434:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6800031000/0x2aac941e5f4a87d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a87ce expref: 23 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541327.259451:0:20781:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788541327.259459:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788541327.259468:0:20781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a8d77 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8d7e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541327.259480:0:20781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a8d77 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a8d7e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541327.259487:0:20781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a8d77 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a8d7e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541327.259496:0:20781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a8d77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a8d7e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541327.259520:0:20781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788541327.259561:0:19546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a68043cda00/0x2aac941e5f4a8b16 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a8b1d expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541327.259578:0:19546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a68043cda00/0x2aac941e5f4a8b16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a8b1d expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541327.259642:0:20781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075ac400/0x2aac941e5f4a87c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a87c7 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541327.259649:0:20781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075ac400/0x2aac941e5f4a87c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a87c7 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541327.259663:0:20781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075ac400/0x2aac941e5f4a87c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a87c7 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541327.259669:0:20781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9a67075ac400/0x2aac941e5f4a87c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a87c7 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541327.259678:0:20781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788541327.259681:0:20781:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788541327.259684:0:20781:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788541327.259733:0:20781:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788541327.259737:0:20781:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788541327.259743:0:20781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788541327.259750:0:20781:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:0.0:1788541327.259757:0:20781:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9a682ff9f800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788541327.259764:0:20781:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9a680a576000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788541327.259770:0:20781:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9a680a577800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788541327.259785:0:20781:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9a682e97c800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788541327.259794:0:20781:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9a681e533000 74d244c9-cb0c-4783-8214-d6a87bde15a9 192.168.202.56@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:0.0:1788541327.259800:0:20781:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9a682fedd000 16a226c0-f2f2-449b-91c5-316ce9e9c327 192.168.202.56@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:0.0:1788541327.259806:0:20781:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9a682fe0b380) has exports, disconnecting them 00000020:00080000:0.0:1788541327.259811:0:20781:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a682ff9f800), last request at 1788541323 00000020:00000080:0.0:1788541327.259820:0:20781:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8ae5 00000100:00080000:0.0:1788541327.259841:0:20781:0:(import.c:65:import_set_state_nolock()) ffff9a682ff99000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788541327.259934:0:20781:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a682ff9f800): rc 0 00000020:00000080:0.0:1788541327.259937:0:20781:0:(genops.c:885:class_export_put()) final put ffff9a682ff9f800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788541327.259956:0:20781:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a680a576000), last request at 1788541323 00000020:00000080:0.0:1788541327.259962:0:20781:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8a4b 00000100:00080000:0.0:1788541327.259969:0:20781:0:(import.c:65:import_set_state_nolock()) ffff9a680a572000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788541327.259981:0:20781:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a680a576000): rc 0 00000020:00000080:0.0:1788541327.259983:0:20781:0:(genops.c:885:class_export_put()) final put ffff9a680a576000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1788541327.259989:0:20781:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a680a577800), last request at 1788541255 00000020:00000080:0.0:1788541327.259993:0:20781:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a899c 00000100:00080000:0.0:1788541327.259997:0:20781:0:(import.c:65:import_set_state_nolock()) ffff9a680a574000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788541327.260003:0:20781:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a680a577800): rc 0 00000020:00000080:0.0:1788541327.260006:0:20781:0:(genops.c:885:class_export_put()) final put ffff9a680a577800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1788541327.260013:0:20781:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a682e97c800), last request at 1788541255 00000020:00000080:0.0:1788541327.260018:0:20781:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8941 00000100:00080000:0.0:1788541327.260024:0:20781:0:(import.c:65:import_set_state_nolock()) ffff9a682fdc2800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788541327.260032:0:20781:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00100000:2.0:1788541327.260081:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4746c063-6c88-4476-b99b-02bb8e8d54f7+22:3641:x1875420981194368:12345-0@lo:103:ldlm_bl.0 Request processed in 626us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541327.260092:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000020:00080000:0.0:1788541327.260133:0:20781:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a682e97c800): rc 0 00000004:00000080:0.0:1788541327.260143:0:20781:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb5cdc1d03ae0 00000100:00080000:0.0:1788541327.260166:0:20781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788541327.260170:0:20781:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788541327.261283:0:20781:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788541327.261321:0:20781:0:(import.c:65:import_set_state_nolock()) ffff9a670774b000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788541327.261540:0:19546:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788541327.261547:0:19546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a8d77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a8d7e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541327.261593:0:19546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75fe00 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:3.0:1788541327.261598:0:19546:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a8d77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a8d7e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541327.261609:0:19546:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a8d77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x2aac941e5f4a8d7e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788541327.261617:0:19546:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a8d77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x2aac941e5f4a8d7e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541327.261624:0:19546:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788541327.261627:0:19546:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788541327.261631:0:19546:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788541327.261665:0:19546:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a8d77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a8d7e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541327.261671:0:19546:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788541327.261695:0:19546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a8d77 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a8d7e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541327.261703:0:19546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a8d77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a8d7e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541327.261713:0:19546:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541327.261716:0:19546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a67075ac400/0x2aac941e5f4a87c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a87c7 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541327.261721:0:19546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ac400 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:3.0:1788541327.261724:0:19546:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a67075ac400/0x2aac941e5f4a87c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a87c7 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541327.261738:0:19546:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a67075ac400/0x2aac941e5f4a87c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2aac941e5f4a87c7 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788541327.261744:0:19546:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a67075ac400/0x2aac941e5f4a87c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2aac941e5f4a87c7 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541327.261748:0:19546:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788541327.261750:0:19546:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788541327.261753:0:19546:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788541327.261780:0:19546:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a67075ac400/0x2aac941e5f4a87c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a87c7 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541327.261787:0:19546:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788541327.261794:0:19546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a67075ac400/0x2aac941e5f4a87c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a87c7 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541327.261800:0:19546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a67075ac400/0x2aac941e5f4a87c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a87c7 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541327.261811:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541327.261813:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541327.261815:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541327.261838:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4746c063-6c88-4476-b99b-02bb8e8d54f7:3643:1875420981194752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788541327.261963:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541327.262028:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788541327.262035:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4746c063-6c88-4476-b99b-02bb8e8d54f7:3643:1875420981194880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788541327.262079:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541327.262117:0:20350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981194752 00000100:00100000:3.0:1788541327.262132:0:20350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981194752 00000100:00100000:3.0:1788541327.262188:0:20350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981194880 00000100:00100000:3.0:1788541327.262191:0:20350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981194880 00000100:00100000:3.0:1788541327.262214:0:20350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788541327.262224:0:20350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4746c063-6c88-4476-b99b-02bb8e8d54f7+23:3643:x1875420981194752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788541327.262239:0:20350:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541327.262257:0:20350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a683551bc00/0x2aac941e5f4a8d7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a8d77 expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541327.262273:0:20350:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541327.262314:0:20350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4746c063-6c88-4476-b99b-02bb8e8d54f7+22:3643:x1875420981194752:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541327.262322:0:20350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788541327.262375:0:20350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788541327.262382:0:20350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670917c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4746c063-6c88-4476-b99b-02bb8e8d54f7+21:3643:x1875420981194880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788541327.262389:0:20350:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541327.262399:0:20350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6800031c00/0x2aac941e5f4a87c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a87c0 expref: 21 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541327.262411:0:20350:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541327.262432:0:20350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670917c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4746c063-6c88-4476-b99b-02bb8e8d54f7+20:3643:x1875420981194880:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541327.262439:0:20350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000020:00000080:3.0:1788541327.262462:0:18310:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682ff9f800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788541327.262519:0:18310:0:(genops.c:844:class_export_destroy()) destroying export ffff9a680a576000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788541327.262548:0:18310:0:(genops.c:844:class_export_destroy()) destroying export ffff9a680a577800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788541327.262587:0:18310:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a682ff99000 for lustre-MDT0000 00000020:00000080:3.0:1788541327.262594:0:18310:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a680a572000 for lustre-MDT0000 00000020:00000080:3.0:1788541327.262605:0:18310:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a680a574000 for lustre-MDT0000 00010000:00010000:3.0:1788541327.262617:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541327.262654:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4746c063-6c88-4476-b99b-02bb8e8d54f7:3643:1875420981194880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788541327.262664:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4746c063-6c88-4476-b99b-02bb8e8d54f7:3643:1875420981194752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788541327.263101:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4746c063-6c88-4476-b99b-02bb8e8d54f7:3641:1875420981194368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788541327.263119:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788541327.263128:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4746c063-6c88-4476-b99b-02bb8e8d54f7:3641:1875420981194496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788541327.263163:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788541327.263317:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541327.263330:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981194496 00000100:00100000:1.0:1788541327.263344:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981194496 00000100:00100000:1.0:1788541327.263378:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788541327.263386:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4746c063-6c88-4476-b99b-02bb8e8d54f7+20:3641:x1875420981194496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788541327.263396:0:17183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541327.263407:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68043cd400/0x2aac941e5f4a8b1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a8b16 expref: 20 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541327.263418:0:17183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541327.263450:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4746c063-6c88-4476-b99b-02bb8e8d54f7+19:3641:x1875420981194496:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541327.263457:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788541327.263483:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4746c063-6c88-4476-b99b-02bb8e8d54f7:3641:1875420981194496:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788541327.263674:0:20781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788541327.263680:0:20781:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:0.0:1788541327.263703:0:20781:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788541327.263778:0:20781:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788541327.263909:0:20781:0:(import.c:65:import_set_state_nolock()) ffff9a682ff81800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788541327.263923:0:20781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788541327.263926:0:20781:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:0.0:1788541327.263937:0:20781:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788541327.264020:0:20781:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788541327.264031:0:20781:0:(import.c:65:import_set_state_nolock()) ffff9a682ff82000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788541327.264084:0:20781:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9a682fe0b380) has no exports 00000100:00100000:3.0:1788541327.265288:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981194624:0@lo:39:umount.0 00000100:00100000:3.0:1788541327.265364:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541327.265441:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707885500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981195008:0@lo:9:umount.0 00000100:00100000:3.0:1788541327.265470:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541327.265492:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707885f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981195136:0@lo:9:umount.0 00000100:00100000:3.0:1788541327.265514:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541327.265563:0:19664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981195008 00000100:00100000:3.0:1788541327.265590:0:19664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981195008 00000100:00100000:3.0:1788541327.265651:0:19664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981195136 00000100:00100000:3.0:1788541327.265654:0:19664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981195136 00000100:00100000:3.0:1788541327.265677:0:19664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788541327.265686:0:19664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670917f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1875420981195008:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788541327.265719:0:19664:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8b24 00000100:00080000:3.0:1788541327.265729:0:19664:0:(import.c:65:import_set_state_nolock()) ffff9a682e797000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788541327.265948:0:19664:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788541327.266146:0:19664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670917f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3640:x1875420981195008:12345-0@lo:9:umount.0 Request processed in 460us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541327.266154:0:19664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788541327.266170:0:19664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788541327.266176:0:19664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670917d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1875420981195136:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788541327.266188:0:19664:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8b2b 00000100:00080000:3.0:1788541327.266195:0:19664:0:(import.c:65:import_set_state_nolock()) ffff9a6835339000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788541327.266233:0:19664:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1788541327.266303:0:19664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670917d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3640:x1875420981195136:12345-0@lo:9:umount.0 Request processed in 127us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541327.266309:0:19664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1788541327.266332:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788541327.266336:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788541327.266350:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788541327.266384:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a682ff81800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788541327.266398:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788541327.266400:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788541327.266403:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707885500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981195008:0@lo:9:umount.0 00000100:00080000:3.0:1788541327.266414:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a682ff82000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788541327.266424:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788541327.266426:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788541327.266428:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707885f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981195136:0@lo:9:umount.0 00010000:00010000:3.0:1788541327.266458:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541327.267151:0:18270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981194624 00000100:00100000:0.0:1788541327.267159:0:18270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981194624 00000100:00100000:0.0:1788541327.267217:0:18270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788541327.267227:0:18270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670917ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875420981194624:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788541327.267254:0:18270:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a89c6 00000100:00080000:0.0:1788541327.267263:0:18270:0:(import.c:65:import_set_state_nolock()) ffff9a67067e2000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788541327.267284:0:18270:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1788541327.267424:0:18270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670917ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3640:x1875420981194624:12345-0@lo:39:umount.0 Request processed in 198us (2059us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788541327.267431:0:18270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1788541327.267482:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a670774b000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788541327.267490:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981194624:0@lo:39:umount.0 00010000:00010000:1.0:1788541327.269347:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788541327.285364:0:20781:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9a682fe0b380) has no exports 00000020:00000080:2.0:1788541327.366382:0:20781:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a881b 00000020:00000080:2.0:1788541327.366398:0:20781:0:(genops.c:885:class_export_put()) final put ffff9a682e803000/lustre-QMT0000_UUID 00000020:01000000:2.0:1788541327.366425:0:20781:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788541327.366575:0:18310:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682e803000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788541327.366604:0:20781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788541327.366615:0:20781:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788541327.366619:0:20781:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9a6835313380) has no exports 00000020:00000080:3.0:1788541327.367074:0:20781:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8814 00000020:00000080:3.0:1788541327.367081:0:20781:0:(genops.c:885:class_export_put()) final put ffff9a68112dc800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788541327.367167:0:18310:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68112dc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788541327.367319:0:20781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788541327.367328:0:20781:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788541327.367331:0:20781:0:(genops.c:885:class_export_put()) final put ffff9a68112d9000/lustre-QMT0000_UUID 00000020:00000080:3.0:1788541327.367333:0:20781:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68112d9000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788541327.367338:0:20781:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000040:00080000:1.0:1788541327.885327:0:17950:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788541328.203276:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541328.330469:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f2cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981195264:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788541328.330542:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541328.330692:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981195264 00000100:00100000:2.0:1788541328.330700:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981195264 00000100:00100000:2.0:1788541328.330767:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788541328.330777:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670917c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981195264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788541328.330807:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788541328.330851:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670917c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981195264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541328.330858:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1788541328.330937:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788541328.330974:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f2cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981195264:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788541328.338830:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981195648:0@lo:400:kworker.0 00000100:00100000:3.0:1788541328.338951:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541328.338994:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981195648 00000100:00100000:3.0:1788541328.339002:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981195648 00000100:00100000:3.0:1788541328.339063:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788541328.339072:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670917f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981195648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541328.339122:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670917f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981195648:12345-0@lo:400:kworker.0 Request processed in 51us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541328.339129:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1788541328.339158:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788541328.339176:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981195520:0@lo:400:kworker.0 00000100:00100000:3.0:1788541328.339195:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981195648:0@lo:400:kworker.0 00000100:00100000:3.0:1788541328.339202:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875420981196160:0@lo:400:kworker.0 00000100:00100000:2.0:1788541328.339206:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541328.339224:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541328.339224:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981196032:0@lo:400:kworker.0 00000100:00100000:2.0:1788541328.339242:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541328.339470:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981195520 00000100:00100000:0.0:1788541328.339475:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981195520 00000100:00100000:0.0:1788541328.339508:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788541328.339514:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f2cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1875420981195520:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788541328.339520:0:17203:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788541328.339570:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f2cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1875420981195520:12345-0@lo:400:kworker.0 Request processed in 55us (362us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788541328.339576:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788541328.339598:0:19663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981196160 00000100:00100000:0.0:1788541328.339602:0:19663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981196160 00000100:00100000:0.0:1788541328.339624:0:19663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981196032 00000100:00100000:0.0:1788541328.339641:0:19663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981196032 00000100:00100000:0.0:1788541328.339687:0:19663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788541328.339694:0:19663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f2ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981196032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541328.339726:0:19663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f2ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981196032:12345-0@lo:400:kworker.0 Request processed in 33us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541328.339732:0:19663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788541328.339743:0:19663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788541328.339747:0:19663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670917dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1875420981196160:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788541328.339751:0:19663:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788541328.339773:0:19663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670917dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1875420981196160:12345-0@lo:400:kworker.0 Request processed in 25us (548us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788541328.339778:0:19663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788541328.339800:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4746c063-6c88-4476-b99b-02bb8e8d54f7:3642:1875420981195392:0@lo:400:kworker.0 00000100:00100000:0.0:1788541328.339830:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541328.339856:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875420981195904:0@lo:400:kworker.0 00000100:00100000:0.0:1788541328.339992:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541328.340011:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788541328.340018:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875420981195776:0@lo:400:kworker.0 00000100:00100000:0.0:1788541328.340040:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541328.340054:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875420981196288:0@lo:400:kworker.0 00000100:00100000:0.0:1788541328.340073:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541328.340097:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981195392 00000100:00100000:0.0:1788541328.340101:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981195392 00000100:00100000:0.0:1788541328.340128:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788541328.340136:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+19:3642:x1875420981195392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541328.340169:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+19:3642:x1875420981195392:12345-0@lo:400:kworker.0 Request processed in 34us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541328.340184:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788541328.340214:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981195904 00000100:00100000:0.0:1788541328.340218:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981195904 00000100:00100000:0.0:1788541328.340230:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981195776 00000100:00100000:0.0:1788541328.340233:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981195776 00000100:00100000:0.0:1788541328.340239:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981196288 00000100:00100000:0.0:1788541328.340241:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981196288 00000100:00100000:0.0:1788541328.340255:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788541328.340260:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875420981196288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541328.340288:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875420981196288:12345-0@lo:400:kworker.0 Request processed in 28us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541328.340295:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788541328.340307:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788541328.340311:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875420981195904:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788541328.340317:0:17199:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788541328.340334:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875420981195904:12345-0@lo:400:kworker.0 Request processed in 22us (343us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788541328.340340:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788541328.340356:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788541328.340360:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875420981195776:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788541328.340365:0:17199:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788541328.340383:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875420981195776:12345-0@lo:400:kworker.0 Request processed in 22us (343us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788541328.340388:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1788541328.340408:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788541328.340431:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788541328.340437:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9a682ff9a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788541328.340446:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788541328.343301:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788541328.343309:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9a6707aa2000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788541328.343314:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788541328.343320:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9a6707aa2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788541328.343324:0:3643:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 535 00000100:00080000:2.0:1788541328.343333:0:3643:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9a6707aa2000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:2.0:1788541328.343372:0:3643:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a683f2ce300 x1875420981196416/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788541328.343411:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981195520:0@lo:400:kworker.0 00010000:00080000:2.0:1788541328.343429:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670917ed80 x1875420981196032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541328.343440:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981196032:0@lo:400:kworker.0 00000100:00100000:1.0:1788541328.343520:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f2ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981196416:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788541328.343592:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541328.345920:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981196416 00000100:00100000:2.0:1788541328.345936:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981196416 00000100:00100000:2.0:1788541328.346016:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788541328.346024:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875420981196416:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1788541328.346043:0:17204:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1788541328.356100:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788541328.356110:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a670190c000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788541328.356114:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788541328.356120:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a670190c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788541328.356124:0:3644:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 565 00000100:00080000:3.0:1788541328.356133:0:3644:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a670190c000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1788541328.356179:0:3644:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a670917d880 x1875420981196544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788541328.356215:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875420981196160:0@lo:400:kworker.0 00000100:00100000:1.0:1788541328.356279:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875420981196544:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788541328.356339:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541328.356399:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981196544 00000100:00100000:3.0:1788541328.356410:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981196544 00000100:00100000:3.0:1788541328.356462:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788541328.356469:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875420981196544:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1788541328.356489:0:17199:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788541328.356541:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875420981196544:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 72us (201us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788541328.356548:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1788541328.356588:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a670190c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788541328.356593:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788541328.356596:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875420981196544:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1788541328.376849:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9a682ff9a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788541328.376862:0:3642:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 536 00000100:00080000:0.0:1788541328.377129:0:3642:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9a682ff9a800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:0.0:1788541328.377176:0:3642:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6707885f80 x1875420981196672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788541328.377207:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875420981195776:0@lo:400:kworker.0 00010000:00080000:0.0:1788541328.377248:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670917df80 x1875420981196288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541328.377259:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875420981196288:0@lo:400:kworker.0 00000100:00100000:0.0:1788541328.377271:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4746c063-6c88-4476-b99b-02bb8e8d54f7:3642:1875420981195392:0@lo:400:kworker.0 00000100:00080000:0.0:1788541328.377282:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788541328.377286:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9a683f192800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788541328.377290:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788541328.377293:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9a683f192800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788541328.377296:0:3642:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 550 00000100:00080000:0.0:1788541328.377301:0:3642:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a683f192800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:0.0:1788541328.377313:0:3642:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6707885500 x1875420981196800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788541328.377323:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875420981195904:0@lo:400:kworker.0 00000100:00100000:0.0:1788541328.377442:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707885f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875420981196672:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788541328.377529:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541328.377570:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707885500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875420981196800:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788541328.377592:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541328.377632:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981196672 00000100:00100000:0.0:1788541328.377639:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981196672 00000100:00100000:0.0:1788541328.377668:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981196800 00000100:00100000:0.0:1788541328.377671:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981196800 00000100:00100000:0.0:1788541328.377690:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788541328.377697:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875420981196672:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1788541328.377713:0:17198:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788541328.377750:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875420981196672:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 51us (221us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788541328.377757:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788541328.377774:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788541328.377778:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875420981196800:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1788541328.377785:0:17198:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788541328.377804:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875420981196800:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 25us (211us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788541328.377809:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1788541328.377828:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a682ff9a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788541328.377832:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788541328.377835:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707885f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875420981196672:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1788541328.377842:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a683f192800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788541328.377845:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788541328.377848:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707885500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875420981196800:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788541328.404355:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875420981196416:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 58325us (60757us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788541328.404370:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1788541328.404493:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6707aa2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788541328.404515:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788541328.404520:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f2ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981196416:0@lo:38:ptlrpcd_00_02.0 00000001:00100000:3.0:1788541328.844005:0:17930:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788541328.844030:0:17930:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:3.0:1788541328.844038:0:17930:0:(genops.c:885:class_export_put()) final put ffff9a683f194800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788541328.844112:0:17930:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 74d244c9-cb0c-4783-8214-d6a87bde15a9 00000001:00080000:3.0:1788541328.844117:0:17930:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:3.0:1788541328.844121:0:17930:0:(genops.c:885:class_export_put()) final put ffff9a681e534000/74d244c9-cb0c-4783-8214-d6a87bde15a9 00000001:00100000:1.0:1788541328.846796:0:19530:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788541328.846809:0:19530:0:(genops.c:885:class_export_put()) final put ffff9a683533f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788541328.846897:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a683f194800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1788541328.847152:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a67067e2000 for lustre-MDT0001 00000001:00100000:3.0:1788541328.847861:0:17930:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 16a226c0-f2f2-449b-91c5-316ce9e9c327 00000001:00080000:3.0:1788541328.847886:0:17930:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:3.0:1788541328.847892:0:17930:0:(genops.c:885:class_export_put()) final put ffff9a682e793800/16a226c0-f2f2-449b-91c5-316ce9e9c327 00000020:00000080:0.0:1788541328.848128:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a681e534000/74d244c9-cb0c-4783-8214-d6a87bde15a9 for lustre-MDT0001 00000020:00000080:0.0:1788541328.848173:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682e793800/16a226c0-f2f2-449b-91c5-316ce9e9c327 for lustre-MDT0001 00000020:00000080:0.0:1788541328.848208:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a681e537000 for lustre-MDT0001 00000020:00000080:0.0:1788541328.848213:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6839113800 for lustre-MDT0001 00000001:00100000:1.0:1788541328.848381:0:19530:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 16a226c0-f2f2-449b-91c5-316ce9e9c327 00000020:00000080:1.0:1788541328.848385:0:19530:0:(genops.c:885:class_export_put()) final put ffff9a682fed8000/16a226c0-f2f2-449b-91c5-316ce9e9c327 00000020:00000080:0.0:1788541328.848557:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a683533f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788541328.848583:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682fed8000/16a226c0-f2f2-449b-91c5-316ce9e9c327 for lustre-OST0001 00000020:00000080:0.0:1788541328.848606:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6835339000 for lustre-OST0001 00000020:00000080:0.0:1788541328.848611:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a682fedc000 for lustre-OST0001 00000001:00100000:3.0:1788541328.849054:0:17178:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788541328.849060:0:17178:0:(genops.c:885:class_export_put()) final put ffff9a682e97c800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788541328.849083:0:17178:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 74d244c9-cb0c-4783-8214-d6a87bde15a9 00000001:00080000:3.0:1788541328.849090:0:17178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:3.0:1788541328.849094:0:17178:0:(genops.c:885:class_export_put()) final put ffff9a681e533000/74d244c9-cb0c-4783-8214-d6a87bde15a9 00000001:00100000:3.0:1788541328.849100:0:17178:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 16a226c0-f2f2-449b-91c5-316ce9e9c327 00000001:00080000:3.0:1788541328.849105:0:17178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:3.0:1788541328.849133:0:17178:0:(genops.c:885:class_export_put()) final put ffff9a682fedd000/16a226c0-f2f2-449b-91c5-316ce9e9c327 00000020:00000080:2.0:1788541328.849185:0:18310:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682e97c800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788541328.849235:0:18310:0:(genops.c:844:class_export_destroy()) destroying export ffff9a681e533000/74d244c9-cb0c-4783-8214-d6a87bde15a9 for lustre-MDT0000 00000020:00000080:2.0:1788541328.849259:0:18310:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682fedd000/16a226c0-f2f2-449b-91c5-316ce9e9c327 for lustre-MDT0000 00000020:00000080:2.0:1788541328.849293:0:18310:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a682fdc2800 for lustre-MDT0000 00000020:00000080:2.0:1788541328.849298:0:18310:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a681e530000 for lustre-MDT0000 00000020:00000080:2.0:1788541328.849302:0:18310:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a682fede000 for lustre-MDT0000 00010000:00010000:3.0:1788541329.226376:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788541329.418787:0:20781:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a680825cd80 - data ffff9a6839e36af8/ffff9a681e512000 00000020:01000000:3.0:1788541329.419305:0:20781:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a6802dad900 - data ffff9a680b73fa20/ffff9a680438f800 00000001:00000004:3.0:1788541329.430518:0:20781:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:3.0:1788541329.539500:0:20781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788541329.539513:0:20781:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788541329.539532:0:20781:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9a6707887b80 x1875420981194624/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788541337 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541329.539577:0:20781:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788541329.545736:0:20781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788541329.545750:0:20781:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:3.0:1788541329.545782:0:20781:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788541329.545785:0:20781:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788541329.546536:0:17222:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788541329.546575:0:17222:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1788541329.546590:0:17222:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1788541329.547536:0:20781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788541329.547557:0:20781:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:3.0:1788541329.547574:0:20781:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788541329.547577:0:20781:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788541329.550912:0:17224:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788541329.550922:0:17224:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:1.0:1788541329.550937:0:17224:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1788541329.553660:0:20781:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a87e3 00000020:00000080:3.0:1788541329.553678:0:20781:0:(genops.c:885:class_export_put()) final put ffff9a6835523000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788541329.555392:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6835523000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788541329.560263:0:20781:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a87f8 00000020:00000080:3.0:1788541329.560283:0:20781:0:(genops.c:885:class_export_put()) final put ffff9a682ff80000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788541329.560346:0:20781:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788541329.560353:0:20781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788541329.560372:0:20781:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788541329.560377:0:20781:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9a682fe099c0) has no exports 00000004:01000000:3.0:1788541329.560592:0:20781:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788541329.560603:0:20781:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a885a 00000020:00000080:3.0:1788541329.560607:0:20781:0:(genops.c:885:class_export_put()) final put ffff9a670774e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788541329.561728:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682ff80000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788541329.561824:0:20781:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788541329.561848:0:20781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788541329.561890:0:20781:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788541329.561895:0:20781:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9a6835314d40) has no exports 00000020:00000080:3.0:1788541329.561906:0:20781:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8853 00000020:00000080:3.0:1788541329.561911:0:20781:0:(genops.c:885:class_export_put()) final put ffff9a682ff80800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788541329.562359:0:20781:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788541329.562365:0:20781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788541329.562561:0:20781:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:3.0:1788541329.562569:0:20781:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788541329.562572:0:20781:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788541329.562612:0:20781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788541329.562620:0:20781:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788541329.562629:0:20781:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8845 00000020:00000080:3.0:1788541329.562635:0:20781:0:(genops.c:885:class_export_put()) final put ffff9a682e804800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788541329.562640:0:20781:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788541329.562645:0:20781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788541329.562650:0:20781:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788541329.562653:0:20781:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9a683ec13380) has no exports 00000020:00000080:3.0:1788541329.562659:0:20781:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a883e 00000020:00000080:3.0:1788541329.562662:0:20781:0:(genops.c:885:class_export_put()) final put ffff9a682ff83800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788541329.563124:0:20781:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788541329.563128:0:20781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788541329.563130:0:20781:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:3.0:1788541329.563134:0:20781:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788541329.563136:0:20781:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788541329.563168:0:20781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788541329.563174:0:20781:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788541329.563189:0:20781:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788541329.563197:0:20781:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8830 00000020:00000080:3.0:1788541329.563202:0:20781:0:(genops.c:885:class_export_put()) final put ffff9a682ff86800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788541329.563206:0:20781:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788541329.563210:0:20781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788541329.563213:0:20781:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788541329.563224:0:20781:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff9a670695cd40) has no exports 00000020:00000080:3.0:1788541329.563229:0:20781:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8829 00000020:00000080:3.0:1788541329.563233:0:20781:0:(genops.c:885:class_export_put()) final put ffff9a6707748000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788541329.563905:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a670774e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788541329.563918:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682ff80800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788541329.563926:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a682ff82000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788541329.563935:0:36:0:(genops.c:885:class_export_put()) final put ffff9a682e805000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788541329.563937:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682e805000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788541329.563942:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788541329.564050:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682e804800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788541329.564057:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682ff83800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788541329.564062:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a682ff81800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788541329.564067:0:36:0:(genops.c:885:class_export_put()) final put ffff9a682ff87000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788541329.564069:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682ff87000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788541329.564073:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788541329.564114:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682ff86800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788541329.564121:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6707748000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788541329.580967:0:20781:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788541329.580981:0:20781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788541329.580988:0:20781:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788541329.581000:0:20781:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788541329.581073:0:20781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788541329.581090:0:20781:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788541329.581124:0:20781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788541329.581128:0:20781:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788541329.581135:0:20781:0:(genops.c:885:class_export_put()) final put ffff9a6835524800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788541329.581141:0:20781:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6835524800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788541329.581157:0:20781:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788541329.581293:0:20781:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a87ff 00000020:00000080:0.0:1788541329.581302:0:20781:0:(genops.c:885:class_export_put()) final put ffff9a682ff82800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788541329.581308:0:20781:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788541329.581312:0:20781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788541329.581318:0:20781:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788541329.581322:0:20781:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9a683ec119c0) has no exports 00000020:00000080:0.0:1788541329.581349:0:20781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788541329.581352:0:20781:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788541329.581356:0:20781:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8806 00000020:00000080:0.0:1788541329.581360:0:20781:0:(genops.c:885:class_export_put()) final put ffff9a682ff81000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788541329.581382:0:20781:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a67082f3800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788541329.581386:0:20781:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a67082f3800 3 00000020:01000004:0.0:1788541329.581389:0:20781:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a67082f3800 from lustre-MDT0000 00000020:00000080:0.0:1788541329.581418:0:20781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788541329.581422:0:20781:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788541329.581424:0:20781:0:(genops.c:885:class_export_put()) final put ffff9a6835521000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788541329.581426:0:20781:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6835521000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788541329.581622:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a670774b000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788541329.581633:0:36:0:(genops.c:885:class_export_put()) final put ffff9a6837917800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788541329.581635:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6837917800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788541329.581645:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788541329.581681:0:20781:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:1.0:1788541329.581714:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682ff82800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788541329.581717:0:36:0:(genops.c:885:class_export_put()) final put ffff9a682ff86000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788541329.581719:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682ff86000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000004:0.0:1788541329.581722:0:20781:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:1.0:1788541329.581723:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:0.0:1788541329.581728:0:20781:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788541329.581731:0:20781:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788541329.581734:0:20781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788541329.581737:0:20781:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788541329.581745:0:20781:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9a6835523800 4746c063-6c88-4476-b99b-02bb8e8d54f7 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00000080:1.0:1788541329.581747:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682ff81000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:0.0:1788541329.581751:0:20781:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9a6707914d40) has exports, disconnecting them 00000020:00080000:0.0:1788541329.581756:0:20781:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9a6835523800), last request at 1788541240 00000020:00000080:0.0:1788541329.581773:0:20781:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a87ab 00000020:00010000:0.0:1788541329.581778:0:20781:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a6835523800: total 0 00000100:00080000:0.0:1788541329.581783:0:20781:0:(import.c:65:import_set_state_nolock()) ffff9a6835526000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788541329.581814:0:20781:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a6835523800): rc 0 00000020:00080000:0.0:1788541329.581819:0:20781:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9a6707914d40) has no exports 00000100:00100000:0.0:1788541329.581919:0:17192:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9a6831cfa800:17192] 1 exiting: rc = 0 00000100:00100000:0.0:1788541329.582038:0:17191:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9a67078f2e00:17191] 0 exiting: rc = 1 00000100:00100000:0.0:1788541329.582100:0:17193:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9a6831cfb600:17193] 2 exiting: rc = 0 00000100:00100000:0.0:1788541329.582167:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.582176:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.582183:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.582192:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.582198:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.582204:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.582211:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.582217:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.582223:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.582229:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.582236:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.582242:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.582248:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.582255:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.582262:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.582268:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.582274:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.582289:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.582295:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.582302:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.582308:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.582314:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.582321:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.582327:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.582334:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.582341:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.582347:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.582355:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.582361:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.582367:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.582373:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.582379:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.582385:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.582391:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.582397:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:1.0:1788541329.582678:0:17187:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a6835523800: total 0 00010000:00010000:1.0:1788541329.582684:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541329.582725:0:17187:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a6835523800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788541329.582765:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a67075ac000/0x2aac941e5f4a8a0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a8a05 expref: 14 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541329.582787:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a682e75f000/0x2aac941e5f4a8aa6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a8a9f expref: 13 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541329.582800:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a683551a800/0x2aac941e5f4a8d54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a8d4d expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541329.582811:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6706957000/0x2aac941e5f4a88ca lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a88c3 expref: 11 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541329.582825:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6800030a00/0x2aac941e5f4a8a36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a8a2f expref: 10 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541329.582849:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a683551aa00/0x2aac941e5f4a8d62 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a8d5b expref: 9 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541329.582860:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a683551a600/0x2aac941e5f4a8987 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a8980 expref: 8 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541329.582888:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6706956400/0x2aac941e5f4a88d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a88d1 expref: 7 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541329.582901:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6706956800/0x2aac941e5f4a87b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a87b2 expref: 6 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541329.582911:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a682e75f200/0x2aac941e5f4a8d70 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a8d69 expref: 5 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541329.582924:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6706956a00/0x2aac941e5f4a88e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a88df expref: 4 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541329.582935:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a682e75e000/0x2aac941e5f4a8ad0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a8ac9 expref: 3 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541329.582950:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6706956200/0x2aac941e5f4a8b0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a8b08 expref: 2 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541329.582960:0:17187:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a6835523800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1788541329.582976:0:17187:0:(genops.c:885:class_export_put()) final put ffff9a6835523800/4746c063-6c88-4476-b99b-02bb8e8d54f7 00010000:00010000:1.0:1788541329.582994:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541329.582996:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541329.582998:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788541329.583014:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6835523800/4746c063-6c88-4476-b99b-02bb8e8d54f7 for MGS 00000020:00000080:1.0:1788541329.583051:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6835526000 for MGS 00000100:00100000:0.0:1788541329.583112:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.583126:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.583133:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.583138:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.583145:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.583151:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.583158:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.583166:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.583172:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.583179:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.583185:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.583191:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.583197:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.583204:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.583210:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.583217:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.583222:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.583237:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.583243:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.583249:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.583255:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.583261:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.583280:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.583288:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.583295:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.583301:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.583308:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.583315:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541329.583321:0:20781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1788541329.585482:0:20781:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a67019c04e0 - data ffff9a6839db7bd0/ffff9a681e4bbc00 00000020:01000000:0.0:1788541329.585652:0:20781:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a683f2f5480 - data ffff9a6839ca3360/ffff9a6708018c00 00000020:00000080:0.0:1788541329.586243:0:20781:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a878f 00000020:00000080:0.0:1788541329.586255:0:20781:0:(genops.c:885:class_export_put()) final put ffff9a67082dc800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788541329.586275:0:20781:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a67082f3800 from MGS, refs=2 00000020:01000004:0.0:1788541329.586279:0:20781:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a67082f3800 2 00000020:01000004:0.0:1788541329.586284:0:20781:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a67082f3800 from MGS 00000020:00000080:0.0:1788541329.586311:0:20781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788541329.586319:0:20781:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788541329.586321:0:20781:0:(genops.c:885:class_export_put()) final put ffff9a67082de000/MGS 00000020:00000080:0.0:1788541329.586325:0:20781:0:(genops.c:844:class_export_destroy()) destroying export ffff9a67082de000/MGS for MGS 00000020:01000000:0.0:1788541329.586333:0:20781:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788541329.586426:0:20781:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788541329.586431:0:20781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788541329.586437:0:20781:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788541329.586445:0:20781:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9a6835186000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788541329.586452:0:20781:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9a6707913380) has exports, disconnecting them 00000020:00080000:0.0:1788541329.586458:0:20781:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9a6835186000), last request at 1788541240 00000020:00000080:0.0:1788541329.586463:0:20781:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8892 00000020:00080000:0.0:1788541329.586474:0:20781:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a6835186000): rc 0 00000020:00000080:0.0:1788541329.586493:0:20781:0:(genops.c:885:class_export_put()) final put ffff9a6835186000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788541329.587302:0:18310:0:(genops.c:844:class_export_destroy()) destroying export ffff9a67082dc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788541329.587318:0:18310:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6835186000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788541329.587932:0:20781:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788541329.587939:0:20781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788541329.587945:0:20781:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788541329.587952:0:20781:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788541329.587985:0:18310:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6835181000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788541329.588219:0:20781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788541329.588229:0:20781:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788541329.588235:0:20781:0:(genops.c:885:class_export_put()) final put ffff9a683f357800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788541329.588239:0:20781:0:(genops.c:844:class_export_destroy()) destroying export ffff9a683f357800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788541329.588259:0:20781:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788541329.588375:0:20781:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a67082f3800 1 00000020:00000080:1.0:1788541329.588382:0:20781:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8781 00000020:00000080:1.0:1788541329.588389:0:20781:0:(genops.c:885:class_export_put()) final put ffff9a67082d9800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788541329.588411:0:20781:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788541329.588421:0:18310:0:(genops.c:844:class_export_destroy()) destroying export ffff9a67082d9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788541329.588440:0:20781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788541329.588444:0:20781:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788541329.588449:0:20781:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9a682fe08000) has no exports 00000020:00000080:1.0:1788541329.659627:0:20781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788541329.659647:0:20781:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788541329.659654:0:20781:0:(genops.c:885:class_export_put()) final put ffff9a67082f1000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788541329.659660:0:20781:0:(genops.c:844:class_export_destroy()) destroying export ffff9a67082f1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788541329.659678:0:20781:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788541329.660022:0:20781:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a67082f7000 00000020:02000400:1.0:1788541329.660099:0:20781:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788541330.250294:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541331.277401:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541331.402417:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788541331.402448:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f2cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981196928:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788541331.402553:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541331.402646:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981196928 00000100:00100000:2.0:1788541331.402657:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981196928 00000100:00100000:2.0:1788541331.402744:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788541331.402755:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670917e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981196928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788541331.402793:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788541331.402853:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670917e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981196928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541331.402862:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788541331.403028:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541331.403079:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f2cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981196928:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788541332.298320:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788541332.950442:0:18713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788541332.950453:0:18713:0:(genops.c:885:class_export_put()) final put ffff9a682e790800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788541332.950765:0:18310:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682e790800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788541332.950825:0:18310:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a682e797000 for lustre-OST0000 00010000:00010000:1.0:1788541333.321997:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788541333.450701:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788541333.450709:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788541333.450713:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a6707aa2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788541333.450721:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 609 00000100:00080000:2.0:1788541333.450728:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788541333.450745:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9a6707aa2000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:2.0:1788541333.450771:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a683f2cdf80 x1875420981197184/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788541333.450812:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788541333.450815:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788541333.450817:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a682ff9a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788541333.450821:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 609 00000100:00080000:2.0:1788541333.450824:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788541333.450827:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9a682ff9a800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:2.0:1788541333.450839:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a683f2cc000 x1875420981197568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788541333.450848:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788541333.450851:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788541333.450852:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a683f192800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788541333.450855:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 609 00000100:00080000:2.0:1788541333.450857:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788541333.450860:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a683f192800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:2.0:1788541333.450889:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a683f2cea00 x1875420981197696/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788541333.450905:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788541333.450908:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788541333.450910:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a670190c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788541333.450912:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 609 00000100:00080000:2.0:1788541333.450914:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788541333.450923:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a670190c000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:2.0:1788541333.450933:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a683f2cdc00 x1875420981197952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788541333.450997:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f2ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981197312:0@lo:400:kworker.0 00000100:00100000:2.0:1788541333.451076:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541333.451144:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981198208:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788541333.451169:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541333.451197:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788541333.451203:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f2cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4746c063-6c88-4476-b99b-02bb8e8d54f7:3644:1875420981197056:0@lo:400:kworker.0 00000400:00000100:2.0:1788541333.451221:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875420981197056 offset 0 length 224: 4 00000100:00100000:2.0:1788541333.451235:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683558ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875420981198080:0@lo:400:kworker.0 00000100:00100000:2.0:1788541333.451255:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541333.451281:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f2cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981197184:0@lo:38:kworker.0 00000100:00100000:2.0:1788541333.451320:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541333.451355:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f2cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875420981197568:0@lo:38:kworker.0 00000100:00100000:2.0:1788541333.451383:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541333.451400:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f2cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875420981197696:0@lo:38:kworker.0 00000100:00100000:2.0:1788541333.451419:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541333.451435:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f2cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875420981197952:0@lo:38:kworker.0 00000100:00100000:2.0:1788541333.451453:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541333.451482:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f2cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981197440:0@lo:400:kworker.0 00000100:00100000:2.0:1788541333.451503:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541333.451531:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788541333.451537:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f2cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981197824:0@lo:400:kworker.0 00000100:00100000:2.0:1788541333.451567:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541333.451596:0:19250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981197312 00000100:00100000:2.0:1788541333.451604:0:19250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981197312 00000100:00100000:2.0:1788541333.451655:0:19250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981197440 00000100:00100000:2.0:1788541333.451659:0:19250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981197440 00000100:00100000:2.0:1788541333.451682:0:19250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788541333.451691:0:19250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981197312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541333.451743:0:19250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981197312:12345-0@lo:400:kworker.0 Request processed in 52us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541333.451750:0:19250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788541333.451767:0:19250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788541333.451773:0:19250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981197440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541333.451805:0:19250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981197440:12345-0@lo:400:kworker.0 Request processed in 33us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541333.451811:0:19250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788541333.451828:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981198208 00000100:00100000:2.0:1788541333.451831:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981198208 00000100:00100000:2.0:1788541333.451853:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788541333.451860:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981198208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788541333.451905:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788541333.451938:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981198208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541333.451943:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788541333.451960:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981198080 00000100:00100000:2.0:1788541333.451964:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981198080 00000100:00100000:2.0:1788541333.451984:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981197568 00000100:00100000:2.0:1788541333.451986:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981197568 00000100:00100000:2.0:1788541333.451994:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981197696 00000100:00100000:2.0:1788541333.452002:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981197696 00000100:00100000:2.0:1788541333.452012:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981197952 00000100:00100000:2.0:1788541333.452015:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981197952 00000100:00100000:2.0:1788541333.452022:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981197824 00000100:00100000:2.0:1788541333.452024:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981197824 00000100:00100000:2.0:1788541333.452039:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788541333.452045:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875420981198080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541333.452078:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875420981198080:12345-0@lo:400:kworker.0 Request processed in 33us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541333.452083:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788541333.452095:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788541333.452100:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981197824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541333.452124:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981197824:12345-0@lo:400:kworker.0 Request processed in 24us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541333.452129:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788541333.452142:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788541333.452146:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875420981197568:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788541333.452163:0:17198:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1788541333.455117:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788541333.455129:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788541333.455132:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541333.455163:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788541333.455172:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875420981197696:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788541333.455197:0:17199:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788541333.455283:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875420981197696:12345-0@lo:38:kworker.0 Request processed in 110us (3862us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788541333.455291:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788541333.455317:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788541333.455323:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875420981197952:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788541333.455334:0:17199:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788541333.455363:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875420981197952:12345-0@lo:38:kworker.0 Request processed in 38us (3908us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788541333.455369:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788541333.455398:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981197184 00000100:00100000:3.0:1788541333.455413:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981197184 00000100:00100000:3.0:1788541333.455446:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788541333.455450:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875420981197184:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788541333.455461:0:17203:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788541333.455490:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875420981197184:12345-0@lo:38:kworker.0 Request processed in 38us (4170us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788541333.455496:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:3.0:1788541333.455579:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9a683558ad80 x1875420981198080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541333.455596:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683558ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875420981198080:0@lo:400:kworker.0 00000100:00100000:3.0:1788541333.455609:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f2ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981197312:0@lo:400:kworker.0 00000100:00100000:3.0:1788541333.455628:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981198208:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788541333.455682:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9a683f2cca80 x1875420981197824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541333.455692:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f2cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981197824:0@lo:400:kworker.0 00000100:00100000:3.0:1788541333.455701:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f2cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981197440:0@lo:400:kworker.0 00000100:00080000:3.0:1788541333.455734:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6707aa2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788541333.455740:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788541333.455744:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f2cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981197184:0@lo:38:kworker.0 00000100:00080000:3.0:1788541333.455755:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a683f192800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788541333.455758:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788541333.455761:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f2cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875420981197696:0@lo:38:kworker.0 00000100:00080000:3.0:1788541333.455770:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a670190c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788541333.455781:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788541333.455784:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f2cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875420981197952:0@lo:38:kworker.0 00000100:00100000:3.0:1788541333.503062:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875420981197568:12345-0@lo:38:kworker.0 Request processed in 50904us (51668us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788541333.503078:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1788541333.503135:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a682ff9a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788541333.503142:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788541333.503147:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f2cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875420981197568:0@lo:38:kworker.0 00000020:01000004:0.0:1788541333.613304:0:20982:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788541333.632414:0:20982:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1788541333.632473:0:20982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075ad400/0x2aac941e5f4a8980 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8987 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541333.632488:0:20982:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075ad400/0x2aac941e5f4a8980 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a8987 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541333.632495:0:20982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075ad400/0x2aac941e5f4a8980 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a8987 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541333.632503:0:20982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9a67075ad400/0x2aac941e5f4a8980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a8987 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541333.632538:0:20982:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788541333.632544:0:20982:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788541333.632570:0:20982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788541333.632575:0:20982:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788541333.632581:0:20982:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788541333.632588:0:20982:0:(import.c:65:import_set_state_nolock()) ffff9a682ff9a800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788541333.632593:0:20982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788541333.632595:0:20982:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788541333.632598:0:20982:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788541333.633365:0:20982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075aca00/0x2aac941e5f4a88df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a88e6 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541333.633372:0:20982:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075aca00/0x2aac941e5f4a88df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a88e6 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541333.633390:0:20982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075aca00/0x2aac941e5f4a88df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a88e6 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541333.633395:0:20982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9a67075aca00/0x2aac941e5f4a88df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a88e6 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541333.633411:0:20982:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788541333.633417:0:20982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a8b08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8b0f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541333.633423:0:20982:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a8b08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a8b0f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541333.633429:0:20982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a8b08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a8b0f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541333.633436:0:20982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a8b08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a8b0f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541333.633450:0:20982:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788541333.633455:0:20982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68043cd600/0x2aac941e5f4a8d69 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8d70 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541333.633461:0:20982:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68043cd600/0x2aac941e5f4a8d69 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a8d70 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541333.633467:0:20982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68043cd600/0x2aac941e5f4a8d69 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a8d70 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541333.633482:0:20982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9a68043cd600/0x2aac941e5f4a8d69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a8d70 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541333.633489:0:20982:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788541333.633494:0:20982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a88d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a88d8 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541333.633501:0:20982:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a88d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a88d8 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541333.633517:0:20982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a88d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a88d8 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541333.633524:0:20982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a88d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a88d8 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541333.633532:0:20982:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:0.0:1788541333.633535:0:20982:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1788541333.633558:0:20982:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1788541333.633562:0:20982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1788541333.633566:0:20982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788541333.633572:0:20982:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788541333.633579:0:20982:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9a682e790000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788541333.633584:0:20982:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9a680a571800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788541333.633588:0:20982:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9a683ec14d40) has exports, disconnecting them 00000020:00080000:0.0:1788541333.633592:0:20982:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9a682e790000), last request at 1788541333 00000020:00000080:0.0:1788541333.633599:0:20982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8afa 00000100:00080000:0.0:1788541333.633616:0:20982:0:(import.c:65:import_set_state_nolock()) ffff9a682e794000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788541333.633666:0:20982:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a682e790000): rc 0 00000020:00000080:0.0:1788541333.633668:0:20982:0:(genops.c:885:class_export_put()) final put ffff9a682e790000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1788541333.633678:0:20982:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9a680a571800), last request at 1788541333 00000020:00000080:0.0:1788541333.633681:0:20982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8a60 00000100:00080000:0.0:1788541333.633687:0:20982:0:(import.c:65:import_set_state_nolock()) ffff9a680a575800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788541333.633692:0:20982:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a680a571800): rc 0 00000020:00000080:0.0:1788541333.633694:0:20982:0:(genops.c:885:class_export_put()) final put ffff9a680a571800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1788541333.633701:0:20982:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb5cdc19cfae0 00000100:00080000:0.0:1788541333.633716:0:20982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788541333.633719:0:20982:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00010000:00010000:3.0:1788541333.634396:0:19546:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788541333.634404:0:19546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a67075ad400/0x2aac941e5f4a8980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a8987 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541333.634413:0:19546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ad400 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:3.0:1788541333.634417:0:19546:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a67075ad400/0x2aac941e5f4a8980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a8987 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541333.634426:0:19546:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a67075ad400/0x2aac941e5f4a8980 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x2aac941e5f4a8987 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788541333.634433:0:19546:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a67075ad400/0x2aac941e5f4a8980 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x2aac941e5f4a8987 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541333.634439:0:19546:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788541333.634442:0:19546:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788541333.634444:0:19546:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788541333.634483:0:19546:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a67075ad400/0x2aac941e5f4a8980 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a8987 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541333.634489:0:19546:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788541333.634530:0:19546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a67075ad400/0x2aac941e5f4a8980 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a8987 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541333.634537:0:19546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a67075ad400/0x2aac941e5f4a8980 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a8987 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541333.634550:0:19546:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788541333.634552:0:19546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a67075aca00/0x2aac941e5f4a88df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a88e6 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541333.634558:0:19546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075aca00 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:3.0:1788541333.634561:0:19546:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a67075aca00/0x2aac941e5f4a88df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a88e6 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541333.634567:0:19546:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a67075aca00/0x2aac941e5f4a88df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x2aac941e5f4a88e6 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788541333.634572:0:19546:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a67075aca00/0x2aac941e5f4a88df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x2aac941e5f4a88e6 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541333.634576:0:19546:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788541333.634578:0:19546:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:3.0:1788541333.634579:0:19546:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:3.0:1788541333.634592:0:19546:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a67075aca00/0x2aac941e5f4a88df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a88e6 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541333.634597:0:19546:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788541333.634603:0:19546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a67075aca00/0x2aac941e5f4a88df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a88e6 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541333.634608:0:19546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a67075aca00/0x2aac941e5f4a88df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a88e6 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541333.634625:0:19546:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788541333.634628:0:19546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a8b08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a8b0f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541333.634633:0:19546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551a000 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:3.0:1788541333.634635:0:19546:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a8b08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a8b0f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541333.634641:0:19546:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a8b08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2aac941e5f4a8b0f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788541333.634647:0:19546:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a8b08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2aac941e5f4a8b0f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541333.634652:0:19546:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788541333.634654:0:19546:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788541333.634655:0:19546:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788541333.634667:0:19546:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a8b08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a8b0f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541333.634673:0:19546:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788541333.634688:0:19546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a8b08 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a8b0f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541333.634694:0:19546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a8b08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a8b0f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541333.634706:0:19546:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788541333.634709:0:19546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a68043cd600/0x2aac941e5f4a8d69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a8d70 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541333.634721:0:19546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68043cd600 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:3.0:1788541333.634724:0:19546:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a68043cd600/0x2aac941e5f4a8d69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a8d70 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541333.634730:0:19546:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a68043cd600/0x2aac941e5f4a8d69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2aac941e5f4a8d70 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788541333.634735:0:19546:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a68043cd600/0x2aac941e5f4a8d69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2aac941e5f4a8d70 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541333.634740:0:19546:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788541333.634741:0:19546:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788541333.634743:0:19546:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788541333.634756:0:19546:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a68043cd600/0x2aac941e5f4a8d69 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a8d70 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541333.634760:0:19546:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788541333.634765:0:19546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a68043cd600/0x2aac941e5f4a8d69 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a8d70 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541333.634771:0:19546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a68043cd600/0x2aac941e5f4a8d69 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a8d70 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541333.634779:0:19546:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541333.634781:0:19546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a88d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a88d8 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541333.634787:0:19546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ade00 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:3.0:1788541333.634789:0:19546:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a88d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a88d8 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541333.634801:0:19546:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a88d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2aac941e5f4a88d8 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788541333.634807:0:19546:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a88d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2aac941e5f4a88d8 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541333.634811:0:19546:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788541333.634813:0:19546:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788541333.634814:0:19546:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788541333.634826:0:19546:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a88d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a88d8 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541333.634832:0:19546:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788541333.634836:0:19546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a88d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a88d8 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541333.634842:0:19546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a88d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a88d8 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541333.634853:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541333.634855:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541333.634856:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541333.634890:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4746c063-6c88-4476-b99b-02bb8e8d54f7:3641:1875420981198336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788541333.634956:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541333.634999:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4746c063-6c88-4476-b99b-02bb8e8d54f7:3641:1875420981198848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788541333.635020:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541333.635041:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788541333.635046:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4746c063-6c88-4476-b99b-02bb8e8d54f7:3641:1875420981198464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788541333.635076:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541333.635105:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4746c063-6c88-4476-b99b-02bb8e8d54f7:3643:1875420981198592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788541333.635125:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541333.635142:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788541333.635147:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4746c063-6c88-4476-b99b-02bb8e8d54f7:3643:1875420981198720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788541333.635168:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541333.635194:0:20350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981198336 00000100:00100000:3.0:1788541333.635201:0:20350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981198336 00000100:00100000:3.0:1788541333.635227:0:20350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981198848 00000100:00100000:3.0:1788541333.635230:0:20350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981198848 00000100:00100000:3.0:1788541333.635237:0:20350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981198464 00000100:00100000:3.0:1788541333.635239:0:20350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981198464 00000100:00100000:3.0:1788541333.635336:0:20350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981198592 00000100:00100000:3.0:1788541333.635340:0:20350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981198592 00000100:00100000:3.0:1788541333.635347:0:20350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981198720 00000100:00100000:3.0:1788541333.635349:0:20350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981198720 00000100:00100000:3.0:1788541333.635361:0:20350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788541333.635368:0:20350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670917df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3641:x1875420981198336:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788541333.635374:0:20350:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788541333 with bad export cookie 3074995503755855787 00010000:00010000:2.0:1788541333.636360:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788541333.636373:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682e790000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1788541333.636424:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a680a571800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1788541333.636445:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a682e794000 for lustre-MDT0001 00000020:00000080:2.0:1788541333.636449:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a680a575800 for lustre-MDT0001 00000100:00100000:2.0:1788541333.636466:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788541333.636473:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670917fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3641:x1875420981198848:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788541333.636478:0:17185:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788541333 with bad export cookie 3074995503755855787 00000100:00100000:2.0:1788541333.636566:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670917fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3641:x1875420981198848:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (1544us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788541333.636573:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788541333.636594:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788541333.636598:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670917d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3641:x1875420981198464:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788541333.636602:0:17185:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788541333 with bad export cookie 3074995503755855787 00000100:00100000:2.0:1788541333.636628:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670917d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3641:x1875420981198464:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (1551us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788541333.636634:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788541333.636645:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788541333.636649:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670917ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3643:x1875420981198592:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788541333.636654:0:17185:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788541333 with bad export cookie 3074995503755855787 00000100:00100000:2.0:1788541333.636681:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670917ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3643:x1875420981198592:12345-0@lo:103:ldlm_bl.0 Request processed in 30us (1555us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788541333.636687:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788541333.636698:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788541333.636702:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3643:x1875420981198720:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788541333.636706:0:17185:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788541333 with bad export cookie 3074995503755855787 00000100:00100000:2.0:1788541333.636727:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3643:x1875420981198720:12345-0@lo:103:ldlm_bl.0 Request processed in 24us (1559us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788541333.636733:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788541333.636765:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.156@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788541333.636770:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9a67082db000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788541333.636773:0:3643:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:1.0:1788541333.636849:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788541333.637197:0:20982:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788541333.637203:0:20982:0:(import.c:65:import_set_state_nolock()) ffff9a6707aa2000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788541333.641675:0:20982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788541333.641684:0:20982:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1788541333.641709:0:20982:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788541333.641768:0:20982:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788541333.641798:0:20982:0:(import.c:65:import_set_state_nolock()) ffff9a682fdc6000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788541333.641822:0:20982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788541333.641825:0:20982:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1788541333.641839:0:20982:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788541333.641914:0:20982:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788541333.641924:0:20982:0:(import.c:65:import_set_state_nolock()) ffff9a68097af000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788541333.641960:0:20982:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9a683ec14d40) has no exports 00000100:00080000:1.0:1788541333.642965:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.156@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:3.0:1788541333.647288:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981198976:0@lo:9:umount.0 00000100:00100000:3.0:1788541333.647364:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541333.647398:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981199104:0@lo:9:umount.0 00000100:00100000:3.0:1788541333.647421:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541333.647464:0:19664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981198976 00000100:00100000:3.0:1788541333.647470:0:19664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981198976 00000100:00100000:3.0:1788541333.647522:0:19664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981199104 00000100:00100000:3.0:1788541333.647525:0:19664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981199104 00000100:00100000:3.0:1788541333.647548:0:19664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788541333.647556:0:19664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670917c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1875420981198976:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788541333.647594:0:19664:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8a8a 00000100:00080000:3.0:1788541333.647605:0:19664:0:(import.c:65:import_set_state_nolock()) ffff9a683533e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788541333.647644:0:19664:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788541333.647767:0:19664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670917c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3640:x1875420981198976:12345-0@lo:9:umount.0 Request processed in 211us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541333.647774:0:19664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788541333.647789:0:19664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788541333.647795:0:19664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1875420981199104:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788541333.647806:0:19664:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8b32 00000100:00080000:3.0:1788541333.647812:0:19664:0:(import.c:65:import_set_state_nolock()) ffff9a6802b4d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788541333.647833:0:19664:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1788541333.649222:0:19664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3640:x1875420981199104:12345-0@lo:9:umount.0 Request processed in 1421us (1794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541333.649233:0:19664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1788541333.649308:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a682fdc6000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788541333.649327:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788541333.649329:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788541333.649402:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981198976:0@lo:9:umount.0 00000100:00080000:3.0:1788541333.649417:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a68097af000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788541333.649426:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788541333.649428:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788541333.649430:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981199104:0@lo:9:umount.0 00010000:00010000:3.0:1788541333.649463:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541333.649677:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541333.649715:0:20350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670917df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3641:x1875420981198336:12345-0@lo:103:ldlm_bl.0 Request processed in 14346us (14758us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788541333.649724:0:20350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788541333.660687:0:3643:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.156@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788541333.660694:0:3643:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788541333.660722:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a683f2cf100 x1875420981197056/t0(0) o400->MGC192.168.202.156@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788541349 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541333.660796:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a670917d180 x1875420981198336/t0(0) o103->MGC192.168.202.156@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788541349 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541333.660807:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a670917ea00 x1875420981198848/t0(0) o103->MGC192.168.202.156@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788541349 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541333.660815:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a670917ca80 x1875420981198464/t0(0) o103->MGC192.168.202.156@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788541349 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541333.660823:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a670917e680 x1875420981198592/t0(0) o103->MGC192.168.202.156@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788541349 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541333.660831:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a670917f800 x1875420981198720/t0(0) o103->MGC192.168.202.156@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788541349 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788541333.660865:0:3641:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9a67082db000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1788541333.660914:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4746c063-6c88-4476-b99b-02bb8e8d54f7:3641:1875420981198336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788541333.660923:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4746c063-6c88-4476-b99b-02bb8e8d54f7:3641:1875420981198848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788541333.660949:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4746c063-6c88-4476-b99b-02bb8e8d54f7:3641:1875420981198464:0@lo:103:ldlm_bl.0 10000000:01000000:2.0:1788541333.661048:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788541333.661052:0:3643:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788541333.661054:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788541333.661057:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9a67082db000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788541333.661062:0:3643:0:(import.c:545:import_select_connection()) MGC192.168.202.156@tcp: connect to NID 0@lo last attempt 521 00000100:00080000:2.0:1788541333.661071:0:3643:0:(import.c:665:import_select_connection()) MGC192.168.202.156@tcp: import ffff9a67082db000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:2.0:1788541333.661117:0:3643:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a682e713b80 x1875420981199232/t0(0) o250->MGC192.168.202.156@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788541333.661170:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4746c063-6c88-4476-b99b-02bb8e8d54f7:3640:1875420981199232:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:0.0:1788541333.661220:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875420981199232 offset 0 length 520: 4 00000100:00100000:2.0:1788541333.661287:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4746c063-6c88-4476-b99b-02bb8e8d54f7:3643:1875420981198592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788541333.661300:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4746c063-6c88-4476-b99b-02bb8e8d54f7:3643:1875420981198720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788541333.661703:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f2cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4746c063-6c88-4476-b99b-02bb8e8d54f7:3644:1875420981197056:0@lo:400:kworker.0 00000020:00080000:2.0:1788541333.669211:0:20982:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9a683ec14d40) has no exports 00000020:01000000:3.0:1788541333.729627:0:20982:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a67019c03c0 - data ffff9a680b7dd438/ffff9a681e4b8400 00000020:01000000:3.0:1788541333.729795:0:20982:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a670196af00 - data ffff9a6839da9798/ffff9a68040d3800 00000001:00000004:3.0:1788541333.748119:0:20982:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:2.0:1788541333.783092:0:20982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788541333.783102:0:20982:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788541333.783108:0:20982:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788541333.784659:0:20982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788541333.784673:0:20982:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1788541333.784695:0:20982:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788541333.784698:0:20982:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788541333.785449:0:17938:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788541333.785454:0:17938:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1788541333.785465:0:17938:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1788541333.786029:0:20982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788541333.786033:0:20982:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1788541333.786052:0:20982:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788541333.786054:0:20982:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788541333.786808:0:17940:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788541333.786813:0:17940:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1788541333.786821:0:17940:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1788541333.788503:0:20982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a88f4 00000020:00000080:2.0:1788541333.788527:0:20982:0:(genops.c:885:class_export_put()) final put ffff9a6707aa0000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788541333.788555:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6707aa0000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788541333.791729:0:20982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8909 00000020:00000080:2.0:1788541333.791744:0:20982:0:(genops.c:885:class_export_put()) final put ffff9a6707aa7800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788541333.791812:0:20982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1788541333.791819:0:20982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788541333.791828:0:20982:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788541333.791833:0:20982:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9a683ec10000) has no exports 00000004:01000000:2.0:1788541333.792010:0:20982:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788541333.792020:0:20982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a895d 00000020:00000080:2.0:1788541333.792024:0:20982:0:(genops.c:885:class_export_put()) final put ffff9a68097a9800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788541333.795004:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6707aa7800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1788541333.795980:0:20982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788541333.795990:0:20982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788541333.796001:0:20982:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788541333.796005:0:20982:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9a670695b380) has no exports 00000020:00000080:2.0:1788541333.796014:0:20982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8956 00000020:00000080:2.0:1788541333.796022:0:20982:0:(genops.c:885:class_export_put()) final put ffff9a68097aa800/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1788541333.797549:0:20982:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788541333.797557:0:20982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788541333.797561:0:20982:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1788541333.797568:0:20982:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788541333.797571:0:20982:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788541333.797606:0:20982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788541333.797616:0:20982:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788541333.797622:0:20982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8948 00000020:00000080:2.0:1788541333.797640:0:20982:0:(genops.c:885:class_export_put()) final put ffff9a68097ab800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788541333.797645:0:20982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788541333.797649:0:20982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788541333.797654:0:20982:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788541333.797656:0:20982:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9a67069599c0) has no exports 00000020:00000080:2.0:1788541333.797662:0:20982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a893a 00000020:00000080:2.0:1788541333.797666:0:20982:0:(genops.c:885:class_export_put()) final put ffff9a682fdc1800/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1788541333.798019:0:20982:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788541333.798023:0:20982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788541333.798025:0:20982:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1788541333.798029:0:20982:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788541333.798031:0:20982:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788541333.798053:0:20982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788541333.798058:0:20982:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1788541333.798069:0:20982:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788541333.798074:0:20982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a892c 00000020:00000080:2.0:1788541333.798079:0:20982:0:(genops.c:885:class_export_put()) final put ffff9a682fdc4800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788541333.798083:0:20982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1788541333.798086:0:20982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788541333.798090:0:20982:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788541333.798092:0:20982:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9a68059999c0) has no exports 00000020:00000080:2.0:1788541333.798096:0:20982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8925 00000020:00000080:2.0:1788541333.798099:0:20982:0:(genops.c:885:class_export_put()) final put ffff9a6707aa0800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788541333.799665:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68097a9800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788541333.799681:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68097aa800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788541333.799689:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a68097af000 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788541333.799697:0:38:0:(genops.c:885:class_export_put()) final put ffff9a68097ae000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788541333.799700:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68097ae000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1788541333.799705:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788541333.799798:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68097ab800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788541333.799803:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682fdc1800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788541333.799807:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a682fdc6000 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788541333.799810:0:38:0:(genops.c:885:class_export_put()) final put ffff9a682fdc7000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788541333.799812:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682fdc7000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1788541333.799816:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788541333.799839:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682fdc4800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788541333.799852:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6707aa0800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788541333.844944:0:20982:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788541333.844954:0:20982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788541333.844959:0:20982:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788541333.844966:0:20982:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788541333.845041:0:20982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788541333.845053:0:20982:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788541333.845079:0:20982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788541333.845082:0:20982:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788541333.845088:0:20982:0:(genops.c:885:class_export_put()) final put ffff9a67078dc000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788541333.845092:0:20982:0:(genops.c:844:class_export_destroy()) destroying export ffff9a67078dc000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788541333.845108:0:20982:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788541333.845313:0:20982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8910 00000020:00000080:0.0:1788541333.845323:0:20982:0:(genops.c:885:class_export_put()) final put ffff9a6707aa4800/lustre-MDD0001_UUID 00000020:01000000:0.0:1788541333.845328:0:20982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788541333.845332:0:20982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788541333.845337:0:20982:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788541333.845341:0:20982:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9a680599cd40) has no exports 00000020:00000080:0.0:1788541333.845359:0:20982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788541333.845362:0:20982:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788541333.845366:0:20982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8917 00000020:00000080:0.0:1788541333.845371:0:20982:0:(genops.c:885:class_export_put()) final put ffff9a6707aa6000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1788541333.845382:0:20982:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a683f356800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788541333.845386:0:20982:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a683f356800 2 00000020:01000004:0.0:1788541333.845390:0:20982:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a683f356800 from lustre-MDT0001 00000020:00000080:0.0:1788541333.845421:0:20982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788541333.845425:0:20982:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788541333.845428:0:20982:0:(genops.c:885:class_export_put()) final put ffff9a6707aa5000/lustre-MDT0001_UUID 00000020:00000080:0.0:1788541333.845430:0:20982:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6707aa5000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788541333.845439:0:20982:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788541333.845469:0:20982:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788541333.845473:0:20982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788541333.845476:0:20982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788541333.845493:0:20982:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788541333.845502:0:20982:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9a6815bc9000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788541333.845517:0:20982:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9a682e74b380) has exports, disconnecting them 00000020:00080000:0.0:1788541333.845523:0:20982:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9a6815bc9000), last request at 1788541255 00000020:00000080:0.0:1788541333.845526:0:20982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8995 00000020:00080000:0.0:1788541333.845541:0:20982:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a6815bc9000): rc 0 00000020:00000080:0.0:1788541333.845545:0:20982:0:(genops.c:885:class_export_put()) final put ffff9a6815bc9000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788541333.847050:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6707aa2000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788541333.847065:0:38:0:(genops.c:885:class_export_put()) final put ffff9a6707aa3000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788541333.847068:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6707aa3000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1788541333.847081:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788541333.847223:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6707aa4800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1788541333.847227:0:38:0:(genops.c:885:class_export_put()) final put ffff9a6707aa1800/lustre-MDD0001_UUID 00000020:00000080:1.0:1788541333.847230:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6707aa1800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1788541333.847233:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1788541333.847347:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6707aa6000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788541333.847353:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6815bc9000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1788541333.857527:0:20982:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1788541333.857537:0:20982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788541333.857542:0:20982:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788541333.857551:0:20982:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788541333.857588:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a682ff9a800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788541333.858083:0:20982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788541333.858093:0:20982:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1788541333.858099:0:20982:0:(genops.c:885:class_export_put()) final put ffff9a682fdc2000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1788541333.858103:0:20982:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682fdc2000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1788541333.858108:0:20982:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1788541333.858190:0:20982:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a683f356800 1 00000020:00000080:1.0:1788541333.858199:0:20982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a88bc 00000020:00000080:1.0:1788541333.858207:0:20982:0:(genops.c:885:class_export_put()) final put ffff9a6815c6f000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1788541333.858216:0:20982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1788541333.858223:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6815c6f000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788541333.858233:0:20982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788541333.858238:0:20982:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788541333.858256:0:20982:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9a6707910000) has no exports 00000020:00000080:1.0:1788541333.969615:0:20982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788541333.969630:0:20982:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1788541333.969635:0:20982:0:(genops.c:885:class_export_put()) final put ffff9a683f352800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788541333.969639:0:20982:0:(genops.c:844:class_export_destroy()) destroying export ffff9a683f352800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1788541333.969650:0:20982:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1788541333.970622:0:20982:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a683f355000 00000020:01000000:0.0:1788541333.971126:0:20982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788541333.971133:0:20982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788541333.971138:0:20982:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788541333.971143:0:20982:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9a682fe0cd40) has no exports 00000100:00100000:3.0:1788541333.971618:0:17199:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9a67069a5e00:17199] 1 exiting: rc = 0 00000100:00100000:3.0:1788541333.971708:0:17200:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9a67069a5200:17200] 2 exiting: rc = 0 00000100:00100000:3.0:1788541333.971777:0:19663:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9a670197e600:19663] 3 exiting: rc = 0 00000100:00100000:3.0:1788541333.971849:0:17198:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9a67069a4200:17198] 0 exiting: rc = 1 00000100:00100000:0.0:1788541333.971969:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.971976:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.971981:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.971987:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.971992:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.971997:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972002:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972017:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972024:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972030:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972036:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972042:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972047:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972053:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972059:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972065:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972070:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972076:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972082:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972088:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972093:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972098:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972120:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972125:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972131:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972136:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972142:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972148:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972153:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972159:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972164:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972170:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972176:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972181:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972186:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972191:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972197:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972202:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972207:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972212:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972217:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972222:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972227:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972233:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972238:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972244:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972249:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972255:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972260:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972265:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972270:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972276:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972281:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972286:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972291:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972296:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972301:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972314:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972319:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972325:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972330:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972336:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972341:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.972348:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541333.975159:0:17202:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9a68354cce00:17202] 1 exiting: rc = 0 00000100:00100000:3.0:1788541333.975269:0:17201:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9a68354cda00:17201] 0 exiting: rc = 1 00000100:00100000:0.0:1788541333.976776:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.976857:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.976864:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.976991:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977000:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977005:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977078:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977084:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977090:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977095:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977100:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977105:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977111:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977116:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977121:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977126:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977132:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977136:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977141:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977147:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977152:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977156:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977161:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977166:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977171:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977176:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977181:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977186:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977207:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977212:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977217:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977222:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977227:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977232:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977237:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977242:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977246:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977252:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977258:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977263:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977269:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977274:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977280:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977285:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977290:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977295:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977300:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977305:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977310:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977315:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977320:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977325:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977523:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977527:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977533:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977538:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977543:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977548:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977553:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977558:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977564:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977569:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977574:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.977589:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.978992:0:17204:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9a6802db8200:17204] 1 exiting: rc = 0 00000100:00100000:2.0:1788541333.979267:0:17203:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9a6707988a00:17203] 0 exiting: rc = 1 00000100:00100000:3.0:1788541333.979624:0:18270:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9a6815a3de00:18270] 2 exiting: rc = 0 00000100:00100000:0.0:1788541333.980199:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.980207:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.980213:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.980220:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.980226:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.980231:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.980237:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.980253:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.980262:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.980269:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.980275:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.980282:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.980289:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.980296:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.980303:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.980312:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.980319:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982642:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982660:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982689:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982695:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982702:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982708:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982714:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982720:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982725:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982731:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982737:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982742:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982748:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982754:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982761:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982768:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982794:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982812:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982818:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982824:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982830:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982835:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982841:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982848:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982857:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982863:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982905:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982913:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982931:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982938:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982945:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982951:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982957:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982962:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982968:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982973:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982987:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982993:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.982999:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.983006:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.983028:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.983034:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.983040:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.983046:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.983051:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.983057:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.983063:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541333.991740:0:17205:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9a6707989600:17205] 0 exiting: rc = 1 00000100:00100000:2.0:1788541333.991892:0:17206:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9a6814d1e800:17206] 1 exiting: rc = 0 00000100:00100000:1.0:1788541333.992045:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992053:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992058:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992064:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992070:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992075:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992080:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992085:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992090:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992095:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992100:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992105:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992111:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992116:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992121:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992126:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992131:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992136:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992141:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992146:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992151:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992157:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992162:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992167:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992172:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992176:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992196:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992201:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992205:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992210:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992215:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992220:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992225:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992230:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992236:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992243:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992250:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992256:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992262:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992267:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992273:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992278:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992282:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992287:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992292:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992298:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992304:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992309:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992315:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992320:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992325:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992330:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992336:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992341:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992346:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992350:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992356:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992361:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992367:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992372:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992378:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992392:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992397:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992402:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.992721:0:17208:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9a6706815400:17208] 1 exiting: rc = 0 00000100:00100000:2.0:1788541333.992821:0:17207:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9a6706814600:17207] 0 exiting: rc = 1 00000100:00100000:1.0:1788541333.993401:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993408:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993413:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993419:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993424:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993430:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993435:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993439:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993445:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993450:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993455:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993460:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993464:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993469:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993474:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993479:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993484:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993489:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993494:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993499:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993514:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993520:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993525:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993530:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993535:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993540:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993545:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993550:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993556:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993561:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993565:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993584:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993590:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993596:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993600:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993605:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993610:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993615:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993619:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993624:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993629:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993635:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993640:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993644:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993649:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993654:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993659:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993664:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993669:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993674:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993679:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993684:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993690:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993695:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993700:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993705:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993710:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993715:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993720:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993725:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993730:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993735:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993739:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.993744:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.995089:0:17210:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9a6835390c00:17210] 1 exiting: rc = 0 00000100:00100000:2.0:1788541333.995451:0:17209:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9a6706814e00:17209] 0 exiting: rc = 1 00000100:00100000:1.0:1788541333.995635:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995642:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995657:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995664:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995669:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995675:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995681:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995686:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995691:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995697:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995702:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995707:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995714:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995719:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995724:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995731:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995737:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995743:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995749:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995755:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995762:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995767:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995773:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995790:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995797:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995803:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995808:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995814:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995820:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995825:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995830:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995836:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995840:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995845:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995851:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995858:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995864:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995949:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995955:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995959:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995964:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995970:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995976:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995981:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995988:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995993:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.995999:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.996005:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.996010:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.996015:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.996020:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.996026:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.996031:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.996036:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.996041:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.996046:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.996051:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.996056:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.996061:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.996067:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.996072:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.996077:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.996081:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.996086:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541333.997038:0:17211:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9a6814e05e00:17211] 0 exiting: rc = 1 00000100:00100000:1.0:1788541333.997313:0:17213:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9a6706815a00:17213] 2 exiting: rc = 0 00000100:00100000:2.0:1788541333.997592:0:17212:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9a6706814800:17212] 1 exiting: rc = 0 00000100:00100000:1.0:1788541333.997921:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.997929:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.997934:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.997940:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.997945:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.997951:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.997957:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.997974:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.997997:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998003:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998009:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998015:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998021:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998027:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998033:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998039:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998046:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998051:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998057:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998062:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998068:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998073:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998079:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998085:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998090:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998096:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998102:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998108:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998113:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998119:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998125:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998131:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998152:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998159:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998164:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998170:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998176:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998182:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998187:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998193:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998200:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998205:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998218:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998224:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998230:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998235:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998241:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998248:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998255:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998260:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998266:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998272:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998279:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998285:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998292:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998297:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998319:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998326:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998331:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998337:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998342:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998347:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998352:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541333.998357:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788541334.003334:0:20982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788541334.003352:0:20982:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788541334.003358:0:20982:0:(genops.c:885:class_export_put()) final put ffff9a6835527800/MDS_uuid 00000020:00000080:0.0:1788541334.003373:0:20982:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6835527800/MDS_uuid for MDS 00000020:01000000:0.0:1788541334.003380:0:20982:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788541334.003552:0:20982:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1788541334.349155:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541335.371365:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541336.394135:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541337.420812:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788541337.644339:0:21183:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788541337.660402:0:21183:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788541337.660449:0:21183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075adc00/0x2aac941e5f4a8a2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8a36 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541337.660484:0:21183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075adc00/0x2aac941e5f4a8a2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a8a36 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541337.660490:0:21183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075adc00/0x2aac941e5f4a8a2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a8a36 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541337.660495:0:21183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9a67075adc00/0x2aac941e5f4a8a2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a8a36 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541337.660549:0:21183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788541337.660562:0:21183:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788541337.660596:0:21183:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788541337.660600:0:21183:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788541337.660605:0:21183:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788541337.660611:0:21183:0:(import.c:65:import_set_state_nolock()) ffff9a683f192800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788541337.660616:0:21183:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788541337.660618:0:21183:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788541337.660621:0:21183:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788541337.662156:0:21183:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788541337.662164:0:21183:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788541337.662172:0:21183:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788541337.662455:0:21183:0:(import.c:65:import_set_state_nolock()) ffff9a6809c4b800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788541337.662534:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875420981199360:0@lo:39:umount.0 00000400:00000100:0.0:1788541337.662603:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875420981199360 offset 0 length 224: 4 00010000:00010000:3.0:1788541337.663301:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541337.663312:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a67075adc00/0x2aac941e5f4a8a2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a8a36 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541337.663323:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075adc00 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:3.0:1788541337.663327:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a67075adc00/0x2aac941e5f4a8a2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a8a36 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541337.663510:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a67075adc00/0x2aac941e5f4a8a2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x2aac941e5f4a8a36 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788541337.663519:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a67075adc00/0x2aac941e5f4a8a2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x2aac941e5f4a8a36 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541337.663525:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788541337.663528:0:17186:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788541337.663546:0:17186:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788541337.663670:0:17186:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a67082db000 00010000:00010000:3.0:1788541337.663675:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a67075adc00/0x2aac941e5f4a8a2f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x2aac941e5f4a8a36 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541337.663682:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a67075adc00/0x2aac941e5f4a8a2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x2aac941e5f4a8a36 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541337.663696:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541337.663698:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541337.663700:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541338.442521:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788541338.570038:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4746c063-6c88-4476-b99b-02bb8e8d54f7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788541338.570047:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 4746c063-6c88-4476-b99b-02bb8e8d54f7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788541338.570051:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788541338.570054:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788541338.570059:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a670190c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788541338.570066:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 614 00000100:00080000:0.0:1788541338.570072:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788541338.570079:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a670190c000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:0.0:1788541338.570129:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a67088a2a00 x1875420981199488/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788541338.570201:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875420981199488:0@lo:38:kworker.0 00000400:00000100:3.0:1788541338.570254:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875420981199488 offset 0 length 520: 4 00000100:00100000:2.0:1788541338.570574:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875420981199616:0@lo:400:kworker.0 00000400:00000100:2.0:1788541338.570610:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875420981199616 offset 0 length 224: 4 00000001:00100000:3.0:1788541339.084835:0:18713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788541339.084979:0:18713:0:(genops.c:885:class_export_put()) final put ffff9a683533a000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788541339.090001:0:19530:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788541339.090009:0:19530:0:(genops.c:885:class_export_put()) final put ffff9a68101d5800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788541339.090101:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68101d5800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788541339.090146:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6802b4d000 for lustre-OST0001 00000020:00000080:0.0:1788541339.091814:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a683533a000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788541339.091863:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a683533e800 for lustre-OST0000 00010000:00010000:1.0:1788541339.470292:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541340.490021:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541341.514039:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541342.538599:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541343.562035:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541343.690027:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788541333/real 1788541333] req@ffff9a682e713b80 x1875420981199232/t0(0) o250->MGC192.168.202.156@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788541343 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541343.690061:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a682e713b80 x1875420981199232/t0(0) o250->MGC192.168.202.156@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788541343 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788541343.690081:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a67082db000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788541343.690100:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788541343.690104:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4746c063-6c88-4476-b99b-02bb8e8d54f7:3640:1875420981199232:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:2.0:1788541343.691569:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4746c063-6c88-4476-b99b-02bb8e8d54f7->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788541343.691575:0:18310:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788541343.691577:0:18310:0:(import.c:65:import_set_state_nolock()) ffff9a67082db000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788541343.691583:0:18310:0:(import.c:545:import_select_connection()) MGC192.168.202.156@tcp: connect to NID 0@lo last attempt 614 00000100:00080000:2.0:1788541343.691588:0:18310:0:(import.c:630:import_select_connection()) MGC192.168.202.156@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788541343.691594:0:18310:0:(import.c:665:import_select_connection()) MGC192.168.202.156@tcp: import ffff9a67082db000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:2.0:1788541343.691623:0:18310:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a682e712d80 x1875420981199744/t0(0) o250->MGC192.168.202.156@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788541343.691645:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788541343.691648:0:18310:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788541343.691745:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981199872:0@lo:400:kworker.0 00000400:00000100:1.0:1788541343.691799:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875420981199872 offset 0 length 224: 4 00000100:00100000:0.0:1788541343.692020:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4746c063-6c88-4476-b99b-02bb8e8d54f7:3640:1875420981199744:0@lo:250:kworker.0 00000400:00000100:0.0:1788541343.692038:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875420981199744 offset 0 length 520: 4 00010000:00010000:3.0:1788541344.589250:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541345.610827:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541346.634798:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541347.658777:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541347.786021:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788541337/real 1788541337] req@ffff9a682e713800 x1875420981199360/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788541347 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541347.786054:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a682e713800 x1875420981199360/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788541347 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788541347.786075:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6809c4b800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788541347.786100:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875420981199360:0@lo:39:umount.0 00000100:00080000:1.0:1788541347.787848:0:21183:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788541347.787857:0:21183:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788541347.787917:0:21183:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788541347.789400:0:21183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6800030400/0x2aac941e5f4a8a05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8a0c expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541347.789431:0:21183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6800030400/0x2aac941e5f4a8a05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a8a0c expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541347.789439:0:21183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6800030400/0x2aac941e5f4a8a05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a8a0c expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541347.789447:0:21183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9a6800030400/0x2aac941e5f4a8a05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a8a0c expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541347.790089:0:21183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788541347.790101:0:21183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551b200/0x2aac941e5f4a8d5b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8d62 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541347.790109:0:21183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551b200/0x2aac941e5f4a8d5b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a8d62 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541347.790115:0:21183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551b200/0x2aac941e5f4a8d5b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a8d62 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541347.790122:0:21183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9a683551b200/0x2aac941e5f4a8d5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a8d62 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541347.795807:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788541347.795822:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a6800030400/0x2aac941e5f4a8a05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a8a0c expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541347.795833:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6800030400 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:2.0:1788541347.795839:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a6800030400/0x2aac941e5f4a8a05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a8a0c expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541347.795850:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a6800030400/0x2aac941e5f4a8a05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x2aac941e5f4a8a0c expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788541347.795856:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a6800030400/0x2aac941e5f4a8a05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x2aac941e5f4a8a0c expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541347.795862:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788541347.795865:0:17187:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1788541347.795895:0:17187:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a67082db000 00010000:00010000:2.0:1788541347.795899:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a6800030400/0x2aac941e5f4a8a05 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x2aac941e5f4a8a0c expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541347.795924:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a6800030400/0x2aac941e5f4a8a05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x2aac941e5f4a8a0c expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541347.795945:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541347.795950:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a683551b200/0x2aac941e5f4a8d5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a8d62 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541347.795955:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b200 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:2.0:1788541347.795959:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a683551b200/0x2aac941e5f4a8d5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a8d62 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541347.796397:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a683551b200/0x2aac941e5f4a8d5b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2aac941e5f4a8d62 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788541347.796404:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a683551b200/0x2aac941e5f4a8d5b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2aac941e5f4a8d62 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541347.796410:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788541347.796412:0:17187:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1788541347.796418:0:17187:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a67082db000 00010000:00010000:2.0:1788541347.796421:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a683551b200/0x2aac941e5f4a8d5b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2aac941e5f4a8d62 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541347.796429:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541347.796431:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541347.796434:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541347.797401:0:21183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788541347.797413:0:21183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a683551b200/0x2aac941e5f4a8d5b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2aac941e5f4a8d62 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788541347.797430:0:21183:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1788541347.797438:0:21183:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1788541347.797441:0:21183:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788541347.797497:0:21183:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788541347.797502:0:21183:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788541347.797508:0:21183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788541347.797514:0:21183:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788541347.797519:0:21183:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9a6706958000) has no exports 00000020:00080000:1.0:1788541347.797548:0:21183:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9a6706958000) has no exports 00000020:01000000:1.0:1788541347.799256:0:21183:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a6701099120 - data ffff9a6705cbb0d8/ffff9a67064be800 00000020:01000000:1.0:1788541347.799390:0:21183:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a670196a8a0 - data ffff9a6839e705e8/ffff9a670652ec00 00010000:00010000:3.0:1788541347.802455:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788541347.814236:0:21183:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788541347.818528:0:21183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8a1a 00000020:00000080:0.0:1788541347.818539:0:21183:0:(genops.c:885:class_export_put()) final put ffff9a68097ac800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788541347.818594:0:21183:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a67067e0800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788541347.818599:0:21183:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a67067e0800 2 00000020:01000004:0.0:1788541347.818610:0:21183:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a67067e0800 from lustre-OST0000 00000020:00000080:0.0:1788541347.818651:0:21183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788541347.818667:0:21183:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788541347.818671:0:21183:0:(genops.c:885:class_export_put()) final put ffff9a682ff9d000/lustre-OST0000_UUID 00000020:00000080:0.0:1788541347.818674:0:21183:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682ff9d000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788541347.818683:0:21183:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788541347.818732:0:21183:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788541347.818736:0:21183:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788541347.818739:0:21183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788541347.818744:0:21183:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788541347.818750:0:21183:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9a680b3c6800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788541347.818756:0:21183:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff9a6805998000) has exports, disconnecting them 00000020:00080000:0.0:1788541347.818761:0:21183:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9a680b3c6800), last request at 1788541269 00000020:00000080:0.0:1788541347.818765:0:21183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8a44 00000020:00080000:0.0:1788541347.818774:0:21183:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a680b3c6800): rc 0 00000020:00000080:0.0:1788541347.818778:0:21183:0:(genops.c:885:class_export_put()) final put ffff9a680b3c6800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788541347.819536:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68097ac800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788541347.831248:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a680b3c6800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788541347.870318:0:21183:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788541347.870327:0:21183:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788541347.870332:0:21183:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788541347.870340:0:21183:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788541347.870420:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a683f192800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788541347.870571:0:21183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788541347.870581:0:21183:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788541347.870592:0:21183:0:(genops.c:885:class_export_put()) final put ffff9a682fdc5000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788541347.870718:0:21183:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682fdc5000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788541347.870728:0:21183:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788541347.870789:0:21183:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788541347.870792:0:21183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788541347.870798:0:21183:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788541347.870804:0:21183:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9a6814845800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788541347.870810:0:21183:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff9a6706520000) has exports, disconnecting them 00000020:00080000:0.0:1788541347.870826:0:21183:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9a6814845800), last request at 1788541269 00000020:00000080:0.0:1788541347.870830:0:21183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8a59 00000020:00080000:0.0:1788541347.870848:0:21183:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a6814845800): rc 0 00000020:00000080:0.0:1788541347.870852:0:21183:0:(genops.c:885:class_export_put()) final put ffff9a6814845800/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788541347.870901:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6814845800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1788541347.876096:0:21183:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788541347.876108:0:21183:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788541347.876113:0:21183:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788541347.876122:0:21183:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788541347.876352:0:21183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788541347.876362:0:21183:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1788541347.876369:0:21183:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a67067e0800 1 00000020:00000080:1.0:1788541347.876376:0:21183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a89f7 00000020:00000080:1.0:1788541347.876394:0:21183:0:(genops.c:885:class_export_put()) final put ffff9a680b3c3800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788541347.876421:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6809c4b800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788541347.876429:0:36:0:(genops.c:885:class_export_put()) final put ffff9a68097a8000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1788541347.876433:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68097a8000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1788541347.876440:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000000:1.0:1788541347.876644:0:21183:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788541347.876650:0:21183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788541347.876656:0:21183:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788541347.876660:0:21183:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff9a6835310000) has no exports 00000020:00000080:2.0:1788541347.878963:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a680b3c3800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788541347.894479:0:21183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788541347.894496:0:21183:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788541347.894502:0:21183:0:(genops.c:885:class_export_put()) final put ffff9a67067e4800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788541347.894506:0:21183:0:(genops.c:844:class_export_destroy()) destroying export ffff9a67067e4800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788541347.894519:0:21183:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788541347.894647:0:21183:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a67067e6800 00000020:02000400:3.0:1788541347.894698:0:21183:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788541348.687016:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788541348.811975:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4746c063-6c88-4476-b99b-02bb8e8d54f7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788541348.811984:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 4746c063-6c88-4476-b99b-02bb8e8d54f7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788541348.811987:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788541348.811991:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788541348.812068:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875420981200000:0@lo:400:kworker.0 00000400:00000100:3.0:1788541348.812130:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875420981200000 offset 0 length 224: 4 00010000:00010000:2.0:1788541349.707121:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541350.730074:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788541351.409728:0:21385:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788541351.423316:0:21385:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788541351.423416:0:21385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551b600/0x2aac941e5f4a8ac9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8ad0 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541351.423433:0:21385:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551b600/0x2aac941e5f4a8ac9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a8ad0 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541351.423441:0:21385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551b600/0x2aac941e5f4a8ac9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a8ad0 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541351.423449:0:21385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9a683551b600/0x2aac941e5f4a8ac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a8ad0 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541351.423510:0:21385:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788541351.423517:0:21385:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788541351.423547:0:21385:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788541351.423561:0:21385:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a67088a2a00 x1875420981199488/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788541358 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541351.423619:0:21385:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788541351.423626:0:21385:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788541351.423643:0:21385:0:(import.c:65:import_set_state_nolock()) ffff9a670190c000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788541351.423648:0:21385:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788541351.423653:0:21385:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a67088a2a00 x1875420981199488/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788541358 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788541351.424263:0:19546:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541351.424270:0:19546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a683551b600/0x2aac941e5f4a8ac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a8ad0 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541351.424285:0:19546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b600 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:1.0:1788541351.424289:0:19546:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a683551b600/0x2aac941e5f4a8ac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a8ad0 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541351.424298:0:19546:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a683551b600/0x2aac941e5f4a8ac9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2aac941e5f4a8ad0 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788541351.424305:0:19546:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a683551b600/0x2aac941e5f4a8ac9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2aac941e5f4a8ad0 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788541351.424310:0:19546:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788541351.424313:0:19546:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788541351.424316:0:19546:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788541351.424330:0:19546:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a67082db000 00010000:00010000:1.0:1788541351.424335:0:19546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a683551b600/0x2aac941e5f4a8ac9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2aac941e5f4a8ad0 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541351.424342:0:19546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a683551b600/0x2aac941e5f4a8ac9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2aac941e5f4a8ad0 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541351.424361:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541351.424364:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541351.424365:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541351.428310:0:21385:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788541351.428358:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875420981199488:0@lo:38:kworker.0 00000100:00100000:2.0:1788541351.428409:0:21385:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788541351.429537:0:21385:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788541351.429551:0:21385:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a67088a1880 x1875420981199616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541354 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541351.429623:0:21385:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a682e712300 x1875420981199872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541359 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541351.429692:0:21385:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a6708837100 x1875420981200000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541364 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541351.429711:0:21385:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788541351.429717:0:21385:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788541351.429746:0:21385:0:(import.c:65:import_set_state_nolock()) ffff9a6705aea800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788541351.429814:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875420981200000:0@lo:400:kworker.0 00000100:00100000:0.0:1788541351.429846:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875420981200128:0@lo:39:umount.0 00000400:00000100:0.0:1788541351.429938:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875420981200128 offset 0 length 224: 4 00000100:00100000:3.0:1788541351.430253:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981199872:0@lo:400:kworker.0 00000100:00100000:1.0:1788541351.430374:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875420981199616:0@lo:400:kworker.0 00010000:00010000:2.0:1788541351.755631:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541352.778161:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541353.802227:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788541353.930565:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4746c063-6c88-4476-b99b-02bb8e8d54f7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788541353.930575:0:18310:0:(pinger.c:247:ptlrpc_pinger_process_import()) 4746c063-6c88-4476-b99b-02bb8e8d54f7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788541354.826688:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541355.850464:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541356.874839:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541357.901163:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541358.602090:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788541343/real 1788541343] req@ffff9a682e712d80 x1875420981199744/t0(0) o250->MGC192.168.202.156@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788541358 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541358.602150:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a682e712d80 x1875420981199744/t0(0) o250->MGC192.168.202.156@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788541358 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788541358.602170:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a67082db000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788541358.602193:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788541358.602197:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4746c063-6c88-4476-b99b-02bb8e8d54f7:3640:1875420981199744:0@lo:250:kworker.0 00000100:00080000:1.0:1788541358.602363:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4746c063-6c88-4476-b99b-02bb8e8d54f7->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788541358.602369:0:18310:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788541358.602372:0:18310:0:(import.c:65:import_set_state_nolock()) ffff9a67082db000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788541358.602378:0:18310:0:(import.c:545:import_select_connection()) MGC192.168.202.156@tcp: connect to NID 0@lo last attempt 624 00000100:00080000:1.0:1788541358.602383:0:18310:0:(import.c:630:import_select_connection()) MGC192.168.202.156@tcp: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788541358.602390:0:18310:0:(import.c:665:import_select_connection()) MGC192.168.202.156@tcp: import ffff9a67082db000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:1.0:1788541358.602423:0:18310:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6708835880 x1875420981200256/t0(0) o250->MGC192.168.202.156@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788541358.602546:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4746c063-6c88-4476-b99b-02bb8e8d54f7:3640:1875420981200256:0@lo:250:kworker.0 00000400:00000100:0.0:1788541358.602595:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875420981200256 offset 0 length 520: 4 00010000:00010000:3.0:1788541358.922169:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541359.947006:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541360.971016:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541361.678481:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788541351/real 1788541351] req@ffff9a682e711f80 x1875420981200128/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788541361 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541361.678514:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a682e711f80 x1875420981200128/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788541361 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788541361.678536:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6705aea800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788541361.678559:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875420981200128:0@lo:39:umount.0 00000100:00080000:2.0:1788541361.678825:0:21385:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788541361.678830:0:21385:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788541361.678835:0:21385:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788541361.681358:0:21385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68043ccc00/0x2aac941e5f4a8a9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8aa6 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541361.681380:0:21385:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68043ccc00/0x2aac941e5f4a8a9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a8aa6 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541361.681404:0:21385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68043ccc00/0x2aac941e5f4a8a9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a8aa6 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541361.681410:0:21385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9a68043ccc00/0x2aac941e5f4a8a9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a8aa6 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541361.681505:0:21385:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541361.681514:0:21385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68043cca00/0x2aac941e5f4a8d4d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8d54 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541361.681520:0:21385:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68043cca00/0x2aac941e5f4a8d4d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a8d54 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541361.681527:0:21385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68043cca00/0x2aac941e5f4a8d4d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a8d54 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541361.681533:0:21385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9a68043cca00/0x2aac941e5f4a8d4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a8d54 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541361.685574:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788541361.685593:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a68043ccc00/0x2aac941e5f4a8a9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a8aa6 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541361.685635:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68043ccc00 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:3.0:1788541361.685640:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a68043ccc00/0x2aac941e5f4a8a9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a8aa6 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541361.685652:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a68043ccc00/0x2aac941e5f4a8a9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2aac941e5f4a8aa6 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788541361.685658:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a68043ccc00/0x2aac941e5f4a8a9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2aac941e5f4a8aa6 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541361.685665:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788541361.685667:0:17186:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1788541361.685684:0:17186:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a67082db000 00010000:00010000:3.0:1788541361.685689:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a68043ccc00/0x2aac941e5f4a8a9f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2aac941e5f4a8aa6 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541361.685696:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a68043ccc00/0x2aac941e5f4a8a9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2aac941e5f4a8aa6 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541361.685716:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541361.685719:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a68043cca00/0x2aac941e5f4a8d4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a8d54 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541361.685738:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68043cca00 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:3.0:1788541361.685741:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a68043cca00/0x2aac941e5f4a8d4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a8d54 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541361.685747:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a68043cca00/0x2aac941e5f4a8d4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2aac941e5f4a8d54 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788541361.685761:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a68043cca00/0x2aac941e5f4a8d4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2aac941e5f4a8d54 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541361.685767:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788541361.685769:0:17186:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1788541361.685775:0:17186:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a67082db000 00010000:00010000:3.0:1788541361.685778:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a68043cca00/0x2aac941e5f4a8d4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2aac941e5f4a8d54 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541361.685785:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541361.685787:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541361.685789:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541361.690844:0:21385:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788541361.690864:0:21385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a68043cca00/0x2aac941e5f4a8d4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2aac941e5f4a8d54 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541361.691086:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788541361.691381:0:21385:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1788541361.691391:0:21385:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1788541361.691393:0:21385:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788541361.691432:0:21385:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788541361.691437:0:21385:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788541361.691446:0:21385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788541361.691466:0:21385:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788541361.691470:0:21385:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9a68353119c0) has no exports 00000020:00080000:2.0:1788541361.691493:0:21385:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9a68353119c0) has no exports 00000020:01000000:2.0:1788541361.695640:0:21385:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a68065a7de0 - data ffff9a6705c7e510/ffff9a681e512c00 00000020:01000000:2.0:1788541361.697361:0:21385:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a680294ac00 - data ffff9a6839d43870/ffff9a67019f8400 00100000:10000000:2.0:1788541361.706526:0:21385:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788541361.723612:0:21385:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8ab4 00000020:00000080:1.0:1788541361.723626:0:21385:0:(genops.c:885:class_export_put()) final put ffff9a683533b800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788541361.723653:0:21385:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a6839114000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788541361.723657:0:21385:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a6839114000 2 00000020:01000004:1.0:1788541361.723660:0:21385:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a6839114000 from lustre-OST0001 00000020:00000080:1.0:1788541361.723682:0:21385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788541361.723692:0:21385:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788541361.723695:0:21385:0:(genops.c:885:class_export_put()) final put ffff9a6835338000/lustre-OST0001_UUID 00000020:00000080:1.0:1788541361.723698:0:21385:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6835338000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788541361.723706:0:21385:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1788541361.723821:0:21385:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 4746c063-6c88-4476-b99b-02bb8e8d54f7->MGS 00010000:00010000:1.0:1788541361.723839:0:21385:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a67075ad200/0x2aac941e5f4a88c3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2aac941e5f4a88ca expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788541361.723852:0:21385:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a67075ad200/0x2aac941e5f4a88c3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2aac941e5f4a88ca expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788541361.723858:0:21385:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788541361.723901:0:21385:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788541361.723904:0:21385:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788541361.723923:0:21385:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a67082db000 00010000:00010000:1.0:1788541361.723927:0:21385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a67075ad200/0x2aac941e5f4a88c3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2aac941e5f4a88ca expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541361.723943:0:21385:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a67075acc00/0x2aac941e5f4a87b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2aac941e5f4a87b9 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788541361.723950:0:21385:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a67075acc00/0x2aac941e5f4a87b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2aac941e5f4a87b9 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788541361.723956:0:21385:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788541361.723958:0:21385:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788541361.723959:0:21385:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788541361.723968:0:21385:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a67082db000 00010000:00010000:1.0:1788541361.723971:0:21385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a67075acc00/0x2aac941e5f4a87b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2aac941e5f4a87b9 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788541361.723988:0:21385:0:(import.c:65:import_set_state_nolock()) ffff9a67082db000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788541361.723992:0:21385:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788541361.723994:0:21385:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788541361.723996:0:21385:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788541361.724001:0:21385:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788541361.724012:0:21385:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a6708835880 x1875420981200256/t0(0) o250->MGC192.168.202.156@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788541378 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000080:3.0:1788541361.724319:0:18310:0:(genops.c:844:class_export_destroy()) destroying export ffff9a683533b800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:1.0:1788541361.724438:0:21385:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788541361.724442:0:21385:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:0.0:1788541361.724740:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4746c063-6c88-4476-b99b-02bb8e8d54f7:3640:1875420981200256:0@lo:250:kworker.0 10000000:01000000:1.0:1788541361.724855:0:21385:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788541361.724865:0:21385:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a879d 00000020:00000080:1.0:1788541361.724894:0:21385:0:(genops.c:885:class_export_put()) final put ffff9a6815a8f800/4746c063-6c88-4476-b99b-02bb8e8d54f7 00000020:01000000:1.0:1788541361.724913:0:21385:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.156@tcp (flags='') 00000020:00000080:1.0:1788541361.724934:0:21385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788541361.724941:0:21385:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.156@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788541361.724946:0:21385:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9a67079119c0) has no exports 00000020:00000080:3.0:1788541361.725248:0:18310:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6815a8f800/4746c063-6c88-4476-b99b-02bb8e8d54f7 for MGC192.168.202.156@tcp 10000000:01000000:0.0:1788541361.725308:0:17196:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788541361.725543:0:21385:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.156@tcp: client import never connected 00000100:00080000:1.0:1788541361.725547:0:21385:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788541361.725549:0:21385:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788541361.725552:0:21385:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788541361.725554:0:21385:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788541361.725594:0:21385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788541361.725601:0:21385:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.156@tcp (uuid 4746c063-6c88-4476-b99b-02bb8e8d54f7) 00000020:01000000:1.0:1788541361.725606:0:21385:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788541361.725610:0:21385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788541361.725615:0:21385:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788541361.725620:0:21385:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9a682e793000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788541361.725625:0:21385:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff9a6831d419c0) has exports, disconnecting them 00000020:00080000:1.0:1788541361.725629:0:21385:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9a682e793000), last request at 1788541284 00000020:00000080:1.0:1788541361.725633:0:21385:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8ade 00000020:00080000:1.0:1788541361.725645:0:21385:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a682e793000): rc 0 00000020:00000080:1.0:1788541361.725649:0:21385:0:(genops.c:885:class_export_put()) final put ffff9a682e793000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788541361.726667:0:18310:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a67082db000 for MGC192.168.202.156@tcp 00000020:00000080:3.0:1788541361.726678:0:18310:0:(genops.c:885:class_export_put()) final put ffff9a67082d8000/4746c063-6c88-4476-b99b-02bb8e8d54f7 00000020:00000080:3.0:1788541361.726680:0:18310:0:(genops.c:844:class_export_destroy()) destroying export ffff9a67082d8000/4746c063-6c88-4476-b99b-02bb8e8d54f7 for MGC192.168.202.156@tcp 00000020:01000000:3.0:1788541361.726687:0:18310:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.156@tcp (4746c063-6c88-4476-b99b-02bb8e8d54f7) 00000020:00000080:3.0:1788541361.727000:0:18310:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682e793000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788541361.727337:0:21385:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788541361.727341:0:21385:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788541361.727345:0:21385:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788541361.727350:0:21385:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788541361.727498:0:21385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788541361.727506:0:21385:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1788541361.727512:0:21385:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788541361.727517:0:21385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788541361.727520:0:21385:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788541361.727527:0:21385:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9a6706678800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788541361.727533:0:21385:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff9a6831d43380) has exports, disconnecting them 00000020:00080000:0.0:1788541361.727538:0:21385:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9a6706678800), last request at 1788541284 00000020:00000080:0.0:1788541361.727541:0:21385:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8af3 00000020:00080000:0.0:1788541361.727555:0:21385:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a6706678800): rc 0 00000020:00000080:0.0:1788541361.727560:0:21385:0:(genops.c:885:class_export_put()) final put ffff9a6706678800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788541361.728453:0:18310:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a670190c000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788541361.728462:0:18310:0:(genops.c:885:class_export_put()) final put ffff9a670190a000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788541361.728464:0:18310:0:(genops.c:844:class_export_destroy()) destroying export ffff9a670190a000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788541361.728470:0:18310:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788541361.728518:0:18310:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6706678800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1788541361.729428:0:21385:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788541361.729433:0:21385:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788541361.729452:0:21385:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788541361.729457:0:21385:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788541361.729484:0:18310:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6705aea800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1788541361.729545:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788541361.729670:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788541361.731266:0:19546:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1788541361.731517:0:17181:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9a6803784000:17181] 0 exiting: rc = 1 00000100:00100000:0.0:1788541361.732091:0:17182:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9a6803785000:17182] 1 exiting: rc = 0 00000100:00100000:3.0:1788541361.732391:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.732654:0:20350:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9a681e4c1800:20350] 3 exiting: rc = 0 00000100:00100000:3.0:1788541361.732755:0:17185:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9a6831cfa600:17185] 2 exiting: rc = 0 00000100:00100000:3.0:1788541361.733312:0:17183:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9a680b246200:17183] 0 exiting: rc = 1 00000100:00100000:3.0:1788541361.737430:0:17184:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9a6831cfb000:17184] 1 exiting: rc = 0 00000100:00100000:3.0:1788541361.737574:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.737583:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.737590:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.737597:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.737602:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.737608:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.737616:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.737621:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.737627:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.737634:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.737639:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.737644:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.737652:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.737656:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.737661:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.737665:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.737670:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.737674:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.737678:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.737682:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.737686:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.737691:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.737713:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.737719:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739226:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739238:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739244:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739261:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739267:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739273:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739278:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739283:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739288:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739293:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739298:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739302:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739306:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739311:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739315:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739320:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739324:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739329:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739334:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739339:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739345:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739351:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739356:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739361:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739366:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739370:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739375:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739380:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739385:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739389:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739394:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739399:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739404:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739419:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739423:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739427:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739432:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739437:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739442:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.739447:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788541361.753300:0:21385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788541361.753322:0:21385:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1788541361.753329:0:21385:0:(genops.c:885:class_export_put()) final put ffff9a6701908000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1788541361.753335:0:21385:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6701908000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1788541361.753345:0:21385:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1788541361.753413:0:21385:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a6839114000 1 00000020:00000080:3.0:1788541361.753420:0:21385:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a8a98 00000020:00000080:3.0:1788541361.753426:0:21385:0:(genops.c:885:class_export_put()) final put ffff9a6707b27000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788541361.753441:0:21385:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788541361.753454:0:18310:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6707b27000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788541361.753470:0:21385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788541361.753476:0:21385:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788541361.753481:0:21385:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff9a682e748000) has no exports 00000020:00000080:3.0:1788541361.826205:0:21385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788541361.826221:0:21385:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788541361.826228:0:21385:0:(genops.c:885:class_export_put()) final put ffff9a6839115000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788541361.826233:0:21385:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6839115000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788541361.826245:0:21385:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788541361.826573:0:21385:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a6839113000 00000020:01000000:3.0:1788541361.826603:0:21385:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788541361.826607:0:21385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788541361.826612:0:21385:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788541361.826616:0:21385:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9a680599b380) has no exports 00000020:00000080:3.0:1788541361.826635:0:21385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788541361.826639:0:21385:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788541361.826651:0:21385:0:(genops.c:885:class_export_put()) final put ffff9a680b3c1000/OSS_uuid 00000020:00000080:3.0:1788541361.826653:0:21385:0:(genops.c:844:class_export_destroy()) destroying export ffff9a680b3c1000/OSS_uuid for OSS 00000020:01000000:3.0:1788541361.826658:0:21385:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1788541361.826888:0:17194:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788541361.827044:0:18716:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9a680435fa00:18716] 0 exiting: rc = 1 00000100:00100000:1.0:1788541361.827115:0:18718:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9a680598d800:18718] 2 exiting: rc = 0 00000100:00100000:1.0:1788541361.827180:0:18717:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9a680435e400:18717] 1 exiting: rc = 0 00000100:00100000:2.0:1788541361.827346:0:19664:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9a6706b80800:19664] 4 exiting: rc = 0 00000100:00100000:3.0:1788541361.827826:0:19250:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9a670197e200:19250] 3 exiting: rc = 0 00000100:00100000:2.0:1788541361.829895:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.829906:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.829912:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.829917:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.829922:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.829927:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.829932:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.829937:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.829942:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.829947:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.829952:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.829957:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.829963:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.829968:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.829975:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.829981:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.829986:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.829992:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.829998:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830003:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830010:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830015:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830021:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830027:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830032:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830037:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830042:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830068:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830084:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830091:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830097:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830102:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830107:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830112:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830117:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830122:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830129:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830135:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830140:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830145:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830151:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830155:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830161:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830167:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830172:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830177:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830182:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830188:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830194:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830199:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830204:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830210:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830215:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830221:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830226:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830231:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830236:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830242:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830247:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830261:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830267:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830273:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830286:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541361.830292:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.831939:0:18721:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9a680598a000:18721] 1 exiting: rc = 0 00000100:00100000:2.0:1788541361.835049:0:18720:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9a680598de00:18720] 0 exiting: rc = 1 00000100:00100000:3.0:1788541361.835352:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835361:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835366:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835372:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835378:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835384:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835390:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835395:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835399:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835405:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835410:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835416:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835421:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835427:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835435:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835440:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835445:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835450:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835456:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835462:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835470:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835475:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835481:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835487:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835492:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835497:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835503:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835509:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835515:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835521:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835526:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835553:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835558:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835565:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835571:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835576:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835603:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835610:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835615:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835621:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835626:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835632:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835637:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835643:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835648:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835654:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835658:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835662:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835667:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835671:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835676:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835681:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835686:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835691:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835696:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835702:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835706:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835712:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835717:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835801:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835808:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835814:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835820:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.835825:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.838360:0:18724:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9a6803c37e00:18724] 2 exiting: rc = 0 00000100:00100000:1.0:1788541361.838587:0:18722:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9a6803c36000:18722] 0 exiting: rc = 1 00000100:00100000:0.0:1788541361.841382:0:18723:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9a68394b6c00:18723] 1 exiting: rc = 0 00000100:00100000:1.0:1788541361.841545:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841553:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841559:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841583:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841588:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841593:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841599:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841604:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841609:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841615:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841619:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841624:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841630:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841636:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841641:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841646:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841651:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841656:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841661:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841667:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841689:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841696:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841702:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841708:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841716:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841721:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841727:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841736:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841742:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841748:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841753:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841758:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841763:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841769:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841774:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841779:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841784:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841789:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841803:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841809:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841814:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841819:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841825:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841831:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841851:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841858:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841863:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841899:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841906:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841912:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841917:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841923:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841929:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841934:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841948:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841954:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841960:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841965:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841970:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841975:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841981:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841986:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841992:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.841997:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541361.847367:0:18725:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9a682ff7f800:18725] 0 exiting: rc = 1 00000100:00100000:3.0:1788541361.847555:0:18726:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9a67067cce00:18726] 1 exiting: rc = 0 00000100:00100000:1.0:1788541361.850238:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850248:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850264:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850269:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850275:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850280:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850286:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850290:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850296:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850321:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850331:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850335:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850340:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850346:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850352:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850357:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850361:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850366:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850372:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850377:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850382:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850386:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850391:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850397:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850402:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850407:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850412:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850417:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850422:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850428:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850434:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850440:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850454:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850464:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850470:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850474:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850479:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850484:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850489:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850496:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850502:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850508:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850513:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850518:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850531:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850536:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850541:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850546:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850550:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850555:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850560:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850566:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850577:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850584:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850589:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850593:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850597:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850601:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850605:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850609:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850613:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850618:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850622:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541361.850626:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.854714:0:18727:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9a681ea92a00:18727] 0 exiting: rc = 1 00000100:00100000:0.0:1788541361.854929:0:18728:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9a681ea92e00:18728] 1 exiting: rc = 0 00000100:00100000:3.0:1788541361.855061:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855069:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855084:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855092:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855098:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855105:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855110:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855138:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855146:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855153:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855159:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855165:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855171:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855176:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855181:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855186:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855191:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855196:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855202:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855223:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855231:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855237:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855243:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855249:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855265:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855271:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855276:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855282:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855289:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855294:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855299:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855320:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855326:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855332:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855337:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855351:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855355:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855363:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855367:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855374:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855379:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855386:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855392:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855412:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855419:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855425:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855431:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855437:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855442:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855447:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855452:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855458:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855464:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855469:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855474:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855493:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855500:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855506:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855511:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855516:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855521:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855527:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855533:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541361.855549:0:21385:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788541361.870033:0:21385:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788541381.384823:0:22150:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg256-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788541391.361642:0:22751:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788541391.361651:0:22751:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788541391.361653:0:22751:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788541391.361791:0:22751:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a682e797000 00000020:01000004:2.0:1788541391.362701:0:22751:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788541391.362714:0:22751:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788541391.362738:0:22751:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9a682e7499c0) 00000020:00000080:2.0:1788541391.362757:0:22751:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788541391.464760:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788541391.470419:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788541391.475404:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1788541391.476672:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1788541391.477068:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1788541391.477339:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1788541391.477718:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1788541391.478004:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1788541391.478283:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1788541391.478694:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788541391.479162:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788541391.479476:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1788541391.479868:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788541391.480161:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1788541391.480367:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788541391.480713:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1788541391.481042:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788541391.481257:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788541391.481518:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788541391.481838:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788541391.482168:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1788541391.482346:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788541391.482626:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788541391.483158:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1788541391.483704:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1788541391.483966:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1788541391.484234:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1788541391.484666:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788541391.484897:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788541391.485153:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788541391.485449:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788541391.485926:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1788541391.486488:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788541391.486964:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788541391.488430:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1788541391.488772:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788541391.489188:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1788541391.489621:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1788541391.490057:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1788541391.490287:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788541391.490677:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1788541391.490955:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788541391.491185:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788541391.491424:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1788541391.491761:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788541391.492108:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788541391.494023:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1788541391.496181:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1788541391.496761:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1788541391.497113:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1788541391.498721:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1788541391.498970:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1788541391.499181:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:1.0:1788541391.500124:0:22751:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788541391.500398:0:22751:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788541391.500406:0:22751:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788541391.500422:0:22751:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2aac941e5f4a9010 00000020:01000004:1.0:1788541391.500430:0:22751:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788541391.500435:0:22751:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788541391.500440:0:22751:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a682e797000 from MGS 00000020:01000004:1.0:1788541391.500444:0:22751:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788541391.500455:0:22751:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9a67069599c0) 00000020:00000080:1.0:1788541391.500466:0:22751:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788541391.500549:0:22751:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a682e797000 from MGS, refs=2 00080000:01000000:1.0:1788541391.500553:0:22751:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788541391.500559:0:22751:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2aac941e5f4a901e 00000100:00100000:1.0:1788541391.500934:0:22751:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788541391.501072:0:22751:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788541391.501078:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788541391.502478:0:22751:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788541391.502488:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788541391.504728:0:22751:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788541391.505161:0:22751:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788541391.505168:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788541391.507049:0:22751:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788541391.507065:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788541391.507997:0:22751:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788541391.508007:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788541391.509938:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541391.509944:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541391.509946:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541391.511081:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541391.511086:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541391.511094:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541391.511674:0:22751:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788541391.513382:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788541391.518045:0:22751:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788541391.518819:0:22763:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788541391.518889:0:22751:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788541391.518927:0:22751:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788541391.519724:0:22751:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788541391.520076:0:22751:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788541391.520250:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788541391.520257:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788541391.521205:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788541391.521213:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788541391.521521:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788541391.521536:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1788541391.522677:0:22767:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1788541391.522792:0:22751:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788541391.523408:0:22751:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.156@tcp' 00000020:01000004:1.0:1788541391.523411:0:22751:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788541391.523441:0:22751:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.156@tcp (typ=mgc) 00000020:00000080:1.0:1788541391.523452:0:22751:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.156@tcp (ffff9a670695b380) 00000020:00000080:1.0:1788541391.523466:0:22751:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788541391.523688:0:22751:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a68398c8000@MGC192.168.202.156@tcp: add connection 192.168.202.156@tcp at head 00010000:00010000:1.0:1788541391.524060:0:22751:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.156@tcp-0 is initialized 00000040:01000000:1.0:1788541391.524068:0:22751:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.156@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788541391.527967:0:22768:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788541391.533278:0:22751:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.156@tcp (uuid ee13e9d8-48fa-4214-b460-99ccd69f1274) 00000020:00000080:1.0:1788541391.533307:0:22751:0:(genops.c:1385:class_connect()) connect: client ee13e9d8-48fa-4214-b460-99ccd69f1274, cookie 0x2aac941e5f4a902c 00000100:00080000:1.0:1788541391.533321:0:22751:0:(import.c:545:import_select_connection()) MGC192.168.202.156@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788541391.533328:0:22751:0:(import.c:665:import_select_connection()) MGC192.168.202.156@tcp: import ffff9a68398c8000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:1.0:1788541391.533364:0:22751:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6708836d80 x1875420981200384/t0(0) o250->MGC192.168.202.156@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788541391.533416:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ee13e9d8-48fa-4214-b460-99ccd69f1274:3640:1875420981200384:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788541391.533502:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541391.533582:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981200384 00000100:00100000:1.0:1788541391.533590:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981200384 00000100:00100000:1.0:1788541391.533694:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788541391.533702:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670690d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3640:x1875420981200384:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788541391.533725:0:22764:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from ee13e9d8-48fa-4214-b460-99ccd69f1274@0@lo t0 exp 0000000000000000 cur 672 last 0 00000020:00000080:1.0:1788541391.533750:0:22764:0:(genops.c:1385:class_connect()) connect: client ee13e9d8-48fa-4214-b460-99ccd69f1274, cookie 0x2aac941e5f4a9033 00000100:00080000:1.0:1788541391.533909:0:22764:0:(import.c:65:import_set_state_nolock()) ffff9a68398ca800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788541391.533962:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670690d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+5:3640:x1875420981200384:12345-0@lo:250:mount.lustre.0 Request processed in 259us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541391.533969:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788541391.534020:0:3640:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.156@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788541391.534029:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.156@tcp: connect to target with instance 0 00000100:00080000:1.0:1788541391.534043:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.156@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788541391.534047:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788541391.534051:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a68398c8000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788541391.534053:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788541391.534061:0:3640:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788541391.534067:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ee13e9d8-48fa-4214-b460-99ccd69f1274:3640:1875420981200384:0@lo:250:mount.lustre.0 00000100:00080000:1.0:1788541391.534095:0:22751:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import ee13e9d8-48fa-4214-b460-99ccd69f1274->MGS 00000020:01000004:1.0:1788541391.534114:0:22751:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788541391.534140:0:22751:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788541391.534154:0:22751:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9a670695cd40) 00000020:00000080:1.0:1788541391.534164:0:22751:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788541391.550477:0:22751:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788541391.551038:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788541391.551045:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788541391.554102:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788541391.554115:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788541391.557024:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788541391.557077:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788541391.559074:0:22751:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788541391.559297:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788541391.559304:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788541391.560548:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788541391.560558:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788541391.597350:0:22751:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788541391.597712:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788541391.597718:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788541391.598857:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788541391.598867:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788541391.600134:0:22751:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788541391.600296:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788541391.600301:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788541391.600990:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788541391.600997:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788541391.601691:0:22751:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788541391.601948:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788541391.601953:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788541391.602399:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788541391.602406:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788541391.603330:0:22751:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788541391.603470:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788541391.603476:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788541391.604487:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788541391.604673:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788541391.623417:0:22751:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788541391.623801:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788541391.624994:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788541391.626348:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788541391.626359:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788541391.628129:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788541391.628141:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788541391.629167:0:22751:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788541391.629200:0:22751:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1788541391.629206:0:22751:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.156@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788541391.629320:0:22751:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.156@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788541391.629357:0:22751:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.156@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788541391.629362:0:22751:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788541391.629368:0:22751:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788541391.629369:0:22751:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788541391.629370:0:22751:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788541391.629372:0:22751:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788541391.629373:0:22751:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788541391.629374:0:22751:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788541391.629376:0:22751:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788541391.629377:0:22751:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788541391.629379:0:22751:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788541391.629381:0:22751:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788541391.629383:0:22751:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788541391.629384:0:22751:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788541391.629385:0:22751:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788541391.629386:0:22751:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788541391.629387:0:22751:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788541391.629388:0:22751:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788541391.629389:0:22751:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788541391.629390:0:22751:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788541391.629391:0:22751:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788541391.629392:0:22751:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788541391.629421:0:22751:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788541391.629441:0:22751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708836d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:22751:1875420981200512:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788541391.629708:0:22751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541391.629795:0:22751:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707873e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788541391.630068:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981200512 00000100:00100000:2.0:1788541391.630076:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981200512 00000100:00100000:2.0:1788541391.630158:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788541391.630169:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670690fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+5:22751:x1875420981200512:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788541391.630219:0:22766:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788541391.630222:0:22766:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788541391.630226:0:22766:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788541391.630523:0:22787:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788541391.631108:0:22766:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:3.0:1788541391.633011:0:22788:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788541391.633018:0:22788:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1788541391.633022:0:22788:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788541391.633024:0:22788:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788541391.633196:0:22788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1788541391.633416:0:22766:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788541391.633426:0:22766:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788541391.635322:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670690fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+5:22751:x1875420981200512:12345-0@lo:253:mount.lustre.0 Request processed in 5145us (5604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541391.635343:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788541391.635467:0:22751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708836d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:22751:1875420981200512:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788541391.635488:0:22751:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788541391.635492:0:22751:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788541391.635494:0:22751:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788541391.635495:0:22751:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788541391.635506:0:22751:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788541391.635507:0:22751:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788541391.635509:0:22751:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788541391.635510:0:22751:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788541391.635512:0:22751:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788541391.635513:0:22751:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788541391.635515:0:22751:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788541391.635682:0:22751:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a682e797000 from lustre-MDT0000 10000000:01000000:1.0:1788541391.635717:0:22751:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788541391.635732:0:22751:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788541391.635737:0:22751:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a670695b380 10000000:01000000:1.0:1788541391.635741:0:22751:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788541391.635751:0:22751:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a670695b380 from 1 10000000:01000000:1.0:1788541391.635754:0:22751:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788541391.635798:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842173c00/0x2aac941e5f4a9041 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541391.636303:0:22751:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a6842173c00/0x2aac941e5f4a9041 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541391.636315:0:22751:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a6842173c00/0x2aac941e5f4a9041 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541391.636339:0:22751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708836d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:22751:1875420981200640:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788541391.636397:0:22751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541391.636484:0:22751:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707873480 going to sleep for 11 seconds 00000100:00100000:0.0:1788541391.636704:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981200640 00000100:00100000:0.0:1788541391.636712:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981200640 00000100:00100000:0.0:1788541391.636813:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788541391.636824:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670690c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+5:22751:x1875420981200640:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788541391.636838:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541391.636854:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a682e75f800/0x2aac941e5f4a9048 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a9041 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541391.636908:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75f800/0x2aac941e5f4a9048 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a9041 expref: 6 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541391.636920:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a682e75f800/0x2aac941e5f4a9048 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a9041 expref: 6 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541391.636930:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75f800, rc 0) 00000100:00100000:0.0:1788541391.636991:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670690c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+6:22751:x1875420981200640:12345-0@lo:101:mount.lustre.0 Request processed in 159us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541391.636997:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788541391.637082:0:22751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708836d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:22751:1875420981200640:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788541391.637096:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a6842173c00/0x2aac941e5f4a9041 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9048 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541391.637106:0:22751:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a6842173c00/0x2aac941e5f4a9041 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a9048 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541391.637171:0:22751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:22751:1875420981200768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788541391.637198:0:22751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541391.637389:0:22751:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68065e0780 going to sleep for 11 seconds 00000100:00100000:1.0:1788541391.637481:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981200768 00000100:00100000:1.0:1788541391.637486:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981200768 00000100:00100000:1.0:1788541391.637523:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788541391.637617:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670690e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+6:22751:x1875420981200768:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541391.637703:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670690e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+6:22751:x1875420981200768:12345-0@lo:501:mount.lustre.0 Request processed in 96us (503us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788541391.637710:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788541391.637936:0:22751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:22751:1875420981200768:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788541391.637965:0:22751:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788541391.637990:0:22751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842173c00/0x2aac941e5f4a9041 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9048 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541391.638000:0:22751:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6842173c00/0x2aac941e5f4a9041 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9048 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541391.638018:0:22751:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a682e797000 10000000:01000000:3.0:1788541391.638022:0:22751:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788541391.638026:0:22751:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a682e797000 10000000:01000000:3.0:1788541391.638029:0:22751:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788541391.638031:0:22751:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9a682e797000 from 1 10000000:01000000:3.0:1788541391.638034:0:22751:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788541391.638055:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68043cd600/0x2aac941e5f4a904f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541391.638063:0:22751:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a68043cd600/0x2aac941e5f4a904f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541391.638071:0:22751:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a68043cd600/0x2aac941e5f4a904f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541391.638084:0:22751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:22751:1875420981200896:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788541391.638109:0:22751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541391.638128:0:22751:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68065e0780 going to sleep for 11 seconds 00000100:00100000:1.0:1788541391.638180:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981200896 00000100:00100000:1.0:1788541391.638184:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981200896 00000100:00100000:1.0:1788541391.638201:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788541391.638207:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670690c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+6:22751:x1875420981200896:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788541391.638214:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541391.638230:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6842173400/0x2aac941e5f4a9056 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a904f expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541391.638247:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6842173400/0x2aac941e5f4a9056 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a904f expref: 7 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541391.638256:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6842173400/0x2aac941e5f4a9056 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a904f expref: 7 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541391.638263:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842173400, rc 0) 00000100:00100000:1.0:1788541391.638294:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670690c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+7:22751:x1875420981200896:12345-0@lo:101:mount.lustre.0 Request processed in 87us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541391.638300:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788541391.638361:0:22751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:22751:1875420981200896:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788541391.638371:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a68043cd600/0x2aac941e5f4a904f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9056 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541391.638379:0:22751:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a68043cd600/0x2aac941e5f4a904f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a9056 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541391.638389:0:22751:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788541391.638402:0:22751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68043cd600/0x2aac941e5f4a904f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9056 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541391.638414:0:22751:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a68043cd600/0x2aac941e5f4a904f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9056 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541391.638420:0:22751:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788541391.638423:0:22751:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788541391.638426:0:22751:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a682e797000 10000000:01000000:3.0:1788541391.638428:0:22751:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788541391.638431:0:22751:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788541391.638433:0:22751:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788541391.638445:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68043ccc00/0x2aac941e5f4a905d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541391.638452:0:22751:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a68043ccc00/0x2aac941e5f4a905d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541391.638459:0:22751:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a68043ccc00/0x2aac941e5f4a905d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541391.638469:0:22751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:22751:1875420981201024:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788541391.638491:0:22751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541391.638511:0:22751:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68065e0780 going to sleep for 11 seconds 00000100:00100000:1.0:1788541391.638618:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981201024 00000100:00100000:1.0:1788541391.638621:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981201024 00000100:00100000:1.0:1788541391.638637:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788541391.638642:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670690c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+7:22751:x1875420981201024:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788541391.638649:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541391.638656:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6842172400/0x2aac941e5f4a9064 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a905d expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541391.638686:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6842172400/0x2aac941e5f4a9064 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a905d expref: 8 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541391.638694:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6842172400/0x2aac941e5f4a9064 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a905d expref: 8 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541391.638700:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842172400, rc 0) 00000100:00100000:1.0:1788541391.638733:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670690c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+8:22751:x1875420981201024:12345-0@lo:101:mount.lustre.0 Request processed in 90us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541391.638749:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788541391.639061:0:22751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:22751:1875420981201024:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788541391.639074:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a68043ccc00/0x2aac941e5f4a905d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9064 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541391.639082:0:22751:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a68043ccc00/0x2aac941e5f4a905d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a9064 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541391.639144:0:22751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:22751:1875420981201152:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788541391.639171:0:22751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541391.639188:0:22751:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68065e0780 going to sleep for 11 seconds 00000100:00100000:1.0:1788541391.639236:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981201152 00000100:00100000:1.0:1788541391.639240:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981201152 00000100:00100000:1.0:1788541391.639268:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788541391.639275:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670690d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+8:22751:x1875420981201152:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541391.639476:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670690d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+9:22751:x1875420981201152:12345-0@lo:501:mount.lustre.0 Request processed in 200us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541391.639483:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788541391.639727:0:22751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:22751:1875420981201152:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788541391.639751:0:22751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:22751:1875420981201280:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788541391.639785:0:22751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541391.640028:0:22751:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68065e0780 going to sleep for 11 seconds 00000100:00100000:0.0:1788541391.640088:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981201280 00000100:00100000:0.0:1788541391.640092:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981201280 00000100:00100000:0.0:1788541391.640155:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788541391.640163:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670690f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+9:22751:x1875420981201280:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788541391.640942:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670690f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+9:22751:x1875420981201280:12345-0@lo:503:mount.lustre.0 Request processed in 778us (1154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541391.640951:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788541391.641052:0:22751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:22751:1875420981201280:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788541391.641409:0:22789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078edc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee13e9d8-48fa-4214-b460-99ccd69f1274:22789:1875420981201408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788541391.641446:0:22789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541391.641772:0:22789:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68065e0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788541391.641798:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981201408 00000100:00100000:1.0:1788541391.641809:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981201408 00000100:00100000:1.0:1788541391.641838:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788541391.641845:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670690e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+9:22789:x1875420981201408:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788541391.642482:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670690e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+9:22789:x1875420981201408:12345-0@lo:502:llog_process_th.0 Request processed in 636us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541391.642490:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788541391.642640:0:22789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078edc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee13e9d8-48fa-4214-b460-99ccd69f1274:22789:1875420981201408:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788541391.642669:0:22789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788541391.642680:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541391.642682:0:22789:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788541391.642687:0:22789:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788541391.642690:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788541391.642703:0:22789:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9a6706524d40) 00000020:00000080:3.0:1788541391.642718:0:22789:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788541391.642723:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788541391.642814:0:22789:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788541391.642823:0:22789:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2aac941e5f4a9072 00000020:00000080:3.0:1788541391.643057:0:22789:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788541391.643062:0:22789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788541391.643065:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541391.643072:0:22789:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788541391.643075:0:22789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788541391.643079:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541391.643080:0:22789:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788541391.643083:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788541391.643091:0:22789:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9a67065219c0) 00000020:00000080:3.0:1788541391.643100:0:22789:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788541391.643104:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788541391.643106:0:22789:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788541391.643109:0:22789:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788541391.643115:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788541391.643168:0:22789:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a682e797000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788541391.643179:0:22789:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9a6706523380) 00000020:00000080:3.0:1788541391.643186:0:22789:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788541391.643229:0:22789:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788541391.643235:0:22789:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2aac941e5f4a9087 00000020:00000080:3.0:1788541391.643322:0:22789:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788541391.643328:0:22789:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788541391.643332:0:22789:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2aac941e5f4a908e 00080000:01000000:3.0:1788541391.643336:0:22789:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788541391.643339:0:22789:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2aac941e5f4a9095 00010000:00010000:3.0:1788541391.722128:0:22789:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788541391.723343:0:22789:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:3.0:1788541391.724016:0:22789:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788541391.724485:0:22789:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9a6706520000) 00000020:00000080:3.0:1788541391.724515:0:22789:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788541391.724601:0:22789:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788541391.724608:0:22789:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2aac941e5f4a90a3 00000020:00000080:3.0:1788541391.729252:0:22789:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788541391.736200:0:22789:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2aac941e5f4a90aa 00000020:00000080:0.0:1788541391.737819:0:22789:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788541391.737832:0:22789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788541391.737839:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541391.737841:0:22789:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788541391.737845:0:22789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788541391.737848:0:22789:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1788541391.737849:0:22789:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788541391.737851:0:22789:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788541391.737853:0:22789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788541391.737856:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541391.737858:0:22789:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788541391.737860:0:22789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788541391.737865:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541391.737867:0:22789:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788541391.737893:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788541391.737939:0:22789:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788541391.737955:0:22789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788541391.737958:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541391.737960:0:22789:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788541391.737962:0:22789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788541391.737966:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541391.737973:0:22789:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788541391.737977:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788541391.737991:0:22789:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.156@tcp to nid 0x20000c0a8ca9c (192.168.202.156@tcp) 00000020:00000080:0.0:1788541391.738018:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788541391.738034:0:22789:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9a6831d40000) 00000020:00000080:0.0:1788541391.738050:0:22789:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788541391.738056:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788541391.738110:0:22789:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1788541391.738116:0:22789:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788541391.738122:0:22789:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2aac941e5f4a90b8 00010000:00080000:0.0:1788541391.738154:0:22789:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a6802b4d000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.156@tcp at head 00010000:00010000:1.0:1788541391.743721:0:22789:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1788541391.748083:0:22789:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788541391.748102:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788541391.748161:0:22789:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788541391.748185:0:22789:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2aac941e5f4a90bf 00000100:00080000:2.0:1788541391.748197:0:22789:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788541391.748203:0:22789:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a6802b4d000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:2.0:1788541391.748242:0:22789:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a682e710000 x1875420981201536/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788541391.748315:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981201536:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788541391.748392:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788541391.748457:0:22789:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1788541391.748550:0:22789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788541391.748566:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541391.748568:0:22789:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788541391.748572:0:22789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788541391.748575:0:22789:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1788541391.748576:0:22789:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788541391.748578:0:22789:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788541391.748579:0:22789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788541391.748582:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541391.748584:0:22789:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788541391.748586:0:22789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788541391.748598:0:22789:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788541391.748602:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541391.748603:0:22789:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788541391.748617:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788541391.748622:0:22789:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.156@tcp to nid 0x20000c0a8ca9c (192.168.202.156@tcp) 00000020:01000000:2.0:1788541391.748643:0:22789:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788541391.748646:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788541391.748660:0:22789:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9a682e74cd40) 00000020:00000080:2.0:1788541391.748673:0:22789:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788541391.748678:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788541391.748739:0:22789:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788541391.748745:0:22789:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788541391.748750:0:22789:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2aac941e5f4a90cd 00010000:00080000:2.0:1788541391.748775:0:22789:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a682fdc6800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.156@tcp at head 00010000:00010000:2.0:1788541391.749036:0:22789:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:1.0:1788541391.749669:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981201536 00000100:00100000:1.0:1788541391.749678:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981201536 00000100:00100000:1.0:1788541391.749720:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788541391.749728:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875420981201536:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1788541391.749745:0:22776:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:2.0:1788541391.759047:0:22789:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788541391.760086:0:22789:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1788541391.763155:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875420981201536:12345-0@lo:38:llog_process_th.0 Request processed in 13416us (14752us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788541391.763169:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:1.0:1788541391.767226:0:22789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:0.0:1788541391.767464:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6802b4d000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788541391.767473:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788541391.767478:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981201536:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788541391.767695:0:22789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1788541391.773179:0:22789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:3.0:1788541391.774381:0:22795:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788541391.774388:0:22795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788541391.775586:0:22789:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788541391.775601:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788541391.775719:0:22789:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788541391.775742:0:22789:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2aac941e5f4a90d4 00000100:00080000:1.0:1788541391.775752:0:22789:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788541391.775758:0:22789:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a682fdc6800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:1.0:1788541391.776176:0:22789:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6708835c00 x1875420981201664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788541391.776226:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981201664:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788541391.776282:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875420981201664 offset 0 length 520: 4 00000100:00080000:1.0:1788541391.776341:0:22789:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788541391.776407:0:22789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788541391.776411:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541391.776413:0:22789:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788541391.776416:0:22789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788541391.776418:0:22789:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1788541391.776420:0:22789:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788541391.776422:0:22789:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788541391.776423:0:22789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788541391.776426:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541391.776427:0:22789:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788541391.776429:0:22789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788541391.776433:0:22789:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788541391.776436:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541391.776438:0:22789:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788541391.776441:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788541391.776445:0:22789:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.156@tcp to nid 0x20000c0a8ca9c (192.168.202.156@tcp) 00000020:01000000:1.0:1788541391.776466:0:22789:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788541391.776469:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788541391.776481:0:22789:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9a6706958000) 00000020:00000080:1.0:1788541391.776493:0:22789:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1788541391.776674:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788541391.776744:0:22789:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788541391.776750:0:22789:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788541391.776755:0:22789:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2aac941e5f4a90e2 00010000:00080000:1.0:1788541391.776781:0:22789:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a68398d5000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.156@tcp at head 00010000:00010000:1.0:1788541391.777048:0:22789:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788541391.777120:0:22789:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788541391.777136:0:22789:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788541391.781167:0:22789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788541391.781483:0:22789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1788541391.782181:0:22789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:3.0:1788541391.783458:0:22797:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788541391.783469:0:22797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788541391.784786:0:22789:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788541391.785018:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788541391.785064:0:22789:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788541391.785086:0:22789:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2aac941e5f4a90e9 00000100:00080000:1.0:1788541391.785098:0:22789:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788541391.785105:0:22789:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a68398d5000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:1.0:1788541391.785139:0:22789:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6708836d80 x1875420981201792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788541391.785203:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981201792:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788541391.785263:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875420981201792 offset 0 length 520: 4 00000100:00080000:1.0:1788541391.785319:0:22789:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788541391.785379:0:22789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788541391.785384:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541391.785386:0:22789:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788541391.785389:0:22789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788541391.785393:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541391.785394:0:22789:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788541391.785397:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788541391.785399:0:22789:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788541391.785401:0:22789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788541391.785404:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541391.785405:0:22789:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788541391.785408:0:22789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788541391.785423:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541391.785424:0:22789:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788541391.785430:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788541391.785458:0:22789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708835880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee13e9d8-48fa-4214-b460-99ccd69f1274:22789:1875420981201920:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788541391.785754:0:22789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541391.785782:0:22789:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67076a0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788541391.786010:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981201920 00000100:00100000:2.0:1788541391.786019:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981201920 00000100:00100000:2.0:1788541391.786071:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788541391.786080:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670690cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+9:22789:x1875420981201920:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788541391.786208:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670690cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+9:22789:x1875420981201920:12345-0@lo:502:llog_process_th.0 Request processed in 128us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541391.786215:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788541391.786325:0:22789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708835880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee13e9d8-48fa-4214-b460-99ccd69f1274:22789:1875420981201920:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788541391.786351:0:22789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788541391.786357:0:22789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541391.786359:0:22789:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788541391.786362:0:22789:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1788541391.786713:0:22751:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1788541391.786736:0:22751:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788541391.786756:0:22751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68043ccc00/0x2aac941e5f4a905d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9064 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541391.786767:0:22751:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a68043ccc00/0x2aac941e5f4a905d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9064 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541391.786782:0:22751:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a682e797000 from 1 10000000:01000000:2.0:1788541391.786785:0:22751:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788541391.786824:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842049e00/0x2aac941e5f4a90f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541391.786833:0:22751:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a6842049e00/0x2aac941e5f4a90f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541391.786854:0:22751:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a6842049e00/0x2aac941e5f4a90f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541391.786908:0:22751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e713100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:22751:1875420981202048:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788541391.786945:0:22751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541391.786968:0:22751:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682e78f540 going to sleep for 11 seconds 00000100:00100000:3.0:1788541391.787152:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981202048 00000100:00100000:3.0:1788541391.787157:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981202048 00000100:00100000:3.0:1788541391.787191:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788541391.787199:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670690ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+9:22751:x1875420981202048:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788541391.787209:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541391.787223:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68043cda00/0x2aac941e5f4a90f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a90f0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541391.787246:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68043cda00/0x2aac941e5f4a90f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a90f0 expref: 10 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541391.787255:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68043cda00/0x2aac941e5f4a90f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a90f0 expref: 10 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541391.787263:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68043cda00, rc 0) 00000100:00100000:3.0:1788541391.787297:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670690ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+10:22751:x1875420981202048:12345-0@lo:101:mount.lustre.0 Request processed in 98us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541391.787304:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788541391.787385:0:22751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e713100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:22751:1875420981202048:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788541391.787399:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a6842049e00/0x2aac941e5f4a90f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a90f7 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541391.787407:0:22751:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a6842049e00/0x2aac941e5f4a90f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a90f7 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541391.789216:0:22751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e713100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:22751:1875420981202176:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788541391.789281:0:22751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541391.789322:0:22751:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682e78f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788541391.789381:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981202176 00000100:00100000:1.0:1788541391.789389:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981202176 00000100:00100000:1.0:1788541391.789432:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788541391.789440:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804595450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+10:22751:x1875420981202176:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788541391.789457:0:22765:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788541391.789464:0:22765:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788541391.789778:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804595450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+10:22751:x1875420981202176:12345-0@lo:256:mount.lustre.0 Request processed in 338us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541391.789786:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788541391.789903:0:22751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e713100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:22751:1875420981202176:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788541391.790753:0:22751:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788541391.790776:0:22751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842049e00/0x2aac941e5f4a90f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a90f7 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541391.790787:0:22751:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6842049e00/0x2aac941e5f4a90f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a90f7 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541391.790842:0:22751:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a682e797000 from 1 10000000:01000000:0.0:1788541391.790845:0:22751:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788541391.790906:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75e800/0x2aac941e5f4a90fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541391.790915:0:22751:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a682e75e800/0x2aac941e5f4a90fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541391.790924:0:22751:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a682e75e800/0x2aac941e5f4a90fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541391.790947:0:22751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:22751:1875420981202304:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788541391.791003:0:22751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541391.791148:0:22751:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6706859900 going to sleep for 11 seconds 00000100:00100000:2.0:1788541391.791326:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981202304 00000100:00100000:2.0:1788541391.791333:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981202304 00000100:00100000:2.0:1788541391.791379:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788541391.791395:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804597850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+10:22751:x1875420981202304:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788541391.791407:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541391.791420:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6842048400/0x2aac941e5f4a9105 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a90fe expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541391.791443:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6842048400/0x2aac941e5f4a9105 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a90fe expref: 11 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541391.791454:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6842048400/0x2aac941e5f4a9105 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a90fe expref: 11 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541391.791463:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842048400, rc 0) 00000100:00100000:2.0:1788541391.791514:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804597850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+11:22751:x1875420981202304:12345-0@lo:101:mount.lustre.0 Request processed in 120us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541391.791520:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788541391.792111:0:22751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:22751:1875420981202304:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788541391.792127:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a682e75e800/0x2aac941e5f4a90fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9105 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541391.792136:0:22751:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a682e75e800/0x2aac941e5f4a90fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a9105 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541391.792202:0:22751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:22751:1875420981202432:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788541391.792233:0:22751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541391.792263:0:22751:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6706859900 going to sleep for 11 seconds 00000100:00100000:2.0:1788541391.792318:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981202432 00000100:00100000:2.0:1788541391.792322:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981202432 00000100:00100000:2.0:1788541391.792383:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788541391.792391:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804597050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+11:22751:x1875420981202432:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788541391.792526:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804597050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+11:22751:x1875420981202432:12345-0@lo:501:mount.lustre.0 Request processed in 135us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541391.792534:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788541391.792627:0:22751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:22751:1875420981202432:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788541391.792656:0:22751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:22751:1875420981202560:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788541391.792703:0:22751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541391.792724:0:22751:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6706859900 going to sleep for 11 seconds 00000100:00100000:2.0:1788541391.792933:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981202560 00000100:00100000:2.0:1788541391.792937:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981202560 00000100:00100000:2.0:1788541391.792957:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788541391.792962:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804594c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+11:22751:x1875420981202560:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788541391.793052:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804594c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+11:22751:x1875420981202560:12345-0@lo:503:mount.lustre.0 Request processed in 89us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541391.793070:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788541391.793324:0:22751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:22751:1875420981202560:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788541391.793998:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078edc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee13e9d8-48fa-4214-b460-99ccd69f1274:22799:1875420981202688:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788541391.794045:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541391.794119:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68065e03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788541391.794226:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981202688 00000100:00100000:2.0:1788541391.794231:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981202688 00000100:00100000:2.0:1788541391.794265:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788541391.794273:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804596850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+11:22799:x1875420981202688:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788541391.795064:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804596850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+11:22799:x1875420981202688:12345-0@lo:502:llog_process_th.0 Request processed in 790us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541391.795073:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788541391.795229:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078edc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee13e9d8-48fa-4214-b460-99ccd69f1274:22799:1875420981202688:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788541391.795260:0:22799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788541391.795271:0:22799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541391.795273:0:22799:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788541391.795281:0:22799:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a682e797000 00000020:00000080:0.0:1788541391.795283:0:22799:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788541391.795291:0:22799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788541391.795294:0:22799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541391.795295:0:22799:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788541391.795297:0:22799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788541391.795300:0:22799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541391.795301:0:22799:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788541391.795305:0:22799:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a682e797000 00000020:00000080:0.0:1788541391.795307:0:22799:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788541391.795412:0:22799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788541391.795416:0:22799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541391.795418:0:22799:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788541391.795421:0:22799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788541391.795424:0:22799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541391.795425:0:22799:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788541391.795428:0:22799:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a682e797000 00000020:00000080:0.0:1788541391.795431:0:22799:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788541391.798298:0:22799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788541391.798314:0:22799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541391.798316:0:22799:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788541391.798320:0:22799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788541391.798325:0:22799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541391.798326:0:22799:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788541391.798346:0:22799:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a682e797000 00000020:00000080:0.0:1788541391.798349:0:22799:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788541391.798436:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee13e9d8-48fa-4214-b460-99ccd69f1274:22799:1875420981202816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788541391.798527:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541391.798577:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6706859900 going to sleep for 11 seconds 00000100:00100000:1.0:1788541391.798703:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981202816 00000100:00100000:1.0:1788541391.798711:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981202816 00000100:00100000:1.0:1788541391.798767:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788541391.798775:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804596450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+11:22799:x1875420981202816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788541391.798932:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804596450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+11:22799:x1875420981202816:12345-0@lo:502:llog_process_th.0 Request processed in 158us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541391.798941:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788541391.799186:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee13e9d8-48fa-4214-b460-99ccd69f1274:22799:1875420981202816:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788541391.799214:0:22799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788541391.799220:0:22799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541391.799221:0:22799:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788541391.799225:0:22799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788541391.802622:0:22751:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788541391.802661:0:22751:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788541391.802677:0:22751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75e800/0x2aac941e5f4a90fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9105 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541391.802690:0:22751:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a682e75e800/0x2aac941e5f4a90fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9105 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541391.802756:0:22751:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788541391.802759:0:22751:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a682e797000 10000000:01000000:2.0:1788541391.802762:0:22751:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a682e797000 10000000:01000000:2.0:1788541391.802766:0:22751:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788541391.802772:0:22751:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a682e797000 from 1 10000000:01000000:2.0:1788541391.802775:0:22751:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788541391.802824:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842048600/0x2aac941e5f4a910c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541391.802834:0:22751:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a6842048600/0x2aac941e5f4a910c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541391.802846:0:22751:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a6842048600/0x2aac941e5f4a910c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541391.802893:0:22751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e711c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:22751:1875420981202944:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788541391.802959:0:22751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541391.803008:0:22751:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707873e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788541391.803425:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981202944 00000100:00100000:1.0:1788541391.803438:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981202944 00000100:00100000:1.0:1788541391.803494:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788541391.803513:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804596050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+11:22751:x1875420981202944:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788541391.803526:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541391.803539:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6842172c00/0x2aac941e5f4a9113 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a910c expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541391.803564:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6842172c00/0x2aac941e5f4a9113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a910c expref: 12 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541391.803576:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6842172c00/0x2aac941e5f4a9113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a910c expref: 12 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541391.803586:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842172c00, rc 0) 00000100:00100000:1.0:1788541391.803642:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804596050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+12:22751:x1875420981202944:12345-0@lo:101:mount.lustre.0 Request processed in 132us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541391.803650:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788541391.805232:0:22751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e711c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:22751:1875420981202944:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788541391.805260:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a6842048600/0x2aac941e5f4a910c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9113 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541391.805272:0:22751:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a6842048600/0x2aac941e5f4a910c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a9113 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541391.805355:0:22751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e711c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:22751:1875420981203072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788541391.805409:0:22751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541391.805445:0:22751:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707873e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788541391.805467:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981203072 00000100:00100000:2.0:1788541391.805472:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981203072 00000100:00100000:2.0:1788541391.805588:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788541391.805598:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804597c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+12:22751:x1875420981203072:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788541391.805786:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804597c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+12:22751:x1875420981203072:12345-0@lo:501:mount.lustre.0 Request processed in 190us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541391.806112:0:22751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e711c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:22751:1875420981203072:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541391.806146:0:22751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708835880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:22751:1875420981203200:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788541391.806194:0:22751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541391.806214:0:22751:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67076a0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788541391.806590:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788541391.806720:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981203200 00000100:00100000:2.0:1788541391.806726:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981203200 00000100:00100000:2.0:1788541391.806764:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788541391.806772:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804597450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+12:22751:x1875420981203200:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788541391.807600:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804597450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+12:22751:x1875420981203200:12345-0@lo:503:mount.lustre.0 Request processed in 826us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541391.807628:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788541391.807691:0:22751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708835880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:22751:1875420981203200:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788541391.807996:0:22802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e711180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee13e9d8-48fa-4214-b460-99ccd69f1274:22802:1875420981203328:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788541391.808038:0:22802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541391.808066:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981203328 00000100:00100000:2.0:1788541391.808071:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981203328 00000100:00100000:2.0:1788541391.808099:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788541391.808106:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804594850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+12:22802:x1875420981203328:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788541391.808184:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804594850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+12:22802:x1875420981203328:12345-0@lo:502:llog_process_th.0 Request processed in 78us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541391.808191:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788541391.808232:0:22802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f2f4600 going to sleep for 11 seconds 00000100:00100000:2.0:1788541391.808247:0:22802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e711180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee13e9d8-48fa-4214-b460-99ccd69f1274:22802:1875420981203328:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788541391.808303:0:22802:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788541391.808324:0:22802:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9a682e748000) 00000020:00000080:2.0:1788541391.808345:0:22802:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1788541391.808426:0:22802:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a682e797000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788541391.808431:0:22802:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a682e797000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788541391.808433:0:22802:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a682e797000 4 00010000:00080000:2.0:1788541391.808461:0:22802:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a680a571000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.156@tcp at head 00010000:00010000:2.0:1788541391.810081:0:22802:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1788541391.810272:0:22802:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788541391.810309:0:22802:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788541391.810323:0:22802:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2aac941e5f4a9121 00000100:00080000:2.0:1788541391.810333:0:22802:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788541391.810338:0:22802:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a680a571000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:2.0:1788541391.810376:0:22802:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a682e711180 x1875420981203456/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788541391.810409:0:22802:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788541391.811710:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875420981203456:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788541391.811787:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541391.813948:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981203456 00000100:00100000:3.0:1788541391.813962:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981203456 00000100:00100000:3.0:1788541391.814019:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788541391.814028:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875420981203456:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788541391.814122:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875420981203456:12345-0@lo:38:llog_process_th.0 Request processed in 93us (2334us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788541391.814139:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788541391.817072:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788541391.817085:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a680a571000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788541391.817092:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788541391.817097:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875420981203456:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788541391.830269:0:22802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708837100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee13e9d8-48fa-4214-b460-99ccd69f1274:22802:1875420981203584:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788541391.830353:0:22802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541391.830393:0:22802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67076a0180 going to sleep for 11 seconds 00000100:00100000:2.0:1788541391.832843:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981203584 00000100:00100000:2.0:1788541391.832856:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981203584 00000100:00100000:2.0:1788541391.832926:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788541391.832935:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804594050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+12:22802:x1875420981203584:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788541391.835475:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804594050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+12:22802:x1875420981203584:12345-0@lo:502:llog_process_th.0 Request processed in 2531us (5112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541391.835489:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788541391.835763:0:22802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708837100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee13e9d8-48fa-4214-b460-99ccd69f1274:22802:1875420981203584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788541391.835844:0:22802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e710a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee13e9d8-48fa-4214-b460-99ccd69f1274:22802:1875420981203712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788541391.835911:0:22802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541391.835941:0:22802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f2f49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788541391.835957:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981203712 00000100:00100000:2.0:1788541391.835963:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981203712 00000100:00100000:2.0:1788541391.836009:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788541391.836019:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804594450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+12:22802:x1875420981203712:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788541391.836097:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804594450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+12:22802:x1875420981203712:12345-0@lo:502:llog_process_th.0 Request processed in 78us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541391.836104:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788541391.836140:0:22802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e710a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee13e9d8-48fa-4214-b460-99ccd69f1274:22802:1875420981203712:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788541391.836159:0:22802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788541391.836293:0:22751:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788541391.836328:0:22751:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788541391.836349:0:22751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842048600/0x2aac941e5f4a910c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9113 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541391.836359:0:22751:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6842048600/0x2aac941e5f4a910c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9113 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788541391.836402:0:22751:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788541391.836404:0:22751:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788541391.836405:0:22751:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788541391.836407:0:22751:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788541391.836408:0:22751:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788541391.836409:0:22751:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788541391.836411:0:22751:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788541391.836412:0:22751:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788541391.836415:0:22751:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788541391.836416:0:22751:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788541391.836420:0:22751:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788541391.836422:0:22751:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788541391.836423:0:22751:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788541391.836424:0:22751:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788541391.836426:0:22751:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788541391.836427:0:22751:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788541391.836428:0:22751:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788541391.836429:0:22751:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788541391.836431:0:22751:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788541391.836432:0:22751:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788541391.836433:0:22751:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788541391.836446:0:22751:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788541391.836456:0:22751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e710a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:22751:1875420981203840:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788541391.836484:0:22751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541391.837049:0:22751:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f2f49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788541391.837076:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981203840 00000100:00100000:2.0:1788541391.837081:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981203840 00000100:00100000:2.0:1788541391.837111:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788541391.837118:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804595850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+12:22751:x1875420981203840:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788541391.837150:0:22765:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788541391.837164:0:22765:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788541391.840367:0:22765:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788541391.840383:0:22765:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788541391.841392:0:22787:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788541391.841400:0:22787:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788541391.841433:0:22787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a68043cd000/0x2aac941e5f4a9128 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541391.841450:0:22787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a68043cda00/0x2aac941e5f4a90f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a90f0 expref: 12 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541391.841463:0:22787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a68043cd000/0x2aac941e5f4a9128 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541391.841580:0:22787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a68043cda00/0x2aac941e5f4a90f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a90f0 expref: 12 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541391.841596:0:22787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a68043cda00/0x2aac941e5f4a90f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a90f0 expref: 12 pid: 22766 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541391.841683:0:22787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078edf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22787:1875420981203968:0@lo:104: 00000100:00100000:3.0:1788541391.841734:0:22787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541391.841778:0:22787:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682e719300 going to sleep for 11 seconds 00000100:00100000:2.0:1788541391.841880:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804595850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+12:22751:x1875420981203840:12345-0@lo:253:mount.lustre.0 Request processed in 3677us (4310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541391.841895:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788541391.841965:0:22751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e710a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:22751:1875420981203840:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788541391.841976:0:22751:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788541391.841989:0:22751:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788541391.841991:0:22751:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788541391.841992:0:22751:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788541391.841993:0:22751:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788541391.841995:0:22751:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788541391.841996:0:22751:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788541391.841997:0:22751:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788541391.841999:0:22751:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788541391.842001:0:22751:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788541391.842002:0:22751:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788541391.842017:0:22751:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788541391.842469:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981203968 00000100:00100000:0.0:1788541391.842478:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981203968 00000100:00100000:0.0:1788541391.843375:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788541391.843391:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee13e9d8-48fa-4214-b460-99ccd69f1274+3:22787:x1875420981203968:12345-0@lo:104: 00010000:00010000:0.0:1788541391.843410:0:22755:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a6842049e00/0x2aac941e5f4a90f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a90f7 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541391.843493:0:22755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788541391.843679:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee13e9d8-48fa-4214-b460-99ccd69f1274+3:22787:x1875420981203968:12345-0@lo:104: Request processed in 295us (1945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541391.843686:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788541391.845163:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541391.845173:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a6842049e00/0x2aac941e5f4a90f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a90f7 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541391.845183:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842049e00 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:0.0:1788541391.845187:0:22761:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a6842049e00/0x2aac941e5f4a90f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a90f7 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541391.845197:0:22761:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a6842049e00/0x2aac941e5f4a90f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a90f7 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788541391.845205:0:22761:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a6842049e00/0x2aac941e5f4a90f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a90f7 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541391.845211:0:22761:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788541391.845269:0:22761:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a6842049e00/0x2aac941e5f4a90f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a90f7 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541391.845275:0:22761:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788541391.845300:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a6842049e00/0x2aac941e5f4a90f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a90f7 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541391.845308:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a6842049e00/0x2aac941e5f4a90f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a90f7 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541391.845328:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541391.845330:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541391.845332:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541391.845394:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee13e9d8-48fa-4214-b460-99ccd69f1274:3641:1875420981204096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788541391.845451:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541391.845547:0:22787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078edf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22787:1875420981203968:0@lo:104: 00010000:00010000:0.0:1788541391.845568:0:22787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a68043cd000/0x2aac941e5f4a9128 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541391.848482:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981204096 00000100:00100000:3.0:1788541391.848507:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981204096 00010000:00010000:3.0:1788541391.848544:0:22757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a68043cda00/0x2aac941e5f4a90f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a90f0 expref: 12 pid: 22766 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541391.848584:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788541391.848594:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee13e9d8-48fa-4214-b460-99ccd69f1274+12:3641:x1875420981204096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788541391.848616:0:22757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541391.848623:0:22757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a68043cda00/0x2aac941e5f4a90f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a90f0 expref: 12 pid: 22766 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541391.848644:0:22757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a68043cda00/0x2aac941e5f4a90f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a90f0 expref: 12 pid: 22766 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541391.848663:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68043cda00/0x2aac941e5f4a90f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a90f0 expref: 12 pid: 22766 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541391.848677:0:22757:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a68043cd000/0x2aac941e5f4a9128 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541391.848685:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68043cd000/0x2aac941e5f4a9128 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788541391.848700:0:22757:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007300579s 00010000:00010000:3.0:1788541391.848705:0:22757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a68043cd000/0x2aac941e5f4a9128 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541391.848713:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a68043cd000/0x2aac941e5f4a9128 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541391.848719:0:22757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a68043cd000/0x2aac941e5f4a9128 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541391.848727:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a68043cd000/0x2aac941e5f4a9128 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541391.848733:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68043cd000 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541391.848737:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a68043cd000/0x2aac941e5f4a9128 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541391.848745:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a68043cd000/0x2aac941e5f4a9128 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541391.848777:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a68043cd000/0x2aac941e5f4a9128 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541391.848789:0:22757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541391.848856:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee13e9d8-48fa-4214-b460-99ccd69f1274+11:3641:x1875420981204096:12345-0@lo:103:ldlm_bl.0 Request processed in 264us (3404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541391.848864:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788541391.849749:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee13e9d8-48fa-4214-b460-99ccd69f1274:3641:1875420981204096:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788541391.850856:0:22787:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a68043cd000/0x2aac941e5f4a9128 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541391.850888:0:22787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a68043cd000/0x2aac941e5f4a9128 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541391.850904:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68043cd000/0x2aac941e5f4a9128 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788541391.860076:0:22751:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:3.0:1788541391.860368:0:22751:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788541391.860677:0:22810:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:2.0:1788541391.860681:0:22810:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:2.0:1788541391.860783:0:22811:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1788541391.861170:0:22811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1788541391.861742:0:22751:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1788541391.864255:0:22811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788541391.864673:0:22811:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:0.0:1788541391.868958:0:22812:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9a67088a1c00 x1875420981204224/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541391.868975:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068596c0 going to sleep for 0 seconds 00000040:01000000:2.0:1788541391.873357:0:22751:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788541391.873394:0:22751:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788541391.876794:0:22751:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788541391.876814:0:22751:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788541391.876937:0:22751:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788541391.884618:0:22751:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788541391.889000:0:22751:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788541391.889093:0:22751:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788541391.889893:0:22751:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:3.0:1788541391.892242:0:22751:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:2.0:1788541391.897245:0:22751:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1788541391.900543:0:22751:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788541391.900596:0:22751:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb5cdc19d7988 00100000:10000000:2.0:1788541391.900606:0:22751:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788541391.901920:0:22751:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788541391.901938:0:22751:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.156@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788541391.901970:0:22751:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788541391.901996:0:22751:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788541391.902788:0:22751:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788541391.903050:0:22751:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788541392.523080:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541392.908768:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068596c0 going to sleep for 0 seconds 00000040:00080000:3.0:1788541392.909204:0:22807:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788541392.909209:0:22807:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788541392.910498:0:22807:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788541392.910508:0:22807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788541393.549415:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788541393.551605:0:22768:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788541393.551611:0:22768:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a682e797000 from 11 10000000:01000000:3.0:1788541393.551617:0:22768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788541393.551663:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68043cda00/0x2aac941e5f4a912f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541393.551675:0:22768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a68043cda00/0x2aac941e5f4a912f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541393.551686:0:22768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a68043cda00/0x2aac941e5f4a912f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541393.551709:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981204352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788541393.552015:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541393.552137:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6835665a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788541393.552172:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981204352 00000100:00100000:2.0:1788541393.552180:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981204352 00000100:00100000:2.0:1788541393.552261:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788541393.552271:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804595050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+11:22768:x1875420981204352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788541393.552284:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541393.552299:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6842049600/0x2aac941e5f4a9136 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a912f expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541393.552321:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6842049600/0x2aac941e5f4a9136 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a912f expref: 12 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541393.552330:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6842049600/0x2aac941e5f4a9136 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a912f expref: 12 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541393.552340:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842049600, rc 0) 00000100:00100000:2.0:1788541393.552389:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804595050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+12:22768:x1875420981204352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541393.552405:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788541393.552472:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981204352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788541393.552487:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a68043cda00/0x2aac941e5f4a912f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9136 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541393.552496:0:22768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a68043cda00/0x2aac941e5f4a912f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a9136 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541393.552545:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981204480:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788541393.552572:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541393.552657:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6835665a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788541393.552741:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981204480 00000100:00100000:0.0:1788541393.552746:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981204480 00000100:00100000:0.0:1788541393.552769:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788541393.552776:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804596c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+12:22768:x1875420981204480:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788541393.552801:0:22766:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788541393.552817:0:22766:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788541393.552821:0:22766:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1788541393.552936:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804596c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+12:22768:x1875420981204480:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 160us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541393.552943:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788541393.553027:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981204480:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788541393.553078:0:22768:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788541393.553085:0:22768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68043cda00/0x2aac941e5f4a912f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9136 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541393.553093:0:22768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a68043cda00/0x2aac941e5f4a912f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9136 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788541393.932491:0:22807:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788541393.932502:0:22807:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788541393.932654:0:22807:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:3.0:1788541393.932698:0:22807:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1788541393.932904:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068596c0 going to sleep for 0 seconds 00000040:00080000:3.0:1788541393.933273:0:22807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:1.0:1788541394.586223:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541394.960066:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068596c0 going to sleep for 0 seconds 00010000:00010000:2.0:1788541395.594055:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541395.980106:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068596c0 going to sleep for 0 seconds 00010000:00010000:1.0:1788541396.619067:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788541396.956550:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788541396.956559:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788541396.956563:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a6802b4d000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788541396.956574:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 672 00000100:00080000:1.0:1788541396.956580:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788541396.956589:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a6802b4d000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:1.0:1788541396.956614:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6708836a00 x1875420981204736/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788541396.956627:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788541396.956631:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788541396.956634:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788541396.956637:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788541396.956640:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788541396.956643:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788541396.956644:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a680a571000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788541396.956649:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a680a571000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:1.0:1788541396.956659:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6708834000 x1875420981204864/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788541396.956716:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee13e9d8-48fa-4214-b460-99ccd69f1274:3642:1875420981204608:0@lo:400:kworker.0 00000100:00100000:1.0:1788541396.956794:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541396.956888:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981204608 00000100:00100000:1.0:1788541396.956896:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981204608 00000100:00100000:1.0:1788541396.956951:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788541396.956961:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804595c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+12:3642:x1875420981204608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541396.957009:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804595c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+12:3642:x1875420981204608:12345-0@lo:400:kworker.0 Request processed in 50us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541396.957017:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788541396.957079:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee13e9d8-48fa-4214-b460-99ccd69f1274:3642:1875420981204608:0@lo:400:kworker.0 00000100:00100000:2.0:1788541396.957341:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981204736:0@lo:38:kworker.0 00000100:00100000:2.0:1788541396.957379:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541396.957415:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875420981204864:0@lo:38:kworker.0 00000100:00100000:2.0:1788541396.957439:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541396.957621:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981204736 00000100:00100000:1.0:1788541396.957626:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981204736 00000100:00100000:1.0:1788541396.957649:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788541396.957656:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875420981204736:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788541396.957675:0:22777:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788541396.957715:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875420981204736:12345-0@lo:38:kworker.0 Request processed in 58us (334us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788541396.957720:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788541396.957753:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6802b4d000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788541396.957757:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788541396.957760:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981204736:0@lo:38:kworker.0 00000100:00100000:0.0:1788541396.958326:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981204864 00000100:00100000:0.0:1788541396.958333:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981204864 00000100:00100000:0.0:1788541396.958364:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788541396.958371:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875420981204864:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788541396.958601:0:22773:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 677 last 0 00000020:00000080:0.0:1788541396.958642:0:22773:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2aac941e5f4a913d 00000004:00100000:0.0:1788541396.958658:0:22773:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788541396.958789:0:22773:0:(import.c:65:import_set_state_nolock()) ffff9a682e97c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788541396.958860:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875420981204864:12345-0@lo:38:kworker.0 Request processed in 488us (1419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541396.958889:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788541396.959641:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a6708834000 x1875420981204864/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788541406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788541396.959659:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788541396.959676:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788541396.959681:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788541396.959683:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a680a571000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788541396.959690:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875420981204864:0@lo:38:kworker.0 00000001:02000400:1.0:1788541396.984360:0:23055:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg256-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788541397.010156:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068596c0 going to sleep for 0 seconds 00010000:00010000:1.0:1788541397.649271:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788541398.020231:0:23108:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788541398.020611:0:23108:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788541398.025955:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068596c0 going to sleep for 0 seconds 00010000:00010000:2.0:1788541398.666301:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788541398.925638:0:23158:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788541398.926284:0:23158:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788541399.049932:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068596c0 going to sleep for 0 seconds 00010000:00010000:1.0:1788541399.690951:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541400.076472:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068596c0 going to sleep for 0 seconds 00010000:00010000:2.0:1788541400.714120:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541401.037220:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788541391/real 1788541391] req@ffff9a6708836d80 x1875420981201792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541401 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541401.037252:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a6708836d80 x1875420981201792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541401 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541401.037262:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788541391/real 1788541391] req@ffff9a6708835c00 x1875420981201664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541401 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541401.037273:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a6708835c00 x1875420981201664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541401 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788541401.037290:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a68398d5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788541401.037312:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788541401.037317:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981201792:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788541401.037323:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a682fdc6800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788541401.037328:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788541401.037331:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981201664:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788541401.037433:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788541401.037437:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788541401.037440:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a6802b4d000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788541401.037445:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 677 00000100:00080000:3.0:1788541401.037451:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788541401.037458:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a6802b4d000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1788541401.037478:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a67078ec000 x1875420981205120/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788541401.037492:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541401.037495:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788541401.037496:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a682fdc6800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788541401.037499:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 672 00000100:00080000:3.0:1788541401.037502:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788541401.037505:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a682fdc6800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1788541401.037515:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a67078efb80 x1875420981205248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788541401.037534:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541401.037536:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788541401.037538:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a68398d5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788541401.037541:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 672 00000100:00080000:3.0:1788541401.037544:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788541401.037547:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a68398d5000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1788541401.037557:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a67078ef800 x1875420981205376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788541401.037587:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981205120:0@lo:38:kworker.0 00000100:00100000:3.0:1788541401.037656:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541401.037700:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981205248:0@lo:8:kworker.0 00000400:00000100:3.0:1788541401.037734:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875420981205248 offset 0 length 520: 4 00000100:00100000:3.0:1788541401.037753:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981205376:0@lo:8:kworker.0 00000400:00000100:3.0:1788541401.037771:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875420981205376 offset 0 length 520: 4 00000100:00100000:3.0:1788541401.037803:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981205120 00000100:00100000:3.0:1788541401.037811:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981205120 00000100:00100000:3.0:1788541401.037843:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788541401.037850:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875420981205120:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788541401.037933:0:22777:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788541401.037974:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875420981205120:12345-0@lo:38:kworker.0 Request processed in 122us (318us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788541401.037982:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788541401.038017:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6802b4d000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788541401.038021:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788541401.038024:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981205120:0@lo:38:kworker.0 00000100:00100000:1.0:1788541401.038222:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420981205504:0@lo:400:kworker.0 00000100:00100000:1.0:1788541401.038253:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541401.038281:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788541401.038288:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee13e9d8-48fa-4214-b460-99ccd69f1274:3644:1875420981204992:0@lo:400:kworker.0 00000100:00100000:1.0:1788541401.038312:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541401.038339:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981204992 00000100:00100000:1.0:1788541401.038343:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981204992 00000100:00100000:1.0:1788541401.038374:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788541401.038381:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+12:3644:x1875420981204992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541401.038418:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+12:3644:x1875420981204992:12345-0@lo:400:kworker.0 Request processed in 38us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541401.038424:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788541401.038460:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee13e9d8-48fa-4214-b460-99ccd69f1274:3644:1875420981204992:0@lo:400:kworker.0 00000100:00100000:3.0:1788541401.038867:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981205504 00000100:00100000:3.0:1788541401.038906:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981205504 00000100:00100000:3.0:1788541401.038937:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788541401.038944:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420981205504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541401.038986:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420981205504:12345-0@lo:400:kworker.0 Request processed in 43us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541401.038992:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788541401.039021:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a67078eed80 x1875420981205504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541401.039047:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420981205504:0@lo:400:kworker.0 00000100:00100000:1.0:1788541401.100885:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068596c0 going to sleep for 0 seconds 00010000:00010000:2.0:1788541401.739297:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541402.128979:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068596c0 going to sleep for 0 seconds 00010000:00010000:2.0:1788541402.762074:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541403.146281:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068596c0 going to sleep for 0 seconds 00000040:00080000:0.0:1788541403.157355:0:22807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788541403.786199:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541404.170221:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068596c0 going to sleep for 0 seconds 00010000:00010000:1.0:1788541404.816192:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541405.194949:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068596c0 going to sleep for 0 seconds 00000020:01000004:0.0:1788541405.264251:0:23503:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788541405.264254:0:23503:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788541405.264255:0:23503:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788541405.264333:0:23503:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a683533d000 00000020:01000004:0.0:1788541405.264346:0:23503:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1788541405.264356:0:23503:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788541405.264367:0:23503:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9a6831d44d40) 00000020:00000080:0.0:1788541405.264378:0:23503:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788541405.304023:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788541405.304316:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1788541405.305579:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1788541405.305990:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1788541405.306173:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788541405.306413:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788541405.306658:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788541405.306915:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788541405.307103:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788541405.307347:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788541405.307538:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1788541405.307848:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788541405.308297:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788541405.308553:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1788541405.309047:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1788541405.309234:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788541405.309425:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1788541405.310444:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1788541405.310787:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788541405.311067:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788541405.311320:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788541405.311593:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788541405.311838:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788541405.312169:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1788541405.312362:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1788541405.312631:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788541405.312899:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1788541405.313142:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788541405.313334:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1788541405.313573:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1788541405.313818:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1788541405.314146:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1788541405.314326:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788541405.314526:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788541405.314794:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1788541405.315010:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1788541405.315212:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1788541405.315403:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788541405.315659:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788541405.316017:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788541405.316216:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788541405.316461:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1788541405.316759:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788541405.316977:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788541405.317175:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788541405.317395:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00080000:01000000:1.0:1788541405.320290:0:23503:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788541405.320554:0:23503:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1788541405.320566:0:23503:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788541405.320579:0:23503:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2aac941e5f4a914b 00000020:01000004:1.0:1788541405.320586:0:23503:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788541405.320608:0:23503:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.156@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788541405.320611:0:23503:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.156@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788541405.320618:0:23503:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1788541405.320648:0:23503:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1788541405.320653:0:23503:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.156@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788541405.324821:0:23503:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.156@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788541405.325013:0:23503:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.156@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1788541405.325019:0:23503:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788541405.325021:0:23503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788541405.325022:0:23503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788541405.325024:0:23503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788541405.325025:0:23503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788541405.325026:0:23503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788541405.325027:0:23503:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788541405.325029:0:23503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788541405.325031:0:23503:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788541405.325034:0:23503:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1788541405.325037:0:23503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788541405.325038:0:23503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788541405.325039:0:23503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788541405.325040:0:23503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788541405.325041:0:23503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788541405.325042:0:23503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788541405.325043:0:23503:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788541405.325044:0:23503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788541405.325045:0:23503:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788541405.325072:0:23503:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788541405.325094:0:23503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e710380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981205632:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788541405.325172:0:23503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541405.325260:0:23503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6835665300 going to sleep for 11 seconds 00000100:00100000:1.0:1788541405.325300:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981205632 00000100:00100000:1.0:1788541405.325309:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981205632 00000100:00100000:1.0:1788541405.325396:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788541405.325407:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+12:23503:x1875420981205632:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788541405.325451:0:22764:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788541405.325454:0:22764:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1788541405.325462:0:22764:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788541405.325786:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+12:23503:x1875420981205632:12345-0@lo:253:mount.lustre.0 Request processed in 381us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541405.325793:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788541405.325868:0:23503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e710380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981205632:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788541405.325950:0:23503:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788541405.325952:0:23503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788541405.325954:0:23503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788541405.325955:0:23503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788541405.325963:0:23503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788541405.325964:0:23503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788541405.325965:0:23503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788541405.325966:0:23503:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788541405.325967:0:23503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788541405.325969:0:23503:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788541405.325987:0:23503:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a683533d000 from lustre-MDT0001 10000000:01000000:2.0:1788541405.326011:0:23503:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1788541405.326013:0:23503:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788541405.326019:0:23503:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a670695b380 local copy 00010000:00010000:2.0:1788541405.326027:0:23503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842173c00/0x2aac941e5f4a9041 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9048 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541405.326094:0:23503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e710380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981205760:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788541405.326118:0:23503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541405.326140:0:23503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6835665780 going to sleep for 11 seconds 00000100:00100000:1.0:1788541405.326194:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981205760 00000100:00100000:1.0:1788541405.326204:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981205760 00000100:00100000:1.0:1788541405.326236:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788541405.326243:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+12:23503:x1875420981205760:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541405.326303:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+12:23503:x1875420981205760:12345-0@lo:501:mount.lustre.0 Request processed in 61us (184us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788541405.326309:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788541405.326409:0:23503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e710380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981205760:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788541405.326424:0:23503:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.156@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788541405.326442:0:23503:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.156@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788541405.326448:0:23503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842173c00/0x2aac941e5f4a9041 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9048 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.326456:0:23503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6842173c00/0x2aac941e5f4a9041 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9048 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541405.326493:0:23503:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a683533d000 10000000:01000000:3.0:1788541405.326499:0:23503:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788541405.326503:0:23503:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9a670695b380 10000000:01000000:3.0:1788541405.326506:0:23503:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788541405.326510:0:23503:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9a670695b380 from 1 10000000:01000000:3.0:1788541405.326513:0:23503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788541405.326540:0:23503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68043cc400/0x2aac941e5f4a9152 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.326548:0:23503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a68043cc400/0x2aac941e5f4a9152 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.326557:0:23503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a68043cc400/0x2aac941e5f4a9152 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541405.326570:0:23503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078eed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981205888:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788541405.326600:0:23503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541405.326631:0:23503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6804f8e780 going to sleep for 11 seconds 00000100:00100000:1.0:1788541405.326694:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981205888 00000100:00100000:1.0:1788541405.326699:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981205888 00000100:00100000:1.0:1788541405.326729:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788541405.326737:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+12:23503:x1875420981205888:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788541405.326745:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541405.326758:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6842172600/0x2aac941e5f4a9159 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a9152 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541405.326779:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6842172600/0x2aac941e5f4a9159 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a9152 expref: 13 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541405.326789:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6842172600/0x2aac941e5f4a9159 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a9152 expref: 13 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541405.326798:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842172600, rc 0) 00000100:00100000:1.0:1788541405.326835:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+13:23503:x1875420981205888:12345-0@lo:101:mount.lustre.0 Request processed in 99us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541405.326841:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788541405.326965:0:23503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078eed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981205888:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788541405.326978:0:23503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a68043cc400/0x2aac941e5f4a9152 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9159 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.326986:0:23503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a68043cc400/0x2aac941e5f4a9152 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a9159 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541405.327001:0:23503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788541405.327018:0:23503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68043cc400/0x2aac941e5f4a9152 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9159 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.327026:0:23503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a68043cc400/0x2aac941e5f4a9152 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9159 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541405.327033:0:23503:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a683533d000 10000000:01000000:3.0:1788541405.327037:0:23503:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788541405.327040:0:23503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9a683533d000 from 1 10000000:01000000:3.0:1788541405.327042:0:23503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788541405.327056:0:23503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68043cc800/0x2aac941e5f4a9160 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.327063:0:23503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a68043cc800/0x2aac941e5f4a9160 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.327070:0:23503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a68043cc800/0x2aac941e5f4a9160 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541405.327081:0:23503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078eed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981206016:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788541405.327105:0:23503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541405.327141:0:23503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6804f8e780 going to sleep for 11 seconds 00000100:00100000:2.0:1788541405.327188:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981206016 00000100:00100000:2.0:1788541405.327193:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981206016 00000100:00100000:2.0:1788541405.327226:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788541405.327233:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+13:23503:x1875420981206016:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788541405.327241:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541405.327250:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6842049e00/0x2aac941e5f4a9167 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a9160 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541405.327265:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6842049e00/0x2aac941e5f4a9167 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a9160 expref: 14 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541405.327274:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6842049e00/0x2aac941e5f4a9167 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a9160 expref: 14 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541405.327280:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842049e00, rc 0) 00000100:00100000:2.0:1788541405.327308:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+14:23503:x1875420981206016:12345-0@lo:101:mount.lustre.0 Request processed in 75us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541405.327320:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788541405.327417:0:23503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078eed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981206016:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788541405.327428:0:23503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a68043cc800/0x2aac941e5f4a9160 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9167 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.327435:0:23503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a68043cc800/0x2aac941e5f4a9160 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a9167 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541405.327445:0:23503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788541405.327460:0:23503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68043cc800/0x2aac941e5f4a9160 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9167 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.327467:0:23503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a68043cc800/0x2aac941e5f4a9160 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9167 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541405.327473:0:23503:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788541405.327477:0:23503:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788541405.327481:0:23503:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a683533d000 10000000:01000000:3.0:1788541405.327484:0:23503:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788541405.327487:0:23503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788541405.327489:0:23503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788541405.327501:0:23503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68043cde00/0x2aac941e5f4a916e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.327508:0:23503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a68043cde00/0x2aac941e5f4a916e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.327515:0:23503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a68043cde00/0x2aac941e5f4a916e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541405.327537:0:23503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078eed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981206144:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788541405.327561:0:23503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541405.327580:0:23503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6804f8e780 going to sleep for 11 seconds 00000100:00100000:2.0:1788541405.327622:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981206144 00000100:00100000:2.0:1788541405.327627:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981206144 00000100:00100000:2.0:1788541405.327656:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788541405.327663:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+14:23503:x1875420981206144:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788541405.327670:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541405.327678:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6842048e00/0x2aac941e5f4a9175 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a916e expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541405.327691:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6842048e00/0x2aac941e5f4a9175 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a916e expref: 15 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541405.327699:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6842048e00/0x2aac941e5f4a9175 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a916e expref: 15 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541405.327705:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842048e00, rc 0) 00000100:00100000:2.0:1788541405.327731:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+15:23503:x1875420981206144:12345-0@lo:101:mount.lustre.0 Request processed in 69us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541405.327737:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788541405.327830:0:23503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078eed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981206144:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788541405.327841:0:23503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a68043cde00/0x2aac941e5f4a916e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9175 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.327848:0:23503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a68043cde00/0x2aac941e5f4a916e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a9175 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788541405.333509:0:23503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:3.0:1788541405.334741:0:23503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788541405.344134:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788541405.344197:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:3.0:1788541405.344211:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:3.0:1788541405.344222:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:3.0:1788541405.344246:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:3.0:1788541405.344261:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:3.0:1788541405.344275:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:3.0:1788541405.344286:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:3.0:1788541405.344296:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:3.0:1788541405.344307:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:3.0:1788541405.344319:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:3.0:1788541405.344333:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:3.0:1788541405.344346:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:3.0:1788541405.344357:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:3.0:1788541405.344368:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:3.0:1788541405.344378:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:3.0:1788541405.344390:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:3.0:1788541405.344413:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:3.0:1788541405.344425:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:3.0:1788541405.344436:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:3.0:1788541405.344448:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:3.0:1788541405.344460:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:3.0:1788541405.344474:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:3.0:1788541405.344645:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:3.0:1788541405.344662:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:3.0:1788541405.344676:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:3.0:1788541405.345215:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:3.0:1788541405.345228:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:3.0:1788541405.345424:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:3.0:1788541405.345442:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:3.0:1788541405.345455:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:3.0:1788541405.345466:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:3.0:1788541405.345477:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:3.0:1788541405.345499:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:3.0:1788541405.345510:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:3.0:1788541405.345521:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:3.0:1788541405.345531:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:3.0:1788541405.345541:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:3.0:1788541405.345552:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:3.0:1788541405.345562:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:3.0:1788541405.345573:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:3.0:1788541405.345584:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:3.0:1788541405.345595:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:3.0:1788541405.345605:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:3.0:1788541405.345631:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:3.0:1788541405.345636:0:23503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:3.0:1788541405.345750:0:23503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078eed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981206272:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788541405.345812:0:23503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541405.345866:0:23503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6804f8ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1788541405.346010:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981206272 00000100:00100000:1.0:1788541405.346017:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981206272 00000100:00100000:1.0:1788541405.346072:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788541405.346082:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+15:23503:x1875420981206272:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541405.346257:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+15:23503:x1875420981206272:12345-0@lo:501:mount.lustre.0 Request processed in 176us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541405.346266:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788541405.346608:0:23503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078eed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981206272:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788541405.346646:0:23503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078eed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981206400:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788541405.346698:0:23503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541405.346728:0:23503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6804f8ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788541405.346775:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981206400 00000100:00100000:2.0:1788541405.346780:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981206400 00000100:00100000:2.0:1788541405.346816:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788541405.346824:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+15:23503:x1875420981206400:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788541405.348501:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+15:23503:x1875420981206400:12345-0@lo:503:mount.lustre.0 Request processed in 1670us (1793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541405.348513:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788541405.348657:0:23503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078eed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981206400:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788541405.349158:0:23503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788541405.349238:0:23503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078eed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981206528:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788541405.349288:0:23503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541405.349330:0:23503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6804f8ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788541405.349494:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981206528 00000100:00100000:2.0:1788541405.349507:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981206528 00000100:00100000:2.0:1788541405.349550:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788541405.349559:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+15:23503:x1875420981206528:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788541405.356782:0:23503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078eed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981206528:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788541405.357075:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788541405.357107:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:3.0:1788541405.357121:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:3.0:1788541405.357136:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:3.0:1788541405.357151:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:3.0:1788541405.357165:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:3.0:1788541405.357177:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:3.0:1788541405.357205:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:3.0:1788541405.357225:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:3.0:1788541405.357239:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:3.0:1788541405.357252:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:3.0:1788541405.357266:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:3.0:1788541405.357279:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:3.0:1788541405.357292:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:3.0:1788541405.357306:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:3.0:1788541405.357320:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:3.0:1788541405.357333:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:3.0:1788541405.357346:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:3.0:1788541405.357370:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:3.0:1788541405.357383:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:3.0:1788541405.357395:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:3.0:1788541405.357409:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:3.0:1788541405.357423:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:3.0:1788541405.357437:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:3.0:1788541405.357449:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:3.0:1788541405.357461:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:3.0:1788541405.357474:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:3.0:1788541405.357486:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:3.0:1788541405.357498:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:3.0:1788541405.357511:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:3.0:1788541405.357525:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:3.0:1788541405.357538:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:3.0:1788541405.357550:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:3.0:1788541405.357564:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:3.0:1788541405.357578:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:3.0:1788541405.357592:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:3.0:1788541405.357605:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:3.0:1788541405.357618:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:3.0:1788541405.357630:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:3.0:1788541405.357641:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:3.0:1788541405.357654:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:3.0:1788541405.357667:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:3.0:1788541405.357800:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:3.0:1788541405.357821:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:3.0:1788541405.357928:0:23503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078eed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981206656:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788541405.357986:0:23503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541405.358062:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+15:23503:x1875420981206528:12345-0@lo:502:mount.lustre.0 Request processed in 7110us (7379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541405.358076:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788541405.358132:0:23503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6804f8ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788541405.358647:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981206656 00000100:00100000:2.0:1788541405.358653:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981206656 00000100:00100000:2.0:1788541405.358705:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788541405.358713:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+15:23503:x1875420981206656:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788541405.358830:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+15:23503:x1875420981206656:12345-0@lo:502:mount.lustre.0 Request processed in 118us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541405.358837:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788541405.359055:0:23503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078eed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981206656:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788541405.359124:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:0.0:1788541405.359136:0:23503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1788541405.360146:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788541405.360157:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541405.360159:0:23507:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788541405.360172:0:23507:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788541405.360175:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788541405.360191:0:23507:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9a68353119c0) 00000020:00000080:3.0:1788541405.360213:0:23507:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1788541405.360220:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788541405.360306:0:23507:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788541405.360314:0:23507:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2aac941e5f4a9183 00000020:00000080:3.0:1788541405.360619:0:23507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788541405.360624:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788541405.360628:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541405.360629:0:23507:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788541405.360632:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788541405.360636:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541405.360638:0:23507:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788541405.360641:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788541405.360650:0:23507:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9a6835310000) 00000020:00000080:3.0:1788541405.360661:0:23507:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1788541405.360666:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788541405.360668:0:23507:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788541405.360671:0:23507:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788541405.360690:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788541405.360752:0:23507:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a683533d000 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788541405.360768:0:23507:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9a6835314d40) 00000020:00000080:3.0:1788541405.360777:0:23507:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1788541405.360829:0:23507:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788541405.360836:0:23507:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2aac941e5f4a9198 00000020:00000080:3.0:1788541405.361069:0:23507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788541405.361076:0:23507:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788541405.361081:0:23507:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x2aac941e5f4a919f 00080000:01000000:3.0:1788541405.361086:0:23507:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788541405.361089:0:23507:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2aac941e5f4a91a6 00010000:00010000:3.0:1788541405.416615:0:23507:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1788541405.417225:0:23507:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:3.0:1788541405.417503:0:23507:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788541405.420335:0:23507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788541405.420347:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788541405.420354:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541405.420357:0:23507:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788541405.420361:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788541405.420366:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541405.420368:0:23507:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788541405.420372:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788541405.420377:0:23507:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.156@tcp to nid 0x20000c0a8ca9c (192.168.202.156@tcp) 00000020:00000080:1.0:1788541405.420405:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788541405.420420:0:23507:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9a680599b380) 00000020:00000080:1.0:1788541405.420443:0:23507:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1788541405.420449:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788541405.420530:0:23507:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788541405.420537:0:23507:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788541405.420544:0:23507:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2aac941e5f4a91b4 00010000:00080000:1.0:1788541405.420576:0:23507:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a680a574800@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.156@tcp at head 00010000:00010000:1.0:1788541405.422723:0:23507:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1788541405.423251:0:23507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788541405.423264:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788541405.423297:0:23507:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788541405.423316:0:23507:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2aac941e5f4a91bb 00000100:00080000:1.0:1788541405.423326:0:23507:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788541405.423332:0:23507:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9a680a574800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:1.0:1788541405.423368:0:23507:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6708836a00 x1875420981206784/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788541405.426832:0:23507:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1788541405.427021:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788541405.427028:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541405.427030:0:23507:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1788541405.427033:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788541405.427036:0:23507:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788541405.427038:0:23507:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788541405.427039:0:23507:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788541405.427041:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788541405.427043:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541405.427044:0:23507:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788541405.427047:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788541405.427052:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541405.427053:0:23507:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1788541405.427057:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788541405.427108:0:23507:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788541405.427122:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788541405.427125:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541405.427127:0:23507:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1788541405.427129:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788541405.427131:0:23507:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1788541405.427132:0:23507:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788541405.427134:0:23507:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788541405.427136:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788541405.427138:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541405.427140:0:23507:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788541405.427142:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788541405.427146:0:23507:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788541405.427149:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541405.427150:0:23507:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788541405.427154:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788541405.427158:0:23507:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.156@tcp to nid 0x20000c0a8ca9c (192.168.202.156@tcp) 00000020:01000000:1.0:1788541405.427188:0:23507:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788541405.427192:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788541405.427207:0:23507:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9a6805998000) 00000020:00000080:1.0:1788541405.427224:0:23507:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788541405.427229:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788541405.427292:0:23507:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1788541405.427299:0:23507:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788541405.427307:0:23507:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2aac941e5f4a91c9 00010000:00080000:1.0:1788541405.427338:0:23507:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a67082f2000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.156@tcp at head 00010000:00010000:1.0:1788541405.427632:0:23507:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:3.0:1788541405.428336:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981206784:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788541405.428402:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541405.428469:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981206784 00000100:00100000:3.0:1788541405.428487:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981206784 00000100:00100000:3.0:1788541405.428518:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788541405.428525:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875420981206784:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788541405.428551:0:22777:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 686 last 0 00000020:00000080:3.0:1788541405.428584:0:22777:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2aac941e5f4a91d0 00000004:00100000:3.0:1788541405.428600:0:22777:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788541405.428606:0:22777:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000040:01000000:1.0:1788541405.429243:0:23507:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788541405.430604:0:23507:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1788541405.432224:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788541405.432232:0:18310:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788541405.432236:0:18310:0:(import.c:65:import_set_state_nolock()) ffff9a6802b4d000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788541405.432245:0:18310:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 681 00000100:00080000:2.0:1788541405.432251:0:18310:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788541405.432257:0:18310:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a6802b4d000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:2.0:1788541405.432292:0:18310:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a682e710e00 x1875420981206912/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788541405.432329:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788541405.432333:0:18310:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788541405.432336:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788541405.432339:0:18310:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788541405.432439:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981206912:0@lo:38:kworker.0 00000100:00100000:1.0:1788541405.432508:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541405.432561:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981207040:0@lo:400:kworker.0 00000100:00100000:1.0:1788541405.432591:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541405.432638:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981207040 00000100:00100000:1.0:1788541405.432646:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981207040 00000100:00100000:1.0:1788541405.432719:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788541405.432728:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981207040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541405.432780:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981207040:12345-0@lo:400:kworker.0 Request processed in 54us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541405.432787:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788541405.432823:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a682e710380 x1875420981207040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541405.432835:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981207040:0@lo:400:kworker.0 00000100:00100000:2.0:1788541405.433076:0:22776:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788541405.433085:0:22776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1788541405.433355:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981206912 00000100:00100000:2.0:1788541405.433360:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981206912 00000100:00100000:1.0:1788541405.433498:0:23512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788541405.433509:0:23512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875420981206912:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788541405.433574:0:23512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875420981206912:12345-0@lo:38:kworker.0 Request processed in 64us (1065us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788541405.433581:0:23512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788541405.433644:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788541405.433651:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6802b4d000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788541405.433655:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788541405.433659:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981206912:0@lo:38:kworker.0 00000040:00080000:0.0:1788541405.435008:0:23507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788541405.435308:0:23507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1788541405.435471:0:23507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1788541405.436312:0:23513:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788541405.436318:0:23513:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00080000:0.0:1788541405.437993:0:22777:0:(import.c:65:import_set_state_nolock()) ffff9a6835339000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788541405.438090:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1875420981206784:12345-0@lo:38:llog_process_th.0 Request processed in 9561us (9684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541405.438124:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788541405.438287:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788541405.438299:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788541405.438310:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788541405.438315:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788541405.438318:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a680a574800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788541405.438339:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981206784:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788541405.439056:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788541405.439071:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981207168:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788541405.439122:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541405.439160:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981207168 00000100:00100000:0.0:1788541405.439166:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981207168 00000100:00100000:0.0:1788541405.439200:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788541405.439208:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1875420981207168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788541405.439254:0:22776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788541405.439292:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1875420981207168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541405.439299:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788541405.439333:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981207168:0@lo:41:osp-pre-0-1.0 00000020:00000080:1.0:1788541405.442131:0:23507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788541405.442151:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788541405.442202:0:23507:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788541405.442226:0:23507:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2aac941e5f4a91d7 00000100:00080000:1.0:1788541405.442236:0:23507:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788541405.442242:0:23507:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9a67082f2000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:1.0:1788541405.442278:0:23507:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6708836a00 x1875420981207296/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788541405.442352:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981207296:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788541405.442406:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875420981207296 offset 0 length 520: 4 00000100:00080000:1.0:1788541405.442627:0:23507:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788541405.442709:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788541405.442713:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541405.442715:0:23507:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788541405.442718:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788541405.442720:0:23507:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1788541405.442722:0:23507:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788541405.442724:0:23507:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788541405.442725:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788541405.442727:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541405.442736:0:23507:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788541405.442739:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788541405.442743:0:23507:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788541405.442746:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541405.442748:0:23507:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788541405.442751:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788541405.442755:0:23507:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.156@tcp to nid 0x20000c0a8ca9c (192.168.202.156@tcp) 00000020:01000000:1.0:1788541405.442774:0:23507:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788541405.442777:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788541405.442788:0:23507:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9a680599cd40) 00000020:00000080:1.0:1788541405.442801:0:23507:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1788541405.442806:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788541405.442903:0:23507:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788541405.442911:0:23507:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788541405.442917:0:23507:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2aac941e5f4a91e5 00000100:00080000:3.0:1788541405.443017:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541405.443022:0:18310:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788541405.443025:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541405.443027:0:18310:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:1.0:1788541405.443089:0:23507:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a6837950800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.156@tcp at head 00010000:00010000:1.0:1788541405.443312:0:23507:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1788541405.443375:0:23507:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788541405.443390:0:23507:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788541405.445284:0:23507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788541405.446661:0:23507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1788541405.447198:0:23507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:0.0:1788541405.447663:0:23515:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788541405.447669:0:23515:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788541405.448444:0:23507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788541405.448463:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788541405.448576:0:23507:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788541405.448599:0:23507:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2aac941e5f4a91ec 00000100:00080000:0.0:1788541405.448609:0:23507:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788541405.448615:0:23507:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a6837950800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:0.0:1788541405.448651:0:23507:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a67088a2300 x1875420981207424/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788541405.448760:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981207424:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788541405.448815:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875420981207424 offset 0 length 520: 4 00000100:00080000:0.0:1788541405.448908:0:23507:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788541405.448974:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788541405.448978:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541405.448981:0:23507:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788541405.448984:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788541405.448988:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541405.448990:0:23507:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788541405.448993:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788541405.448995:0:23507:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788541405.448997:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788541405.448999:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541405.449001:0:23507:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788541405.449003:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788541405.449005:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541405.449006:0:23507:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788541405.449010:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788541405.449038:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788541405.449041:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541405.449042:0:23507:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788541405.449045:0:23507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:0.0:1788541405.449098:0:23503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1788541405.449132:0:23503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788541405.449145:0:23503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68043cde00/0x2aac941e5f4a916e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9175 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541405.449169:0:23503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a68043cde00/0x2aac941e5f4a916e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9175 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541405.449177:0:23503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a683533d000 from 1 10000000:01000000:0.0:1788541405.449179:0:23503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788541405.449203:0:23503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75f600/0x2aac941e5f4a91f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541405.449210:0:23503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a682e75f600/0x2aac941e5f4a91f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541405.449222:0:23503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a682e75f600/0x2aac941e5f4a91f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541405.449238:0:23503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981207552:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788541405.449274:0:23503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541405.449298:0:23503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68394b5600 going to sleep for 11 seconds 00000100:00100000:0.0:1788541405.449316:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981207552 00000100:00100000:0.0:1788541405.449322:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981207552 00000100:00100000:0.0:1788541405.449356:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788541405.449365:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+15:23503:x1875420981207552:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788541405.449377:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541405.449389:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a682e75fc00/0x2aac941e5f4a91fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a91f3 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541405.449410:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75fc00/0x2aac941e5f4a91fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a91f3 expref: 16 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541405.449430:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a682e75fc00/0x2aac941e5f4a91fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a91f3 expref: 16 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541405.449440:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75fc00, rc 0) 00000100:00100000:0.0:1788541405.449474:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+16:23503:x1875420981207552:12345-0@lo:101:mount.lustre.0 Request processed in 109us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541405.449552:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788541405.449597:0:23503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981207552:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788541405.449610:0:23503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a682e75f600/0x2aac941e5f4a91f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a91fa expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541405.449618:0:23503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a682e75f600/0x2aac941e5f4a91f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a91fa expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541405.450158:0:23503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981207680:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788541405.450196:0:23503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788541405.450259:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541405.450264:0:18310:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788541405.450267:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541405.450270:0:18310:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788541405.450785:0:23503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68394b5600 going to sleep for 11 seconds 00000100:00100000:3.0:1788541405.451270:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981207680 00000100:00100000:3.0:1788541405.451279:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981207680 00000100:00100000:3.0:1788541405.451361:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788541405.451371:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+16:23503:x1875420981207680:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788541405.451400:0:22764:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788541405.451415:0:22764:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788541405.451418:0:22764:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1788541405.451540:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+16:23503:x1875420981207680:12345-0@lo:256:mount.lustre.0 Request processed in 170us (1342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541405.451548:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788541405.451793:0:23503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981207680:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788541405.452608:0:23503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788541405.452635:0:23503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75f600/0x2aac941e5f4a91f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a91fa expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541405.452647:0:23503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a682e75f600/0x2aac941e5f4a91f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a91fa expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788541405.452666:0:23503:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a683533d000 from 1 10000000:01000000:1.0:1788541405.452669:0:23503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788541405.452771:0:23503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842172a00/0x2aac941e5f4a9201 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541405.452781:0:23503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a6842172a00/0x2aac941e5f4a9201 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541405.452790:0:23503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a6842172a00/0x2aac941e5f4a9201 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541405.452812:0:23503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708835180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981207808:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788541405.452984:0:23503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541405.453059:0:23503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6803c470c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788541405.453177:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981207808 00000100:00100000:3.0:1788541405.453183:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981207808 00000100:00100000:3.0:1788541405.453254:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788541405.453262:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+16:23503:x1875420981207808:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788541405.453274:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541405.453287:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68043cc600/0x2aac941e5f4a9208 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a9201 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.453310:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68043cc600/0x2aac941e5f4a9208 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a9201 expref: 17 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.453320:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68043cc600/0x2aac941e5f4a9208 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a9201 expref: 17 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.453327:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68043cc600, rc 0) 00000100:00100000:3.0:1788541405.453372:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+17:23503:x1875420981207808:12345-0@lo:101:mount.lustre.0 Request processed in 111us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541405.453379:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788541405.453456:0:23503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708835180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981207808:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788541405.453470:0:23503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a6842172a00/0x2aac941e5f4a9201 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9208 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541405.453489:0:23503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a6842172a00/0x2aac941e5f4a9201 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a9208 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788541405.455110:0:23503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:0.0:1788541405.455377:0:23503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788541405.455660:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788541405.455699:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:0.0:1788541405.455718:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:0.0:1788541405.455734:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:0.0:1788541405.455748:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:0.0:1788541405.455763:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:0.0:1788541405.455777:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:0.0:1788541405.455792:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:0.0:1788541405.455808:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788541405.455836:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:0.0:1788541405.455851:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:0.0:1788541405.456049:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:0.0:1788541405.456056:0:23503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:0.0:1788541405.456139:0:23503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981207936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788541405.456200:0:23503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541405.456295:0:23503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68394b50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788541405.456394:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981207936 00000100:00100000:1.0:1788541405.456400:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981207936 00000100:00100000:1.0:1788541405.456445:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788541405.456455:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+17:23503:x1875420981207936:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541405.456562:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+17:23503:x1875420981207936:12345-0@lo:501:mount.lustre.0 Request processed in 108us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541405.456578:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788541405.456623:0:23503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981207936:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541405.456655:0:23503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708835180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981208064:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788541405.456704:0:23503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541405.456718:0:23503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6803281480 going to sleep for 11 seconds 00000100:00100000:1.0:1788541405.456730:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981208064 00000100:00100000:1.0:1788541405.456734:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981208064 00000100:00100000:1.0:1788541405.456751:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788541405.456757:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+17:23503:x1875420981208064:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788541405.456821:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+17:23503:x1875420981208064:12345-0@lo:503:mount.lustre.0 Request processed in 64us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541405.456828:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788541405.456900:0:23503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708835180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981208064:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788541405.457230:0:23503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788541405.457297:0:23503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708835180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981208192:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788541405.457329:0:23503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541405.457345:0:23503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6803281480 going to sleep for 11 seconds 00000100:00100000:1.0:1788541405.457359:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981208192 00000100:00100000:1.0:1788541405.457362:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981208192 00000100:00100000:1.0:1788541405.457380:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788541405.457386:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+17:23503:x1875420981208192:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788541405.457457:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+17:23503:x1875420981208192:12345-0@lo:502:mount.lustre.0 Request processed in 71us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541405.457463:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788541405.457505:0:23503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708835180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981208192:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788541405.457647:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788541405.457671:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:1.0:1788541405.457683:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:1.0:1788541405.457696:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:1.0:1788541405.457710:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:1.0:1788541405.457723:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:1.0:1788541405.457737:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:1.0:1788541405.457750:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:1.0:1788541405.457763:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1788541405.457776:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:1.0:1788541405.457787:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:1.0:1788541405.457804:0:23503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708835180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981208320:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788541405.457837:0:23503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541405.457852:0:23503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6803281480 going to sleep for 11 seconds 00000100:00100000:1.0:1788541405.457900:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981208320 00000100:00100000:1.0:1788541405.457905:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981208320 00000100:00100000:1.0:1788541405.457923:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788541405.457928:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706b73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+17:23503:x1875420981208320:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788541405.457999:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706b73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+17:23503:x1875420981208320:12345-0@lo:502:mount.lustre.0 Request processed in 70us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541405.458005:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788541405.458039:0:23503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708835180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981208320:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788541405.458071:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:1.0:1788541405.458079:0:23503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788541405.459064:0:23517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788541405.459075:0:23517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541405.459078:0:23517:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788541405.459084:0:23517:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a683533d000 00000020:00000080:0.0:1788541405.459087:0:23517:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788541405.459094:0:23517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788541405.459096:0:23517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541405.459097:0:23517:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788541405.459100:0:23517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788541405.459102:0:23517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541405.459103:0:23517:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788541405.459106:0:23517:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a683533d000 00000020:00000080:0.0:1788541405.459108:0:23517:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788541405.459165:0:23517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788541405.461405:0:23517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541405.461411:0:23517:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788541405.461420:0:23517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788541405.461426:0:23517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541405.461427:0:23517:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788541405.461432:0:23517:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a683533d000 00000020:00000080:0.0:1788541405.461434:0:23517:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788541405.462039:0:23517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788541405.462045:0:23517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541405.462047:0:23517:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788541405.462050:0:23517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788541405.462056:0:23517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541405.462058:0:23517:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788541405.462061:0:23517:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a683533d000 00000020:00000080:0.0:1788541405.462063:0:23517:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788541405.471554:0:23517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788541405.471568:0:23517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541405.471571:0:23517:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788541405.471575:0:23517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:0.0:1788541405.471649:0:23503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788541405.471692:0:23503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788541405.471715:0:23503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842172a00/0x2aac941e5f4a9201 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9208 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541405.471728:0:23503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6842172a00/0x2aac941e5f4a9201 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9208 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541405.471792:0:23503:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788541405.471795:0:23503:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a683533d000 10000000:01000000:0.0:1788541405.471798:0:23503:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a683533d000 10000000:01000000:0.0:1788541405.471802:0:23503:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788541405.471808:0:23503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a683533d000 from 1 10000000:01000000:0.0:1788541405.471811:0:23503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788541405.471847:0:23503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a920f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541405.471868:0:23503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a920f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541405.471908:0:23503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a920f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541405.472200:0:23503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981208448:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788541405.472281:0:23503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541405.472323:0:23503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6806368300 going to sleep for 11 seconds 00000100:00100000:1.0:1788541405.472444:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981208448 00000100:00100000:1.0:1788541405.472453:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981208448 00000100:00100000:1.0:1788541405.472555:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788541405.472572:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706b72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+17:23503:x1875420981208448:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788541405.472585:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541405.472598:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6842173a00/0x2aac941e5f4a9216 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a920f expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541405.472623:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6842173a00/0x2aac941e5f4a9216 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a920f expref: 18 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541405.472634:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6842173a00/0x2aac941e5f4a9216 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a920f expref: 18 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541405.472643:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842173a00, rc 0) 00000100:00100000:1.0:1788541405.473615:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706b72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+18:23503:x1875420981208448:12345-0@lo:101:mount.lustre.0 Request processed in 1040us (1329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541405.473623:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788541405.473817:0:23503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981208448:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788541405.473838:0:23503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a920f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9216 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541405.473849:0:23503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a920f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a9216 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788541405.476117:0:23503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:0.0:1788541405.476405:0:23503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788541405.476677:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:0.0:1788541405.476713:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:0.0:1788541405.476726:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:0.0:1788541405.476755:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:0.0:1788541405.476769:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:0.0:1788541405.476781:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:0.0:1788541405.476792:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:0.0:1788541405.476803:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:0.0:1788541405.476815:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:0.0:1788541405.476827:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:0.0:1788541405.476840:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:0.0:1788541405.476852:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:0.0:1788541405.476905:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:0.0:1788541405.478842:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:0.0:1788541405.478930:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:0.0:1788541405.478950:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:0.0:1788541405.478974:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:0.0:1788541405.478990:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:0.0:1788541405.479004:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:0.0:1788541405.479036:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:0.0:1788541405.479061:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:0.0:1788541405.479073:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:0.0:1788541405.479085:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:0.0:1788541405.479100:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:0.0:1788541405.479112:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:0.0:1788541405.479126:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:0.0:1788541405.479139:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:0.0:1788541405.479152:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:0.0:1788541405.479166:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:0.0:1788541405.479181:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:0.0:1788541405.479194:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:0.0:1788541405.479206:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:0.0:1788541405.479220:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:0.0:1788541405.479233:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:0.0:1788541405.479247:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:0.0:1788541405.479273:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:0.0:1788541405.479286:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:0.0:1788541405.479299:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:0.0:1788541405.479310:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:0.0:1788541405.479321:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:0.0:1788541405.479333:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:0.0:1788541405.479344:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:0.0:1788541405.479355:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:0.0:1788541405.479366:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:0.0:1788541405.479376:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:0.0:1788541405.479387:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:0.0:1788541405.479399:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:0.0:1788541405.479411:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:0.0:1788541405.479587:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:0.0:1788541405.479607:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:0.0:1788541405.479637:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:0.0:1788541405.479643:0:23503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:0.0:1788541405.479765:0:23503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981208576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788541405.479841:0:23503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541405.479936:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981208576 00000100:00100000:0.0:1788541405.479944:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981208576 00000100:00100000:0.0:1788541405.479987:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788541405.479995:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706b72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+18:23503:x1875420981208576:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788541405.480104:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706b72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+18:23503:x1875420981208576:12345-0@lo:501:mount.lustre.0 Request processed in 109us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541405.480112:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788541405.480152:0:23503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6835665300 going to sleep for 11 seconds 00000100:00100000:0.0:1788541405.480172:0:23503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981208576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788541405.480200:0:23503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981208704:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788541405.480235:0:23503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541405.480245:0:23503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6835665300 going to sleep for 11 seconds 00000100:00100000:1.0:1788541405.484587:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981208704 00000100:00100000:1.0:1788541405.484601:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981208704 00000100:00100000:1.0:1788541405.484691:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788541405.484701:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706b72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+18:23503:x1875420981208704:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788541405.484892:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706b72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+18:23503:x1875420981208704:12345-0@lo:503:mount.lustre.0 Request processed in 168us (4632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541405.484901:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788541405.485457:0:23503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981208704:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788541405.485914:0:23503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788541405.485994:0:23503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981208832:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788541405.486053:0:23503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541405.486087:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981208832 00000100:00100000:0.0:1788541405.486092:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981208832 00000100:00100000:0.0:1788541405.486118:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788541405.486126:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706b70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+18:23503:x1875420981208832:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788541405.486210:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706b70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+18:23503:x1875420981208832:12345-0@lo:502:mount.lustre.0 Request processed in 84us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541405.486217:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788541405.486259:0:23503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6706859d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788541405.486275:0:23503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981208832:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788541405.486423:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:0.0:1788541405.486447:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:0.0:1788541405.486459:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:0.0:1788541405.486470:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:0.0:1788541405.486483:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:0.0:1788541405.486494:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:0.0:1788541405.486505:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:0.0:1788541405.486517:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:0.0:1788541405.486528:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:0.0:1788541405.486540:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:0.0:1788541405.486552:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:0.0:1788541405.486563:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:0.0:1788541405.486575:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:0.0:1788541405.486597:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:0.0:1788541405.486610:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:0.0:1788541405.486620:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:0.0:1788541405.486631:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:0.0:1788541405.486642:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:0.0:1788541405.486653:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:0.0:1788541405.486664:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:0.0:1788541405.486674:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:0.0:1788541405.486684:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:0.0:1788541405.486695:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:0.0:1788541405.486707:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:0.0:1788541405.486719:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:0.0:1788541405.486731:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:0.0:1788541405.486743:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:0.0:1788541405.486754:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:0.0:1788541405.486765:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:0.0:1788541405.486787:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:0.0:1788541405.486800:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:0.0:1788541405.486819:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:0.0:1788541405.486830:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:0.0:1788541405.486842:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:0.0:1788541405.486865:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:0.0:1788541405.486908:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:0.0:1788541405.486919:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:0.0:1788541405.486929:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:0.0:1788541405.486938:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:0.0:1788541405.486948:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:0.0:1788541405.486957:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:0.0:1788541405.486967:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:0.0:1788541405.487047:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:0.0:1788541405.487062:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:0.0:1788541405.487073:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:0.0:1788541405.487096:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:0.0:1788541405.487109:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:0.0:1788541405.487119:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:0.0:1788541405.487150:0:23503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981208960:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788541405.487191:0:23503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541405.487219:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981208960 00000100:00100000:0.0:1788541405.487223:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981208960 00000100:00100000:0.0:1788541405.487244:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788541405.487249:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706b73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+18:23503:x1875420981208960:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788541405.487315:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706b73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+18:23503:x1875420981208960:12345-0@lo:502:mount.lustre.0 Request processed in 65us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541405.487321:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788541405.487358:0:23503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6706859d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788541405.487372:0:23503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981208960:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788541405.487486:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:0.0:1788541405.487511:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:0.0:1788541405.487529:0:23503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981209088:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788541405.487559:0:23503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541405.487576:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981209088 00000100:00100000:0.0:1788541405.487580:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981209088 00000100:00100000:0.0:1788541405.487597:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788541405.487602:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706b71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+18:23503:x1875420981209088:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788541405.487660:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706b71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+18:23503:x1875420981209088:12345-0@lo:502:mount.lustre.0 Request processed in 57us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541405.487667:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788541405.487696:0:23503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6706859d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788541405.487708:0:23503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981209088:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788541405.487742:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:0.0:1788541405.487751:0:23503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788541405.502360:0:23522:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1788541405.502378:0:23522:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9a6835313380) 00000020:00000080:3.0:1788541405.502402:0:23522:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788541405.502478:0:23522:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a683533d000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788541405.502487:0:23522:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a683533d000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788541405.502489:0:23522:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a683533d000 3 00010000:00080000:3.0:1788541405.502521:0:23522:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a6806314800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.156@tcp at head 00010000:00010000:3.0:1788541405.513713:0:23522:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1788541405.514535:0:23522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788541405.514594:0:23522:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788541405.514605:0:23522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x2aac941e5f4a9224 00000100:00080000:3.0:1788541405.514615:0:23522:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788541405.514622:0:23522:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9a6806314800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1788541405.514658:0:23522:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a67078ef480 x1875420981209216/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788541405.514688:0:23522:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788541405.514710:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541405.514714:0:18310:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788541405.514717:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541405.514720:0:18310:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788541405.514775:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875420981209216:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788541405.514842:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541405.514927:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981209216 00000100:00100000:1.0:1788541405.514934:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981209216 00000100:00100000:1.0:1788541405.514967:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788541405.514974:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875420981209216:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788541405.515005:0:22773:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 686 last 0 00000020:00000080:1.0:1788541405.515033:0:22773:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x2aac941e5f4a922b 00000004:00100000:1.0:1788541405.515049:0:22773:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788541405.515079:0:22773:0:(import.c:65:import_set_state_nolock()) ffff9a6707bd1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788541405.515127:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875420981209216:12345-0@lo:38:llog_process_th.0 Request processed in 151us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541405.515134:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788541405.515167:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a67078ef480 x1875420981209216/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788541415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541405.515177:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788541405.515184:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788541405.515190:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788541405.515195:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788541405.515197:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6806314800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788541405.515202:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875420981209216:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788541405.516066:0:23522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:0.0:1788541405.519034:0:23503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788541405.519080:0:23503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788541405.519103:0:23503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a920f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9216 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541405.519116:0:23503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a920f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9216 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788541405.519163:0:23503:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788541405.519165:0:23503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788541405.519167:0:23503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788541405.519168:0:23503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788541405.519169:0:23503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788541405.519171:0:23503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788541405.519172:0:23503:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788541405.519174:0:23503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788541405.519179:0:23503:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788541405.519183:0:23503:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1788541405.519185:0:23503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788541405.519186:0:23503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788541405.519187:0:23503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788541405.519188:0:23503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788541405.519189:0:23503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788541405.519190:0:23503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788541405.519191:0:23503:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788541405.519192:0:23503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788541405.519193:0:23503:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788541405.519218:0:23503:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788541405.519239:0:23503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981209344:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788541405.519310:0:23503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541405.519354:0:23503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068599c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788541405.523499:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981209344 00000100:00100000:3.0:1788541405.523520:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981209344 00000100:00100000:3.0:1788541405.523599:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788541405.523610:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706b71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+18:23503:x1875420981209344:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788541405.523648:0:22766:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788541405.523663:0:22766:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1788541405.527814:0:22752:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788541405.528238:0:22766:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788541405.528278:0:22766:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788541405.528631:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706b71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+18:23503:x1875420981209344:12345-0@lo:253:mount.lustre.0 Request processed in 5018us (9315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541405.528657:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 20000000:01000000:1.0:1788541405.528768:0:22787:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788541405.528773:0:22787:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788541405.528794:0:22787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6842173200/0x2aac941e5f4a9232 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541405.528810:0:22787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6842049600/0x2aac941e5f4a9136 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a912f expref: 17 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541405.528818:0:22787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a682e75fc00/0x2aac941e5f4a91fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a91f3 expref: 17 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541405.528837:0:22787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6842173200/0x2aac941e5f4a9232 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541405.529045:0:22787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a682e75fc00/0x2aac941e5f4a91fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a91f3 expref: 17 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541405.529060:0:22787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a682e75fc00/0x2aac941e5f4a91fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a91f3 expref: 17 pid: 22766 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541405.529073:0:22787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708835500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22787:1875420981209472:0@lo:104: 00000100:00100000:1.0:1788541405.529112:0:22787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788541405.529162:0:22787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6842049600/0x2aac941e5f4a9136 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a912f expref: 17 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541405.529171:0:22787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6842049600/0x2aac941e5f4a9136 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a912f expref: 17 pid: 22764 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541405.529178:0:22787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708837b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22787:1875420981209600:0@lo:104: 00000100:00100000:1.0:1788541405.529199:0:22787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541405.529212:0:22787:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6809a93c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788541405.529260:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981209472 00000100:00100000:3.0:1788541405.529268:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981209472 00000100:00100000:3.0:1788541405.529300:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981209600 00000100:00100000:3.0:1788541405.529303:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981209600 00000100:00100000:3.0:1788541405.529319:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788541405.529327:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708837800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee13e9d8-48fa-4214-b460-99ccd69f1274+4:22787:x1875420981209472:12345-0@lo:104: 00010000:00010000:3.0:1788541405.529340:0:22755:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a682e75f600/0x2aac941e5f4a91f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a91fa expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.529397:0:22755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788541405.529403:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708837800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee13e9d8-48fa-4214-b460-99ccd69f1274+4:22787:x1875420981209472:12345-0@lo:104: Request processed in 77us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541405.529421:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788541405.529434:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788541405.529441:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708834e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee13e9d8-48fa-4214-b460-99ccd69f1274+3:22787:x1875420981209600:12345-0@lo:104: 00010000:00010000:3.0:1788541405.529449:0:22755:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a68043cda00/0x2aac941e5f4a912f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a9136 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.529482:0:22755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788541405.529487:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708834e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee13e9d8-48fa-4214-b460-99ccd69f1274+3:22787:x1875420981209600:12345-0@lo:104: Request processed in 47us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541405.529492:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788541405.529511:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788541405.529516:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a682e75f600/0x2aac941e5f4a91f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a91fa expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.529523:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75f600 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:3.0:1788541405.529535:0:22761:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75f600/0x2aac941e5f4a91f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a91fa expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.529544:0:22761:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a682e75f600/0x2aac941e5f4a91f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a91fa expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788541405.529551:0:22761:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75f600/0x2aac941e5f4a91f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a91fa expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541405.529557:0:22761:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788541405.529588:0:22761:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a682e75f600/0x2aac941e5f4a91f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a91fa expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.529594:0:22761:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788541405.529614:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a682e75f600/0x2aac941e5f4a91f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a91fa expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.529622:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a682e75f600/0x2aac941e5f4a91f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a91fa expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.529633:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541405.529636:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a68043cda00/0x2aac941e5f4a912f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a9136 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.529641:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68043cda00 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:3.0:1788541405.529644:0:22761:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a68043cda00/0x2aac941e5f4a912f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a9136 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.529650:0:22761:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a68043cda00/0x2aac941e5f4a912f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a9136 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788541405.529669:0:22761:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a68043cda00/0x2aac941e5f4a912f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a9136 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541405.529674:0:22761:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1788541405.529786:0:23503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:23503:1875420981209344:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788541405.529799:0:23503:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788541405.529803:0:23503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788541405.529804:0:23503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788541405.529805:0:23503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788541405.529806:0:23503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788541405.529808:0:23503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788541405.529809:0:23503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788541405.529810:0:23503:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788541405.529812:0:23503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788541405.529813:0:23503:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788541405.529828:0:23503:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1788541405.529897:0:22761:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a68043cda00/0x2aac941e5f4a912f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a9136 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.529902:0:22761:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788541405.529909:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a68043cda00/0x2aac941e5f4a912f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a9136 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.529915:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a68043cda00/0x2aac941e5f4a912f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a9136 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.529927:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541405.529929:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541405.529930:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541405.529937:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541405.529946:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee13e9d8-48fa-4214-b460-99ccd69f1274:3643:1875420981209728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788541405.529976:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541405.529998:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788541405.530003:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee13e9d8-48fa-4214-b460-99ccd69f1274:3643:1875420981209856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788541405.530022:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541405.530049:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981209728 00000100:00100000:3.0:1788541405.530053:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981209728 00010000:00010000:3.0:1788541405.530069:0:22757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a682e75fc00/0x2aac941e5f4a91fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a91f3 expref: 18 pid: 22766 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541405.530087:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981209856 00000100:00100000:3.0:1788541405.530095:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981209856 00010000:00010000:3.0:1788541405.530107:0:22757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6842049600/0x2aac941e5f4a9136 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a912f expref: 19 pid: 22764 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541405.530122:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788541405.530128:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee13e9d8-48fa-4214-b460-99ccd69f1274+19:3643:x1875420981209728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788541405.530137:0:22757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541405.530141:0:22757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a682e75fc00/0x2aac941e5f4a91fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a91f3 expref: 19 pid: 22766 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.530151:0:22757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a682e75fc00/0x2aac941e5f4a91fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a91f3 expref: 19 pid: 22766 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.530165:0:22757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541405.530192:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee13e9d8-48fa-4214-b460-99ccd69f1274+19:3643:x1875420981209728:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541405.530199:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788541405.530211:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788541405.530217:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee13e9d8-48fa-4214-b460-99ccd69f1274+18:3643:x1875420981209856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788541405.530225:0:22757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541405.530229:0:22757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6842049600/0x2aac941e5f4a9136 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a912f expref: 18 pid: 22764 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.530238:0:22757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6842049600/0x2aac941e5f4a9136 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a912f expref: 18 pid: 22764 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.530250:0:22757:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6842173200/0x2aac941e5f4a9232 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.530258:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6842173200/0x2aac941e5f4a9232 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788541405.530277:0:22757:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007300579s 00010000:00010000:3.0:1788541405.530281:0:22757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6842173200/0x2aac941e5f4a9232 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.530288:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6842173200/0x2aac941e5f4a9232 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.530295:0:22757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6842173200/0x2aac941e5f4a9232 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.530302:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6842173200/0x2aac941e5f4a9232 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.530308:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842173200 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541405.530312:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6842173200/0x2aac941e5f4a9232 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.530320:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6842173200/0x2aac941e5f4a9232 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.530328:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6842173200/0x2aac941e5f4a9232 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541405.530336:0:22757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541405.530359:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee13e9d8-48fa-4214-b460-99ccd69f1274+18:3643:x1875420981209856:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541405.530366:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788541405.530732:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee13e9d8-48fa-4214-b460-99ccd69f1274:3643:1875420981209856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788541405.530739:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee13e9d8-48fa-4214-b460-99ccd69f1274:3643:1875420981209728:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788541405.530901:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a682e75fc00/0x2aac941e5f4a91fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a91f3 expref: 17 pid: 22766 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541405.530913:0:22787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708835500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22787:1875420981209472:0@lo:104: 00010000:00010000:1.0:1788541405.530922:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6842049600/0x2aac941e5f4a9136 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a912f expref: 16 pid: 22764 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541405.530931:0:22787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708837b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22787:1875420981209600:0@lo:104: 00010000:00010000:1.0:1788541405.530955:0:22787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6842173200/0x2aac941e5f4a9232 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541405.530964:0:22787:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6842173200/0x2aac941e5f4a9232 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541405.530971:0:22787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6842173200/0x2aac941e5f4a9232 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541405.530977:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6842173200/0x2aac941e5f4a9232 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:1.0:1788541405.533539:0:23503:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1788541405.533593:0:23528:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1788541405.533597:0:23528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788541405.533798:0:23529:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788541405.533945:0:23503:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1788541405.534222:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e710e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23530:1875420981209984:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788541405.534287:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541405.534319:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68083dba80 going to sleep for 11 seconds 00000040:01000000:1.0:1788541405.534420:0:23503:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788541405.534449:0:23503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788541405.534913:0:23503:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788541405.534921:0:23503:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788541405.534955:0:23503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788541405.535667:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981209984 00000100:00100000:3.0:1788541405.535688:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981209984 00000100:00100000:3.0:1788541405.535747:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788541405.535757:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23530:x1875420981209984:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788541405.535892:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23530:x1875420981209984:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 136us (1604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541405.535900:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788541405.535947:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e710e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23530:1875420981209984:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1788541405.535982:0:23530:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788541405.536020:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ee680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23530:1875420981210112:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788541405.536057:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541405.536083:0:23512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981210112 00000100:00100000:3.0:1788541405.536087:0:23512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981210112 00000100:00100000:3.0:1788541405.536108:0:23512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788541405.536114:0:23512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23530:x1875420981210112:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788541405.536206:0:23512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23530:x1875420981210112:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 92us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541405.536213:0:23512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788541405.536231:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6705a9b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788541405.536243:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ee680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23530:1875420981210112:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788541405.536296:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ee680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23530:1875420981210240:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788541405.536322:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541405.536352:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981210240 00000100:00100000:3.0:1788541405.536356:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981210240 00000100:00100000:3.0:1788541405.536381:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788541405.536398:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23530:x1875420981210240:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788541405.536433:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23530:x1875420981210240:12345-0@lo:900:lod0001_rec0000.0 Request processed in 37us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541405.536439:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788541405.536457:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68083dba80 going to sleep for 11 seconds 00010000:00080000:3.0:1788541405.536472:0:23530:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a67078ee680 x1875420981210240/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788541421 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541405.536483:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ee680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23530:1875420981210240:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788541405.536519:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ee680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23530:1875420981210368:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788541405.536544:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541405.536563:0:23512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981210368 00000100:00100000:3.0:1788541405.536566:0:23512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981210368 00000100:00100000:3.0:1788541405.536586:0:23512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788541405.536593:0:23512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23530:x1875420981210368:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788541405.536636:0:23512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23530:x1875420981210368:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 43us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541405.536642:0:23512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788541405.536657:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6705a9b180 going to sleep for 11 seconds 00000100:00100000:3.0:1788541405.536670:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ee680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23530:1875420981210368:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1788541405.536707:0:23530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788541405.539414:0:23503:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788541405.540601:0:23503:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788541405.540653:0:23503:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1788541405.541583:0:23503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788541405.542172:0:23503:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000040:00080000:0.0:1788541405.542771:0:23529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788541405.550202:0:23530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788541405.550274:0:23530:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000001:00000004:1.0:1788541405.550360:0:23503:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000040:00080000:0.0:1788541405.551126:0:23529:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788541405.551180:0:23529:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788541405.551190:0:23529:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:1.0:1788541405.551904:0:23503:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788541405.552085:0:23503:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb5cdc19df988 00100000:10000000:1.0:1788541405.552094:0:23503:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1788541405.552698:0:23503:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788541405.552728:0:23503:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.156@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788541405.552749:0:23503:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788541405.552774:0:23503:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1788541405.553448:0:23503:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788541405.553649:0:23503:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788541405.835214:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541406.217973:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068596c0 going to sleep for 0 seconds 00000040:00080000:1.0:1788541406.546117:0:23524:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788541406.862109:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788541407.116290:0:22768:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788541407.116298:0:22768:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a683533d000 from 12 10000000:01000000:0.0:1788541407.116305:0:22768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788541407.116351:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75f400/0x2aac941e5f4a9239 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541407.116363:0:22768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a682e75f400/0x2aac941e5f4a9239 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541407.116374:0:22768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a682e75f400/0x2aac941e5f4a9239 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541407.116402:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981210496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788541407.116472:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541407.116522:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67076a0540 going to sleep for 11 seconds 00000100:00100000:1.0:1788541407.116601:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981210496 00000100:00100000:1.0:1788541407.116608:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981210496 00000100:00100000:1.0:1788541407.116668:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788541407.116678:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706b72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+16:22768:x1875420981210496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788541407.116705:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541407.116719:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6842172000/0x2aac941e5f4a9240 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a9239 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541407.116741:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6842172000/0x2aac941e5f4a9240 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a9239 expref: 17 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541407.116751:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6842172000/0x2aac941e5f4a9240 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a9239 expref: 17 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541407.116760:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842172000, rc 0) 00000100:00100000:1.0:1788541407.116806:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706b72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+17:22768:x1875420981210496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541407.116813:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788541407.117274:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981210496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788541407.117291:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a682e75f400/0x2aac941e5f4a9239 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9240 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541407.117301:0:22768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a682e75f400/0x2aac941e5f4a9239 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a9240 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541407.117355:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981210624:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788541407.117399:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541407.117433:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67076a0540 going to sleep for 11 seconds 00000100:00100000:3.0:1788541407.117514:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981210624 00000100:00100000:3.0:1788541407.117524:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981210624 00000100:00100000:3.0:1788541407.117551:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788541407.117557:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706b71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+17:22768:x1875420981210624:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788541407.117571:0:22765:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788541407.117586:0:22765:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788541407.117589:0:22765:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1788541407.117659:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706b71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+17:22768:x1875420981210624:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 101us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541407.117667:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788541407.117801:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981210624:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788541407.117852:0:22768:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788541407.117858:0:22768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75f400/0x2aac941e5f4a9239 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9240 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541407.117866:0:22768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a682e75f400/0x2aac941e5f4a9239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9240 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541407.117902:0:22768:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788541407.117904:0:22768:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a682e797000 from 12 10000000:01000000:0.0:1788541407.117907:0:22768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788541407.117923:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75fa00/0x2aac941e5f4a9247 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541407.117931:0:22768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a682e75fa00/0x2aac941e5f4a9247 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541407.117939:0:22768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a682e75fa00/0x2aac941e5f4a9247 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541407.117951:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981210752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788541407.117974:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541407.117989:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67076a0540 going to sleep for 11 seconds 00000100:00100000:3.0:1788541407.118342:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981210752 00000100:00100000:3.0:1788541407.118347:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981210752 00000100:00100000:3.0:1788541407.118377:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788541407.118384:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706b71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+17:22768:x1875420981210752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788541407.118392:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541407.118401:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68043cda00/0x2aac941e5f4a924e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a9247 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541407.118417:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68043cda00/0x2aac941e5f4a924e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a9247 expref: 18 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541407.118425:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68043cda00/0x2aac941e5f4a924e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a9247 expref: 18 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541407.118433:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68043cda00, rc 0) 00000100:00100000:3.0:1788541407.118460:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706b71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+18:22768:x1875420981210752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541407.118465:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788541407.118583:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981210752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788541407.118594:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a682e75fa00/0x2aac941e5f4a9247 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a924e expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541407.118611:0:22768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a682e75fa00/0x2aac941e5f4a9247 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a924e expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541407.118643:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981210880:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788541407.118669:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541407.118697:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67076a0540 going to sleep for 11 seconds 00000100:00100000:3.0:1788541407.118794:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981210880 00000100:00100000:3.0:1788541407.118799:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981210880 00000100:00100000:3.0:1788541407.118832:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788541407.118848:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706b70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+18:22768:x1875420981210880:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788541407.118859:0:22765:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788541407.118898:0:22765:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788541407.118901:0:22765:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1788541407.118958:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706b70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+18:22768:x1875420981210880:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541407.118964:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788541407.119137:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981210880:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788541407.119171:0:22768:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788541407.119177:0:22768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75fa00/0x2aac941e5f4a9247 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a924e expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541407.119184:0:22768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a682e75fa00/0x2aac941e5f4a9247 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a924e expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541407.242684:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068596c0 going to sleep for 0 seconds 00000040:00080000:1.0:1788541407.562815:0:23524:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788541407.882575:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541408.267258:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068596c0 going to sleep for 0 seconds 00010000:00010000:3.0:1788541408.913367:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541409.290275:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068596c0 going to sleep for 0 seconds 00010000:00010000:3.0:1788541409.930209:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541410.316732:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068596c0 going to sleep for 0 seconds 00000001:02000400:3.0:1788541410.445948:0:23773:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg256-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788541410.763944:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788541410.763965:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981211008:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788541410.764074:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541410.764696:0:23512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981211008 00000100:00100000:2.0:1788541410.764708:0:23512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981211008 00000100:00100000:2.0:1788541410.764829:0:23512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788541410.764840:0:23512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981211008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788541410.764906:0:23512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788541410.765005:0:23512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981211008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 154us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541410.765012:0:23512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788541410.766586:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788541410.766593:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788541410.766597:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a6802b4d000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788541410.766608:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a6802b4d000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1788541410.766646:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a67078ee300 x1875420981211264/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788541410.766666:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541410.766670:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788541410.766673:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541410.766676:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788541410.766696:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541410.766700:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788541410.766702:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541410.766716:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788541410.766750:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981211392:0@lo:400:kworker.0 00000100:00100000:3.0:1788541410.766818:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541410.766853:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788541410.766860:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981211520:0@lo:400:kworker.0 00000100:00100000:3.0:1788541410.766899:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541410.766932:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981211392 00000100:00100000:3.0:1788541410.766939:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981211392 00000100:00100000:3.0:1788541410.766999:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981211520 00000100:00100000:3.0:1788541410.767002:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981211520 00000100:00100000:3.0:1788541410.767019:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788541410.767025:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981211392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541410.767069:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981211392:12345-0@lo:400:kworker.0 Request processed in 43us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541410.767076:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788541410.767090:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788541410.767096:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981211520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541410.767118:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981211520:12345-0@lo:400:kworker.0 Request processed in 23us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541410.767124:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788541410.767141:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788541410.767148:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee13e9d8-48fa-4214-b460-99ccd69f1274:3641:1875420981211136:0@lo:400:kworker.0 00000100:00100000:3.0:1788541410.767176:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541410.767207:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981211136 00000100:00100000:3.0:1788541410.767210:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981211136 00000100:00100000:3.0:1788541410.767233:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788541410.767240:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706b70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+18:3641:x1875420981211136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541410.767276:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706b70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+18:3641:x1875420981211136:12345-0@lo:400:kworker.0 Request processed in 37us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541410.767282:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788541410.767325:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee13e9d8-48fa-4214-b460-99ccd69f1274:3641:1875420981211136:0@lo:400:kworker.0 00010000:00080000:3.0:1788541410.767361:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a67078ef100 x1875420981211520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541410.767372:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981211520:0@lo:400:kworker.0 00010000:00080000:3.0:1788541410.767383:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a67078eca80 x1875420981211392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541410.767390:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981211392:0@lo:400:kworker.0 00000100:00100000:1.0:1788541410.767472:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981211264:0@lo:38:kworker.0 00000100:00100000:1.0:1788541410.767505:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541410.767568:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981211008:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788541410.767699:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981211264 00000100:00100000:3.0:1788541410.767704:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981211264 00000100:00100000:3.0:1788541410.767733:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788541410.767739:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875420981211264:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788541410.767761:0:22776:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 691 last 0 00000020:00000080:3.0:1788541410.767795:0:22776:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2aac941e5f4a9255 00000004:00100000:3.0:1788541410.767817:0:22776:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788541410.767823:0:22776:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:3.0:1788541410.775015:0:22776:0:(import.c:65:import_set_state_nolock()) ffff9a6806313800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788541410.775119:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1875420981211264:12345-0@lo:38:kworker.0 Request processed in 7376us (7610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541410.775132:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1788541410.776829:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788541410.776842:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788541410.776849:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788541410.776852:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6802b4d000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788541410.776906:0:3640:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000095f3eba1): req@ffff9a67088a1c00 x1875420981204224/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541410.776927:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981211264:0@lo:38:kworker.0 00000100:00100000:1.0:1788541410.777032:0:22812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541410.777060:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068596c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788541410.777078:0:23512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981204224 00000100:00100000:1.0:1788541410.777083:0:23512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981204224 00000100:00100000:1.0:1788541410.777125:0:23512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788541410.777134:0:23512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22812:x1875420981204224:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788541410.777208:0:23512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22812:x1875420981204224:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 75us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541410.777216:0:23512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788541410.777245:0:22812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a1c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22812:1875420981204224:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1788541410.777295:0:22812:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788541410.777338:0:22812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708836300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22812:1875420981211648:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788541410.777539:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981211776:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788541410.777569:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541410.777729:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981211776 00000100:00100000:0.0:1788541410.777734:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981211776 00000100:00100000:0.0:1788541410.777768:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788541410.777776:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1875420981211776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788541410.777799:0:22776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788541410.777847:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1875420981211776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541410.777854:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788541410.778760:0:22812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541410.778838:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f2410c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788541410.782632:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981211776:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788541410.784761:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981211648 00000100:00100000:0.0:1788541410.784778:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981211648 00000100:00100000:0.0:1788541410.786140:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788541410.786166:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22812:x1875420981211648:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788541410.786486:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22812:x1875420981211648:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 324us (7726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541410.786494:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788541410.786977:0:22812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708836300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22812:1875420981211648:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788541410.787093:0:22812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a2d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22812:1875420981211904:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788541410.787135:0:22812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541410.787294:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67076a0540 going to sleep for 11 seconds 00000100:00100000:3.0:1788541410.789030:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981211904 00000100:00100000:3.0:1788541410.789046:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981211904 00000100:00100000:3.0:1788541410.789121:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788541410.789134:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22812:x1875420981211904:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788541410.789367:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22812:x1875420981211904:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 236us (2232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541410.789376:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788541410.789443:0:22812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a2d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22812:1875420981211904:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1788541410.789509:0:22812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788541410.796658:0:22812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788541410.797204:0:22812:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:3.0:1788541410.797212:0:22812:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1788541410.958124:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788541411.347521:0:23826:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788541411.347722:0:23826:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788541411.979450:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788541412.326734:0:23876:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788541412.327059:0:23876:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788541413.002305:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788541413.401187:0:22807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:2.0:1788541413.437108:0:23924:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcc326d6e0 20000000:00000080:2.0:1788541413.437167:0:23924:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a6838e00800 uarg=0000000000000000 20000000:01000000:2.0:1788541413.437221:0:23924:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788541413.437230:0:23924:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788541413.437235:0:23924:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788541413.437730:0:23925:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1788541413.437990:0:23924:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788541413.444021:0:23924:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788541413.444054:0:23924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6842049600/0x2aac941e5f4a925c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541413.444075:0:23924:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6842048400/0x2aac941e5f4a9105 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a90fe expref: 17 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541413.444085:0:23924:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a68043cc600/0x2aac941e5f4a9208 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a9201 expref: 17 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541413.444093:0:23924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6842049600/0x2aac941e5f4a925c lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541413.444144:0:23924:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a68043cc600/0x2aac941e5f4a9208 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a9201 expref: 17 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541413.444159:0:23924:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a68043cc600/0x2aac941e5f4a9208 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a9201 expref: 17 pid: 22764 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541413.444174:0:23924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e711c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23924:1875420981212032:0@lo:104: 00000100:00100000:2.0:1788541413.444242:0:23924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788541413.444298:0:23924:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6842048400/0x2aac941e5f4a9105 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a90fe expref: 17 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541413.444307:0:23924:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6842048400/0x2aac941e5f4a9105 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a90fe expref: 17 pid: 22766 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541413.444334:0:23924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e710000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23924:1875420981212160:0@lo:104: 00000100:00100000:2.0:1788541413.444357:0:23924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541413.444383:0:23924:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a680133a600 going to sleep for 11 seconds 00000100:00100000:3.0:1788541413.444466:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981212032 00000100:00100000:3.0:1788541413.444474:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981212032 00000100:00100000:3.0:1788541413.444512:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981212160 00000100:00100000:3.0:1788541413.444515:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981212160 00000100:00100000:3.0:1788541413.444530:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788541413.444538:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e713100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee13e9d8-48fa-4214-b460-99ccd69f1274+4:23924:x1875420981212032:12345-0@lo:104: 00010000:00010000:3.0:1788541413.444551:0:22756:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a6842172a00/0x2aac941e5f4a9201 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a9208 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541413.444608:0:22756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788541413.444614:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e713100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee13e9d8-48fa-4214-b460-99ccd69f1274+4:23924:x1875420981212032:12345-0@lo:104: Request processed in 78us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541413.444621:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788541413.444638:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788541413.444652:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e711f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee13e9d8-48fa-4214-b460-99ccd69f1274+3:23924:x1875420981212160:12345-0@lo:104: 00010000:00010000:3.0:1788541413.444661:0:22756:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a682e75e800/0x2aac941e5f4a90fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a9105 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541413.444691:0:22756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788541413.444696:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e711f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee13e9d8-48fa-4214-b460-99ccd69f1274+3:23924:x1875420981212160:12345-0@lo:104: Request processed in 45us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541413.444701:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788541413.444717:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788541413.444723:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a6842172a00/0x2aac941e5f4a9201 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a9208 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541413.444729:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842172a00 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:3.0:1788541413.444733:0:22761:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a6842172a00/0x2aac941e5f4a9201 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a9208 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541413.444741:0:22761:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a6842172a00/0x2aac941e5f4a9201 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a9208 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788541413.444748:0:22761:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a6842172a00/0x2aac941e5f4a9201 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a9208 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541413.444754:0:22761:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788541413.444794:0:22761:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a6842172a00/0x2aac941e5f4a9201 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a9208 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541413.444801:0:22761:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788541413.444818:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a6842172a00/0x2aac941e5f4a9201 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a9208 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541413.444834:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a6842172a00/0x2aac941e5f4a9201 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a9208 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541413.444847:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541413.444849:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a682e75e800/0x2aac941e5f4a90fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a9105 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541413.444854:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75e800 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:3.0:1788541413.444857:0:22761:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75e800/0x2aac941e5f4a90fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a9105 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541413.444864:0:22761:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a682e75e800/0x2aac941e5f4a90fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a9105 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788541413.444897:0:22761:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75e800/0x2aac941e5f4a90fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a9105 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541413.444903:0:22761:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788541413.444916:0:22761:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a682e75e800/0x2aac941e5f4a90fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a9105 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541413.444921:0:22761:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788541413.444936:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a682e75e800/0x2aac941e5f4a90fe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a9105 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541413.444942:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a682e75e800/0x2aac941e5f4a90fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a9105 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541413.444954:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541413.444961:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541413.444963:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541413.444983:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee13e9d8-48fa-4214-b460-99ccd69f1274:3643:1875420981212416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788541413.445013:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541413.445072:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981212416 00000100:00100000:3.0:1788541413.445077:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981212416 00010000:00010000:3.0:1788541413.445094:0:22758:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6842048400/0x2aac941e5f4a9105 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a90fe expref: 18 pid: 22766 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541413.445117:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788541413.445124:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee13e9d8-48fa-4214-b460-99ccd69f1274+18:3643:x1875420981212416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788541413.445134:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541413.445139:0:22758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6842048400/0x2aac941e5f4a9105 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a90fe expref: 18 pid: 22766 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541413.445150:0:22758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6842048400/0x2aac941e5f4a9105 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a90fe expref: 18 pid: 22766 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541413.445166:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541413.445193:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee13e9d8-48fa-4214-b460-99ccd69f1274+18:3643:x1875420981212416:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541413.445200:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788541413.445235:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee13e9d8-48fa-4214-b460-99ccd69f1274:3643:1875420981212416:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788541413.445417:0:23924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e711c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23924:1875420981212032:0@lo:104: 00010000:00010000:2.0:1788541413.445428:0:23924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6842048400/0x2aac941e5f4a9105 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a90fe expref: 17 pid: 22766 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541413.445438:0:23924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e710000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23924:1875420981212160:0@lo:104: 00010000:00010000:2.0:1788541413.445455:0:23924:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6842049600/0x2aac941e5f4a925c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541413.445611:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541413.445623:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee13e9d8-48fa-4214-b460-99ccd69f1274:3642:1875420981212288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788541413.445654:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541413.445749:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981212288 00000100:00100000:3.0:1788541413.445754:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981212288 00010000:00010000:3.0:1788541413.445770:0:22757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a68043cc600/0x2aac941e5f4a9208 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a9201 expref: 17 pid: 22764 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541413.445808:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788541413.445823:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708836680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee13e9d8-48fa-4214-b460-99ccd69f1274+17:3642:x1875420981212288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788541413.445832:0:22757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541413.445837:0:22757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a68043cc600/0x2aac941e5f4a9208 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a9201 expref: 17 pid: 22764 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541413.445847:0:22757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a68043cc600/0x2aac941e5f4a9208 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a9201 expref: 17 pid: 22764 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541413.445858:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68043cc600/0x2aac941e5f4a9208 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a9201 expref: 17 pid: 22764 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541413.446017:0:22757:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6842049600/0x2aac941e5f4a925c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541413.446027:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6842049600/0x2aac941e5f4a925c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541413.446042:0:22757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6842049600/0x2aac941e5f4a925c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541413.446050:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6842049600/0x2aac941e5f4a925c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541413.446057:0:22757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6842049600/0x2aac941e5f4a925c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541413.446064:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6842049600/0x2aac941e5f4a925c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541413.446070:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842049600 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541413.446074:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6842049600/0x2aac941e5f4a925c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541413.446089:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6842049600/0x2aac941e5f4a925c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541413.447769:0:23924:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6842049600/0x2aac941e5f4a925c lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541413.447792:0:23924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6842049600/0x2aac941e5f4a925c lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541413.450572:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6842049600/0x2aac941e5f4a925c lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541413.450592:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6842049600/0x2aac941e5f4a925c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541413.450614:0:22757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541413.450701:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708836680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee13e9d8-48fa-4214-b460-99ccd69f1274+16:3642:x1875420981212288:12345-0@lo:103:ldlm_bl.0 Request processed in 4875us (5041us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541413.450711:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788541413.450772:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee13e9d8-48fa-4214-b460-99ccd69f1274:3642:1875420981212288:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788541414.026152:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788541414.793958:0:22768:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788541414.793965:0:22768:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a683533d000 from 13 10000000:01000000:3.0:1788541414.793971:0:22768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788541414.794018:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68043cc600/0x2aac941e5f4a9263 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541414.794030:0:22768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a68043cc600/0x2aac941e5f4a9263 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541414.794040:0:22768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a68043cc600/0x2aac941e5f4a9263 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541414.794066:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981212544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788541414.794137:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541414.794324:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68394b5240 going to sleep for 11 seconds 00000100:00100000:0.0:1788541414.796829:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981212544 00000100:00100000:0.0:1788541414.796844:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981212544 00000100:00100000:0.0:1788541414.796925:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788541414.796936:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706b70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+16:22768:x1875420981212544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788541414.796955:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541414.796975:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a926a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a9263 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541414.797005:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a926a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a9263 expref: 17 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541414.797016:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a926a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a9263 expref: 17 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541414.797025:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75e800, rc 0) 00000100:00100000:0.0:1788541414.797814:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706b70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+17:22768:x1875420981212544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 875us (3671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541414.797830:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788541414.803087:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981212544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788541414.803121:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a68043cc600/0x2aac941e5f4a9263 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a926a expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541414.803135:0:22768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a68043cc600/0x2aac941e5f4a9263 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a926a expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541414.803684:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e710000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981212672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788541414.803753:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541414.803829:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67078739c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541414.803921:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981212672 00000100:00100000:0.0:1788541414.803928:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981212672 00000100:00100000:0.0:1788541414.804000:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788541414.804010:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706b73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+17:22768:x1875420981212672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788541414.804171:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706b73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+17:22768:x1875420981212672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 162us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541414.804179:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788541414.804830:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e710000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981212672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788541414.804938:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e710000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981212800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788541414.804994:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541414.805020:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67078739c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541414.805091:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981212800 00000100:00100000:0.0:1788541414.805098:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981212800 00000100:00100000:0.0:1788541414.805152:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788541414.805160:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706b73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+17:22768:x1875420981212800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788541414.805643:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706b73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+17:22768:x1875420981212800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 481us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541414.805652:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788541414.805781:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e710000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981212800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788541414.815733:0:23986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788541414.816118:0:22768:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788541414.816178:0:22768:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788541414.816191:0:22768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68043cc600/0x2aac941e5f4a9263 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a926a expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541414.816215:0:22768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a68043cc600/0x2aac941e5f4a9263 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a926a expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541414.816537:0:22768:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788541414.816541:0:22768:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a682e797000 from 13 10000000:01000000:0.0:1788541414.816544:0:22768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788541414.816589:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75f000/0x2aac941e5f4a9271 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541414.816609:0:22768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a682e75f000/0x2aac941e5f4a9271 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541414.816622:0:22768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a682e75f000/0x2aac941e5f4a9271 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541414.816648:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981212928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788541414.816714:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541414.816762:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683530ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788541414.816911:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981212928 00000100:00100000:2.0:1788541414.816921:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981212928 00000100:00100000:2.0:1788541414.816983:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788541414.816993:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708319050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+17:22768:x1875420981212928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788541414.817010:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541414.817023:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6842048800/0x2aac941e5f4a9278 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a9271 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541414.817047:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6842048800/0x2aac941e5f4a9278 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a9271 expref: 18 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541414.817059:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6842048800/0x2aac941e5f4a9278 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a9271 expref: 18 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541414.817068:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842048800, rc 0) 00000100:00100000:2.0:1788541414.817117:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708319050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+18:22768:x1875420981212928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541414.817124:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788541414.817539:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981212928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788541414.817556:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a682e75f000/0x2aac941e5f4a9271 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9278 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541414.817575:0:22768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a682e75f000/0x2aac941e5f4a9271 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a9278 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541414.817649:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708834700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981213056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788541414.817680:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541414.817701:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6802dae480 going to sleep for 11 seconds 00000100:00100000:0.0:1788541414.817759:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981213056 00000100:00100000:0.0:1788541414.817764:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981213056 00000100:00100000:0.0:1788541414.817807:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788541414.817815:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+18:22768:x1875420981213056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788541414.817957:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+18:22768:x1875420981213056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541414.817963:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788541414.818545:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708834700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981213056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788541414.818584:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708834700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981213184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788541414.818634:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541414.818655:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6802dae480 going to sleep for 11 seconds 00000100:00100000:0.0:1788541414.818982:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981213184 00000100:00100000:0.0:1788541414.818988:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981213184 00000100:00100000:0.0:1788541414.819030:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788541414.819038:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708319850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+18:22768:x1875420981213184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788541414.819138:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708319850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+18:22768:x1875420981213184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541414.819145:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788541414.820665:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708834700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981213184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788541414.830111:0:23987:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788541414.830500:0:22768:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788541414.830538:0:22768:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788541414.830549:0:22768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75f000/0x2aac941e5f4a9271 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9278 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541414.830562:0:22768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a682e75f000/0x2aac941e5f4a9271 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9278 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541415.051164:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541415.882049:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788541405/real 1788541405] req@ffff9a67088a2300 x1875420981207424/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541415 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541415.882090:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a67088a2300 x1875420981207424/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541415 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541415.882100:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788541405/real 1788541405] req@ffff9a6708836a00 x1875420981207296/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541415 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541415.882111:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a6708836a00 x1875420981207296/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541415 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788541415.882129:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6837950800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788541415.882136:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788541415.882139:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981207424:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788541415.882144:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a67082f2000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788541415.882147:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788541415.882149:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981207296:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788541415.883660:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541415.883664:0:18310:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788541415.883666:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541415.883668:0:18310:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788541415.883678:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541415.883680:0:18310:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788541415.883682:0:18310:0:(import.c:65:import_set_state_nolock()) ffff9a67082f2000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788541415.883687:0:18310:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 686 00000100:00080000:3.0:1788541415.883692:0:18310:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788541415.883697:0:18310:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9a67082f2000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1788541415.883712:0:18310:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68045f5c00 x1875420981213824/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788541415.883723:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541415.883725:0:18310:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788541415.883726:0:18310:0:(import.c:65:import_set_state_nolock()) ffff9a6837950800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788541415.883728:0:18310:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 686 00000100:00080000:3.0:1788541415.883730:0:18310:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788541415.883732:0:18310:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a6837950800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1788541415.883737:0:18310:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68045f5f80 x1875420981213952/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788541415.883820:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee13e9d8-48fa-4214-b460-99ccd69f1274:3644:1875420981213312:0@lo:400:kworker.0 00000100:00100000:3.0:1788541415.883919:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541415.883960:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875420981214080:0@lo:400:kworker.0 00000100:00100000:3.0:1788541415.883988:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541415.885823:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788541415.885840:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981213696:0@lo:400:kworker.0 00000100:00100000:0.0:1788541415.886178:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420981213568:0@lo:400:kworker.0 00000100:00100000:0.0:1788541415.886444:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541415.886500:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981214336:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788541415.886525:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541415.886545:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788541415.886552:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981213440:0@lo:400:kworker.0 00000100:00100000:0.0:1788541415.886572:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541415.886599:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981214208:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788541415.886619:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541415.886668:0:23512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981214336 00000100:00100000:0.0:1788541415.886674:0:23512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981214336 00000100:00100000:1.0:1788541415.886684:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981214080 00000100:00100000:1.0:1788541415.886688:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981214080 00000100:00100000:0.0:1788541415.886709:0:23512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981213440 00000100:00100000:0.0:1788541415.886712:0:23512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981213440 00000100:00100000:0.0:1788541415.886723:0:23512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981214208 00000100:00100000:0.0:1788541415.886725:0:23512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981214208 00000100:00100000:0.0:1788541415.886735:0:23512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788541415.886743:0:23512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981214336:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788541415.886777:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981213568 00000004:00000024:0.0:1788541415.886784:0:23512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788541415.886826:0:23512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981214336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541415.886833:0:23512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788541415.886848:0:23512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788541415.886853:0:23512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3642:x1875420981213440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541415.886920:0:23512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3642:x1875420981213440:12345-0@lo:400:kworker.0 Request processed in 66us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541415.886926:0:23512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788541415.886938:0:23512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788541415.886955:0:23512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1875420981214208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788541415.886971:0:23512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788541415.887005:0:23512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1875420981214208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541415.887011:0:23512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788541415.887051:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981213440:0@lo:400:kworker.0 00000100:00100000:0.0:1788541415.887065:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981214208:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788541415.887077:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981214336:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788541415.887107:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981213824:0@lo:8:kworker.0 00000400:00000100:0.0:1788541415.887131:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875420981213824 offset 0 length 520: 4 00000100:00100000:0.0:1788541415.887167:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981213952:0@lo:8:kworker.0 00000400:00000100:0.0:1788541415.887185:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875420981213952 offset 0 length 520: 4 00000100:00100000:3.0:1788541415.887784:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541415.887964:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981213312 00000100:00100000:3.0:1788541415.887970:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981213312 00000100:00100000:3.0:1788541415.888010:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788541415.888017:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+18:3644:x1875420981213312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541415.888033:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981213568 00000100:00100000:3.0:1788541415.888063:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+18:3644:x1875420981213312:12345-0@lo:400:kworker.0 Request processed in 47us (4144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541415.888069:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788541415.888499:0:23512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981213696 00000100:00100000:0.0:1788541415.888503:0:23512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981213696 00000100:00100000:0.0:1788541415.888530:0:23512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788541415.888536:0:23512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981213696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541415.888575:0:23512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981213696:12345-0@lo:400:kworker.0 Request processed in 39us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541415.888636:0:23512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788541415.888708:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788541415.889000:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788541415.889011:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420981213568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541415.889130:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420981213568:12345-0@lo:400:kworker.0 Request processed in 122us (2686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541415.889137:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788541415.889162:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a67078ef100 x1875420981213568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541415.889177:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420981213568:0@lo:400:kworker.0 00000100:00100000:2.0:1788541415.889403:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981213696:0@lo:400:kworker.0 00000100:00100000:2.0:1788541415.889414:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee13e9d8-48fa-4214-b460-99ccd69f1274:3644:1875420981213312:0@lo:400:kworker.0 00000100:00100000:3.0:1788541415.889595:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875420981214080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541415.889633:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875420981214080:12345-0@lo:400:kworker.0 Request processed in 918us (5645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541415.889640:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788541415.889668:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a68045f4a80 x1875420981214080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541415.889679:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875420981214080:0@lo:400:kworker.0 00000001:00100000:0.0:1788541415.889753:0:23504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788541416.079085:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541416.906163:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788541401/real 1788541401] req@ffff9a67078efb80 x1875420981205248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541416 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541416.906219:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a67078efb80 x1875420981205248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541416 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541416.906229:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788541401/real 1788541401] req@ffff9a67078ef800 x1875420981205376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541416 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541416.906239:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a67078ef800 x1875420981205376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541416 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788541416.906258:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a682fdc6800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788541416.906279:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788541416.906283:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981205248:0@lo:8:kworker.0 00000100:00080000:0.0:1788541416.906288:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a68398d5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788541416.906293:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788541416.906296:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981205376:0@lo:8:kworker.0 00000100:00080000:2.0:1788541416.906423:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788541416.906428:0:18310:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788541416.906431:0:18310:0:(import.c:65:import_set_state_nolock()) ffff9a682fdc6800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788541416.906436:0:18310:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 681 00000100:00080000:2.0:1788541416.906441:0:18310:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788541416.906447:0:18310:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a682fdc6800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:2.0:1788541416.906464:0:18310:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a682e712300 x1875420981214720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788541416.906485:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788541416.906488:0:18310:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788541416.906490:0:18310:0:(import.c:65:import_set_state_nolock()) ffff9a68398d5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788541416.906493:0:18310:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 681 00000100:00080000:2.0:1788541416.906496:0:18310:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788541416.906499:0:18310:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a68398d5000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:2.0:1788541416.906509:0:18310:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a682e713800 x1875420981214848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788541416.906550:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788541416.906554:0:18310:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788541416.906557:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788541416.906565:0:18310:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788541416.906589:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981214976:0@lo:400:kworker.0 00000100:00100000:2.0:1788541416.906647:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541416.906675:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788541416.906680:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981215104:0@lo:400:kworker.0 00000100:00100000:2.0:1788541416.906702:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541416.906742:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981214976 00000100:00100000:2.0:1788541416.906761:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981214976 00000100:00100000:2.0:1788541416.906818:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788541416.906828:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981214976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541416.906899:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981214976:12345-0@lo:400:kworker.0 Request processed in 72us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541416.906906:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788541416.906931:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981215104 00000100:00100000:2.0:1788541416.906934:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981215104 00000100:00100000:2.0:1788541416.906958:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788541416.906964:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981215104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541416.906994:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981215104:12345-0@lo:400:kworker.0 Request processed in 31us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541416.907000:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788541416.907036:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981215104:0@lo:400:kworker.0 00010000:00080000:2.0:1788541416.907047:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a682e713b80 x1875420981214976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541416.907054:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981214976:0@lo:400:kworker.0 00000100:00100000:1.0:1788541416.907186:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981214720:0@lo:8:kworker.0 00000400:00000100:1.0:1788541416.907213:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875420981214720 offset 0 length 520: 4 00000100:00100000:1.0:1788541416.907236:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981214848:0@lo:8:kworker.0 00000400:00000100:1.0:1788541416.907256:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875420981214848 offset 0 length 520: 4 00000100:00100000:3.0:1788541416.907424:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981214592:0@lo:400:kworker.0 00000100:00100000:3.0:1788541416.907454:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541416.907484:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788541416.907490:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee13e9d8-48fa-4214-b460-99ccd69f1274:3644:1875420981214464:0@lo:400:kworker.0 00000100:00100000:3.0:1788541416.907514:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541416.907546:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875420981215232:0@lo:400:kworker.0 00000100:00100000:3.0:1788541416.907569:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541416.907606:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981215232 00000100:00100000:3.0:1788541416.907610:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981215232 00000100:00100000:3.0:1788541416.907635:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788541416.907642:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875420981215232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541416.907676:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875420981215232:12345-0@lo:400:kworker.0 Request processed in 35us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541416.907682:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788541416.907707:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a682e711880 x1875420981215232/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541416.907717:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875420981215232:0@lo:400:kworker.0 00000100:00100000:1.0:1788541416.907836:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981214592 00000100:00100000:1.0:1788541416.907848:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981214592 00000100:00100000:1.0:1788541416.907939:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788541416.907946:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981214592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541416.907983:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981214592:12345-0@lo:400:kworker.0 Request processed in 37us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541416.907988:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788541416.908099:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981214464 00000100:00100000:2.0:1788541416.908109:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981214464 00000100:00100000:2.0:1788541416.908148:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788541416.908155:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+18:3644:x1875420981214464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541416.908185:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+18:3644:x1875420981214464:12345-0@lo:400:kworker.0 Request processed in 31us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541416.908190:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788541416.909395:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee13e9d8-48fa-4214-b460-99ccd69f1274:3644:1875420981214464:0@lo:400:kworker.0 00000100:00100000:3.0:1788541416.909409:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981214592:0@lo:400:kworker.0 00010000:00010000:2.0:1788541417.101207:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788541417.802811:0:23524:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788541418.122180:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541419.156066:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788541419.808294:0:24272:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788541419.808298:0:24272:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788541419.808300:0:24272:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788541419.808417:0:24272:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a67078de000 00000020:01000004:1.0:1788541419.808433:0:24272:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788541419.808447:0:24272:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788541419.808462:0:24272:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9a68059999c0) 00000020:00000080:1.0:1788541419.808479:0:24272:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788541419.886181:0:24272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788541419.890265:0:24272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788541419.890503:0:24272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788541419.890905:0:24272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788541419.891290:0:24272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788541419.891492:0:24272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788541419.891864:0:24272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:3.0:1788541419.894426:0:24272:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788541419.895194:0:24272:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788541419.895209:0:24272:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788541419.895224:0:24272:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2aac941e5f4a9286 00000020:01000004:3.0:1788541419.895232:0:24272:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788541419.895253:0:24272:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.156@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788541419.895266:0:24272:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.156@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788541419.895272:0:24272:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788541419.895277:0:24272:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788541419.895291:0:24272:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9a682fe0cd40) 00000020:00000080:3.0:1788541419.895303:0:24272:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1788541419.896477:0:24272:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788541419.897308:0:24272:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788541419.897317:0:24272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788541419.898519:0:24272:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788541419.898529:0:24272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788541419.899061:0:24272:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788541419.899069:0:24272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788541419.900590:0:24272:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788541419.900798:0:24272:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788541419.900806:0:24272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788541419.903863:0:24272:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788541419.903953:0:24272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788541419.937339:0:24272:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788541419.937792:0:24272:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788541419.937799:0:24272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788541419.939846:0:24272:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788541419.939861:0:24272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788541419.941427:0:24272:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788541419.941439:0:24272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788541419.945749:0:24272:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788541419.946380:0:24272:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788541419.946387:0:24272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788541419.948345:0:24272:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788541419.948358:0:24272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788541420.003807:0:24272:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788541420.004110:0:24272:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788541420.004117:0:24272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788541420.012778:0:24272:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788541420.012793:0:24272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788541420.013428:0:24272:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788541420.013461:0:24272:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1788541420.013469:0:24272:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.156@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788541420.026533:0:24272:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.156@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788541420.026581:0:24272:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.156@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788541420.026586:0:24272:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788541420.026587:0:24272:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788541420.026589:0:24272:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788541420.026590:0:24272:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788541420.026591:0:24272:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788541420.026592:0:24272:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788541420.026594:0:24272:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788541420.026595:0:24272:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788541420.026597:0:24272:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788541420.026600:0:24272:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788541420.026603:0:24272:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788541420.026608:0:24272:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788541420.026609:0:24272:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788541420.026610:0:24272:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788541420.026611:0:24272:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788541420.026612:0:24272:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788541420.026613:0:24272:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788541420.026614:0:24272:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788541420.026615:0:24272:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788541420.026647:0:24272:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788541420.026776:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e713b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981215360:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788541420.026846:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541420.026967:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981215360 00000100:00100000:0.0:1788541420.026974:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981215360 00000100:00100000:0.0:1788541420.027031:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788541420.027040:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670690d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+18:24272:x1875420981215360:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788541420.027076:0:22766:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788541420.027079:0:22766:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788541420.027082:0:22766:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788541420.027401:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670690d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+18:24272:x1875420981215360:12345-0@lo:253:mount.lustre.0 Request processed in 362us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541420.027420:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788541420.030321:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6802dae300 going to sleep for 11 seconds 00000100:00100000:1.0:1788541420.030367:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e713b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981215360:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788541420.030384:0:24272:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788541420.030388:0:24272:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788541420.030390:0:24272:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788541420.030392:0:24272:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788541420.030393:0:24272:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788541420.030394:0:24272:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788541420.030396:0:24272:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788541420.030397:0:24272:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788541420.030399:0:24272:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788541420.030400:0:24272:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788541420.030444:0:24272:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a67078de000 from lustre-OST0000 10000000:01000000:1.0:1788541420.030487:0:24272:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788541420.030490:0:24272:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788541420.030500:0:24272:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a670695b380 local copy 00010000:00010000:1.0:1788541420.030520:0:24272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842173c00/0x2aac941e5f4a9041 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9048 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541420.030909:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708836a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981215488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541420.030979:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541420.031002:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683543c000 going to sleep for 11 seconds 00000100:00100000:0.0:1788541420.031131:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981215488 00000100:00100000:0.0:1788541420.031138:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981215488 00000100:00100000:0.0:1788541420.031232:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788541420.031241:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670690fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+18:24272:x1875420981215488:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788541420.031328:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670690fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+18:24272:x1875420981215488:12345-0@lo:501:mount.lustre.0 Request processed in 88us (349us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788541420.031336:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788541420.031403:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708836a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981215488:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788541420.031416:0:24272:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.156@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788541420.031433:0:24272:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.156@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788541420.031439:0:24272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842173c00/0x2aac941e5f4a9041 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9048 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541420.031448:0:24272:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6842173c00/0x2aac941e5f4a9041 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9048 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788541420.031475:0:24272:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a67078de000 10000000:01000000:1.0:1788541420.031485:0:24272:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788541420.031490:0:24272:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788541420.031494:0:24272:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788541420.031498:0:24272:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788541420.031501:0:24272:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788541420.031526:0:24272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842173800/0x2aac941e5f4a9294 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541420.031534:0:24272:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a6842173800/0x2aac941e5f4a9294 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541420.031563:0:24272:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a6842173800/0x2aac941e5f4a9294 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541420.031576:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708836a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981215616:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788541420.031601:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541420.031833:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683543c000 going to sleep for 11 seconds 00000100:00100000:3.0:1788541420.032221:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981215616 00000100:00100000:3.0:1788541420.032227:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981215616 00000100:00100000:3.0:1788541420.032259:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788541420.032266:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670690c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+18:24272:x1875420981215616:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788541420.032278:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541420.032291:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68043cd800/0x2aac941e5f4a929b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a9294 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541420.032312:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68043cd800/0x2aac941e5f4a929b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a9294 expref: 19 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541420.032324:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68043cd800/0x2aac941e5f4a929b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a9294 expref: 19 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541420.032333:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68043cd800, rc 0) 00000100:00100000:3.0:1788541420.032394:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670690c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+19:24272:x1875420981215616:12345-0@lo:101:mount.lustre.0 Request processed in 128us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541420.032400:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788541420.032487:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708836a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981215616:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788541420.032501:0:24272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a6842173800/0x2aac941e5f4a9294 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a929b expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541420.032627:0:24272:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a6842173800/0x2aac941e5f4a9294 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a929b expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788541420.033497:0:24272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1788541420.034193:0:24272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788541420.038032:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1788541420.038095:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1788541420.038112:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1788541420.038125:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1788541420.038139:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1788541420.038154:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1788541420.038167:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1788541420.038180:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1788541420.038193:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1788541420.038207:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1788541420.038219:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:1.0:1788541420.038246:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:1.0:1788541420.038272:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:1.0:1788541420.038278:0:24272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:1.0:1788541420.038400:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708836a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981215744:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541420.038468:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541420.038683:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68065e0240 going to sleep for 11 seconds 00000100:00100000:0.0:1788541420.038807:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981215744 00000100:00100000:0.0:1788541420.038814:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981215744 00000100:00100000:1.0:1788541420.039002:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788541420.039012:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670690e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+19:24272:x1875420981215744:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541420.039176:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670690e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+19:24272:x1875420981215744:12345-0@lo:501:mount.lustre.0 Request processed in 163us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541420.039184:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788541420.039237:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708836a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981215744:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541420.039271:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708836a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981215872:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788541420.039311:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541420.039332:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981215872 00000100:00100000:1.0:1788541420.039336:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981215872 00000100:00100000:1.0:1788541420.039353:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788541420.039359:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670690c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+19:24272:x1875420981215872:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788541420.040212:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6807619e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788541420.040325:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670690c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+19:24272:x1875420981215872:12345-0@lo:503:mount.lustre.0 Request processed in 964us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541420.040333:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788541420.040416:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708836a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981215872:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788541420.041007:0:24272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788541420.041106:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981216000:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788541420.041153:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541420.041182:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683543c000 going to sleep for 11 seconds 00000100:00100000:1.0:1788541420.041325:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981216000 00000100:00100000:1.0:1788541420.041332:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981216000 00000100:00100000:1.0:1788541420.041372:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788541420.041380:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670690c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+19:24272:x1875420981216000:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788541420.041785:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670690c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+19:24272:x1875420981216000:12345-0@lo:502:mount.lustre.0 Request processed in 404us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541420.041793:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788541420.041905:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981216000:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788541420.042092:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1788541420.042118:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1788541420.042138:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1788541420.042154:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1788541420.042167:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1788541420.042183:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1788541420.042197:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1788541420.042210:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1788541420.042224:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:0.0:1788541420.042235:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:0.0:1788541420.042258:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:0.0:1788541420.042272:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:0.0:1788541420.042309:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981216128:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788541420.042350:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541420.042379:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6831c25d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788541420.042442:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981216128 00000100:00100000:1.0:1788541420.042447:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981216128 00000100:00100000:1.0:1788541420.042479:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788541420.042487:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670690d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+19:24272:x1875420981216128:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788541420.042702:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670690d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+19:24272:x1875420981216128:12345-0@lo:502:mount.lustre.0 Request processed in 215us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541420.042708:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788541420.042981:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981216128:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788541420.043229:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1788541420.043242:0:24272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1788541420.044178:0:24289:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788541420.044187:0:24289:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788541420.044192:0:24289:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541420.044195:0:24289:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788541420.044201:0:24289:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788541420.044216:0:24289:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9a682fe08000) 00000020:00000080:3.0:1788541420.044241:0:24289:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788541420.044248:0:24289:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788541420.044322:0:24289:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a67078de000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788541420.044331:0:24289:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788541420.044338:0:24289:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2aac941e5f4a92a9 00010000:00010000:3.0:1788541420.050191:0:24289:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1788541420.050672:0:24289:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:3.0:1788541420.054730:0:24289:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1788541420.057296:0:24289:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788541420.057310:0:24289:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788541420.057317:0:24289:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541420.057319:0:24289:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788541420.057324:0:24289:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788541420.057327:0:24289:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1788541420.057329:0:24289:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788541420.057330:0:24289:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788541420.057332:0:24289:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788541420.057335:0:24289:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541420.057336:0:24289:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788541420.057339:0:24289:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788541420.057342:0:24289:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541420.057344:0:24289:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788541420.057347:0:24289:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788541420.057349:0:24289:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788541420.057358:0:24289:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788541420.057361:0:24289:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541420.057362:0:24289:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788541420.057365:0:24289:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788541420.057367:0:24289:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541420.057369:0:24289:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788541420.057372:0:24289:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788541420.057406:0:24289:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788541420.057409:0:24289:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541420.057410:0:24289:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788541420.057414:0:24289:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:0.0:1788541420.057691:0:24272:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788541420.057735:0:24272:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788541420.057760:0:24272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842173800/0x2aac941e5f4a9294 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a929b expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541420.057774:0:24272:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6842173800/0x2aac941e5f4a9294 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a929b expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541420.057784:0:24272:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a67078de000 from 1 10000000:01000000:0.0:1788541420.057786:0:24272:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788541420.057826:0:24272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75ec00/0x2aac941e5f4a92b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541420.057834:0:24272:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a682e75ec00/0x2aac941e5f4a92b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541420.057846:0:24272:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a682e75ec00/0x2aac941e5f4a92b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541420.057898:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981216256:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788541420.057967:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541420.058007:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683543c000 going to sleep for 11 seconds 00000100:00100000:3.0:1788541420.058212:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981216256 00000100:00100000:3.0:1788541420.058220:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981216256 00000100:00100000:3.0:1788541420.058268:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788541420.058278:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670690f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+19:24272:x1875420981216256:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788541420.058291:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541420.058303:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68043cd000/0x2aac941e5f4a92b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a92b0 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541420.058328:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68043cd000/0x2aac941e5f4a92b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a92b0 expref: 20 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541420.058339:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68043cd000/0x2aac941e5f4a92b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a92b0 expref: 20 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541420.058348:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68043cd000, rc 0) 00000100:00100000:3.0:1788541420.058391:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670690f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+20:24272:x1875420981216256:12345-0@lo:101:mount.lustre.0 Request processed in 115us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541420.058398:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788541420.058527:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981216256:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788541420.058615:0:24272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a682e75ec00/0x2aac941e5f4a92b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a92b7 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541420.058625:0:24272:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a682e75ec00/0x2aac941e5f4a92b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a92b7 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788541420.059533:0:24272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1788541420.059836:0:24272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788541420.060015:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1788541420.060038:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1788541420.060052:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1788541420.060064:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1788541420.060089:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1788541420.060103:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1788541420.060115:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1788541420.060127:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1788541420.060139:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1788541420.060150:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1788541420.060161:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1788541420.060175:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1788541420.060180:0:24272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1788541420.060242:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981216384:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788541420.060292:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541420.060330:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6831c25d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788541420.060521:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981216384 00000100:00100000:3.0:1788541420.060527:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981216384 00000100:00100000:3.0:1788541420.060576:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788541420.060583:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670690e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+20:24272:x1875420981216384:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788541420.060682:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670690e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+20:24272:x1875420981216384:12345-0@lo:501:mount.lustre.0 Request processed in 99us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541420.060689:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788541420.060819:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981216384:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788541420.060859:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e713480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981216512:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788541420.060923:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541420.060946:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6802dae000 going to sleep for 11 seconds 00000100:00100000:3.0:1788541420.061081:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981216512 00000100:00100000:3.0:1788541420.061085:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981216512 00000100:00100000:3.0:1788541420.061106:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788541420.061112:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670690cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+20:24272:x1875420981216512:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788541420.061189:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670690cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+20:24272:x1875420981216512:12345-0@lo:503:mount.lustre.0 Request processed in 77us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541420.061196:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788541420.061275:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e713480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981216512:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788541420.061595:0:24272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788541420.061654:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e713480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981216640:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788541420.061686:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541420.061713:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6802dae000 going to sleep for 11 seconds 00000100:00100000:3.0:1788541420.061810:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981216640 00000100:00100000:3.0:1788541420.061814:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981216640 00000100:00100000:3.0:1788541420.061843:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788541420.061850:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670690ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+20:24272:x1875420981216640:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788541420.061946:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670690ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+20:24272:x1875420981216640:12345-0@lo:502:mount.lustre.0 Request processed in 95us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541420.061952:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788541420.062036:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e713480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981216640:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788541420.062209:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788541420.062232:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788541420.062244:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788541420.062255:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788541420.062267:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1788541420.062281:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1788541420.062308:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1788541420.062319:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1788541420.062342:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1788541420.062356:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1788541420.062370:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1788541420.062391:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e713480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981216768:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788541420.062424:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541420.062487:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6802dae000 going to sleep for 11 seconds 00000100:00100000:3.0:1788541420.067773:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981216768 00000100:00100000:3.0:1788541420.067790:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981216768 00000100:00100000:3.0:1788541420.067852:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788541420.067863:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804595450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+20:24272:x1875420981216768:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788541420.068054:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804595450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+20:24272:x1875420981216768:12345-0@lo:502:mount.lustre.0 Request processed in 193us (5628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541420.068063:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788541420.068195:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e713480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981216768:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788541420.068275:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1788541420.068289:0:24272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788541420.069689:0:24293:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788541420.069701:0:24293:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541420.069703:0:24293:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788541420.069712:0:24293:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a67078de000 00000020:00000080:1.0:1788541420.069714:0:24293:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788541420.069732:0:24293:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788541420.069735:0:24293:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541420.069737:0:24293:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788541420.069739:0:24293:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788541420.069742:0:24293:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541420.069744:0:24293:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788541420.069747:0:24293:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a67078de000 00000020:00000080:1.0:1788541420.069749:0:24293:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788541420.069814:0:24293:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788541420.069817:0:24293:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541420.069819:0:24293:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788541420.069822:0:24293:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788541420.069825:0:24293:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541420.069826:0:24293:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788541420.069830:0:24293:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a67078de000 00000020:00000080:1.0:1788541420.069831:0:24293:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788541420.069850:0:24293:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788541420.069853:0:24293:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541420.069859:0:24293:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788541420.069863:0:24293:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788541420.069866:0:24293:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541420.069867:0:24293:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788541420.069898:0:24293:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a67078de000 00000020:00000080:1.0:1788541420.069900:0:24293:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788541420.069926:0:24293:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788541420.069928:0:24293:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541420.069930:0:24293:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788541420.069932:0:24293:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1788541420.071747:0:24272:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788541420.071788:0:24272:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788541420.071804:0:24272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75ec00/0x2aac941e5f4a92b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a92b7 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541420.071816:0:24272:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a682e75ec00/0x2aac941e5f4a92b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a92b7 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541420.071892:0:24272:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788541420.071895:0:24272:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a67078de000 10000000:01000000:2.0:1788541420.071898:0:24272:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a67078de000 10000000:01000000:2.0:1788541420.071901:0:24272:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788541420.071907:0:24272:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a67078de000 from 1 10000000:01000000:2.0:1788541420.071910:0:24272:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788541420.071947:0:24272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842049800/0x2aac941e5f4a92be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541420.071956:0:24272:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a6842049800/0x2aac941e5f4a92be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541420.071969:0:24272:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a6842049800/0x2aac941e5f4a92be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541420.072000:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e713480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981216896:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788541420.072062:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541420.072102:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6802daee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788541420.074679:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981216896 00000100:00100000:0.0:1788541420.074690:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981216896 00000100:00100000:0.0:1788541420.074758:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788541420.074768:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804597850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+20:24272:x1875420981216896:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788541420.074783:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541420.074801:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a682e75ea00/0x2aac941e5f4a92c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a92be expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541420.074833:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75ea00/0x2aac941e5f4a92c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a92be expref: 21 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541420.074844:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a682e75ea00/0x2aac941e5f4a92c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a92be expref: 21 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541420.074853:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75ea00, rc 0) 00000100:00100000:0.0:1788541420.074934:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804597850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+21:24272:x1875420981216896:12345-0@lo:101:mount.lustre.0 Request processed in 168us (2871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541420.074940:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788541420.075131:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e713480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981216896:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788541420.075153:0:24272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a6842049800/0x2aac941e5f4a92be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a92c5 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541420.075162:0:24272:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a6842049800/0x2aac941e5f4a92be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a92c5 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788541420.078608:0:24272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1788541420.078914:0:24272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788541420.079098:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788541420.079125:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1788541420.079140:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1788541420.079153:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1788541420.079165:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1788541420.079177:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1788541420.079188:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1788541420.079199:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1788541420.079211:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788541420.079223:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1788541420.079237:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1788541420.079249:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1788541420.079274:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1788541420.079289:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1788541420.079302:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1788541420.079318:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1788541420.079328:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1788541420.079350:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1788541420.079364:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1788541420.079376:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1788541420.079388:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1788541420.079399:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1788541420.079411:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1788541420.079424:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1788541420.079438:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1788541420.079449:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1788541420.079460:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1788541420.079472:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1788541420.079497:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1788541420.079511:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1788541420.079525:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1788541420.079536:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1788541420.082680:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1788541420.082739:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1788541420.082758:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1788541420.082772:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1788541420.082784:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1788541420.082797:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1788541420.082811:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1788541420.082824:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1788541420.082837:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1788541420.082850:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1788541420.082864:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1788541420.082895:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1788541420.082923:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1788541420.082938:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1788541420.082952:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1788541420.082966:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1788541420.083138:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1788541420.083157:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1788541420.083183:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1788541420.083189:0:24272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1788541420.083302:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e713480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981217024:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788541420.083385:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541420.083440:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6802dae780 going to sleep for 11 seconds 00000100:00100000:3.0:1788541420.083603:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981217024 00000100:00100000:3.0:1788541420.083611:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981217024 00000100:00100000:3.0:1788541420.083661:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788541420.083672:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804597050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+21:24272:x1875420981217024:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788541420.083803:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804597050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+21:24272:x1875420981217024:12345-0@lo:501:mount.lustre.0 Request processed in 133us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541420.083811:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788541420.086710:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e713480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981217024:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788541420.086783:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e713480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981217152:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788541420.086844:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541420.086892:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6802dae780 going to sleep for 11 seconds 00000100:00100000:3.0:1788541420.087208:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981217152 00000100:00100000:3.0:1788541420.087215:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981217152 00000100:00100000:3.0:1788541420.087264:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788541420.087273:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804594c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+21:24272:x1875420981217152:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788541420.087384:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804594c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+21:24272:x1875420981217152:12345-0@lo:503:mount.lustre.0 Request processed in 112us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541420.087392:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788541420.090861:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e713480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981217152:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788541420.091330:0:24272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788541420.091421:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e713480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981217280:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788541420.091499:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541420.091545:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981217280 00000100:00100000:2.0:1788541420.091550:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981217280 00000100:00100000:2.0:1788541420.091595:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788541420.091605:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804596850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+21:24272:x1875420981217280:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788541420.091697:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804596850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+21:24272:x1875420981217280:12345-0@lo:502:mount.lustre.0 Request processed in 94us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541420.091705:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788541420.094228:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6802daee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788541420.094266:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e713480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981217280:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788541420.094497:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788541420.094527:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1788541420.094541:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1788541420.094581:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1788541420.094595:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1788541420.094610:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1788541420.094639:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1788541420.094654:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1788541420.094669:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788541420.094681:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1788541420.094693:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1788541420.094704:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1788541420.094717:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1788541420.094742:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1788541420.094758:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1788541420.094770:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1788541420.094784:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1788541420.094798:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1788541420.094812:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1788541420.094823:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1788541420.094837:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1788541420.094848:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1788541420.094903:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1788541420.094921:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1788541420.094934:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1788541420.094946:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1788541420.094963:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1788541420.094976:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1788541420.094988:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1788541420.094999:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1788541420.095010:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1788541420.095022:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1788541420.095035:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1788541420.095047:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1788541420.095059:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1788541420.095071:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1788541420.095093:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1788541420.095106:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1788541420.095132:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1788541420.095147:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1788541420.095165:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1788541420.095176:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1788541420.095187:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1788541420.095200:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1788541420.095212:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1788541420.095224:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1788541420.095237:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1788541420.095250:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1788541420.095294:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e713480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981217408:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788541420.095364:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541420.095394:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6802daee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788541420.095575:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981217408 00000100:00100000:0.0:1788541420.095582:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981217408 00000100:00100000:0.0:1788541420.095625:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788541420.095635:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804596450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+21:24272:x1875420981217408:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788541420.095764:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804596450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+21:24272:x1875420981217408:12345-0@lo:502:mount.lustre.0 Request processed in 130us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541420.095771:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788541420.097319:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e713480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981217408:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788541420.097526:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1788541420.098067:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1788541420.098107:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e713480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981217536:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788541420.098179:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541420.098225:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981217536 00000100:00100000:2.0:1788541420.098232:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981217536 00000100:00100000:2.0:1788541420.098274:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788541420.098283:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804596050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+21:24272:x1875420981217536:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788541420.098381:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804596050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+21:24272:x1875420981217536:12345-0@lo:502:mount.lustre.0 Request processed in 98us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541420.098388:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788541420.098425:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6802daee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788541420.098445:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e713480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981217536:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788541420.098482:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1788541420.098490:0:24272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788541420.107063:0:24298:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788541420.107081:0:24298:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9a6831d43380) 00000020:00000080:0.0:1788541420.107104:0:24298:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1788541420.107185:0:24298:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a67078de000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788541420.107190:0:24298:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a67078de000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788541420.107192:0:24298:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a67078de000 3 00010000:00080000:0.0:1788541420.107222:0:24298:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a6815c6c800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.156@tcp at head 00010000:00010000:0.0:1788541420.110719:0:24298:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1788541420.110991:0:24298:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788541420.111034:0:24298:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788541420.111049:0:24298:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2aac941e5f4a92d3 00000100:00080000:0.0:1788541420.111058:0:24298:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788541420.111064:0:24298:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a6815c6c800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:0.0:1788541420.111098:0:24298:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a67088a0380 x1875420981217664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788541420.111123:0:24298:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788541420.111169:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788541420.111173:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788541420.111175:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788541420.111178:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788541420.111198:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788541420.111201:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788541420.111204:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788541420.111207:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788541420.111263:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981217792:0@lo:400:kworker.0 00000100:00100000:0.0:1788541420.111333:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541420.111368:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788541420.111374:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875420981218176:0@lo:400:kworker.0 00000100:00100000:0.0:1788541420.111401:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541420.111601:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875420981217664:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788541420.111631:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541420.111669:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981217920:0@lo:400:kworker.0 00000100:00100000:2.0:1788541420.111691:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541420.111706:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788541420.111711:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981218048:0@lo:400:kworker.0 00000100:00100000:2.0:1788541420.111743:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541420.111778:0:23512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981217792 00000100:00100000:2.0:1788541420.111785:0:23512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981217792 00000100:00100000:2.0:1788541420.111822:0:23512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981218048 00000100:00100000:2.0:1788541420.111825:0:23512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981218048 00000100:00100000:2.0:1788541420.111840:0:23512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788541420.111848:0:23512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981217792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541420.111922:0:23512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981217792:12345-0@lo:400:kworker.0 Request processed in 74us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541420.111931:0:23512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788541420.111947:0:23512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788541420.111953:0:23512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981218048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541420.111984:0:23512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981218048:12345-0@lo:400:kworker.0 Request processed in 32us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541420.111991:0:23512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788541420.112011:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981218176 00000100:00100000:2.0:1788541420.112014:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981218176 00000100:00100000:2.0:1788541420.112080:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981217664 00000100:00100000:2.0:1788541420.112090:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981217664 00000100:00100000:2.0:1788541420.112101:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981217920 00000100:00100000:2.0:1788541420.112104:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981217920 00000100:00100000:2.0:1788541420.112118:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788541420.112124:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875420981218176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541420.112165:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875420981218176:12345-0@lo:400:kworker.0 Request processed in 41us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541420.112171:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788541420.112182:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788541420.112188:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981217920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541420.112211:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981217920:12345-0@lo:400:kworker.0 Request processed in 24us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541420.112216:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788541420.112225:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788541420.112229:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875420981217664:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788541420.112247:0:22771:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 701 last 0 00000020:00000080:2.0:1788541420.112289:0:22771:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2aac941e5f4a92da 00000004:00100000:2.0:1788541420.112306:0:22771:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788541420.112340:0:22771:0:(import.c:65:import_set_state_nolock()) ffff9a6837915800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788541420.112377:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875420981217664:12345-0@lo:38:llog_process_th.0 Request processed in 146us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541420.112383:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788541420.112425:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981218048:0@lo:400:kworker.0 00010000:00080000:2.0:1788541420.112437:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a67088a1880 x1875420981217920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541420.112447:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981217920:0@lo:400:kworker.0 00010000:00080000:2.0:1788541420.112493:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a67088a0380 x1875420981217664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788541430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541420.112501:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788541420.112508:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1788541420.112517:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788541420.112521:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788541420.112524:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6815c6c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788541420.112528:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875420981217664:0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788541420.114888:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a67088a1500 x1875420981218176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541420.114906:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875420981218176:0@lo:400:kworker.0 00000100:00100000:0.0:1788541420.114923:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981217792:0@lo:400:kworker.0 00000020:01000004:0.0:1788541420.115055:0:24298:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788541420.115072:0:24298:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9a6831d419c0) 00000020:00000080:0.0:1788541420.115096:0:24298:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1788541420.115192:0:24298:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a67078de000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788541420.115197:0:24298:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a67078de000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788541420.115199:0:24298:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a67078de000 3 00010000:00080000:0.0:1788541420.115227:0:24298:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a6815c6a800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.156@tcp at head 00010000:00010000:0.0:1788541420.118336:0:24298:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1788541420.118991:0:24298:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1788541420.121014:0:24298:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788541420.121029:0:24298:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x2aac941e5f4a92e8 00000100:00080000:1.0:1788541420.121040:0:24298:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788541420.121046:0:24298:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9a6815c6a800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:1.0:1788541420.121080:0:24298:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6708834700 x1875420981218304/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788541420.121102:0:24298:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788541420.122976:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788541420.122986:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788541420.122988:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788541420.122991:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788541420.122995:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788541420.122998:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788541420.123001:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788541420.123004:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1788541420.127503:0:24298:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000100:00100000:2.0:1788541420.127519:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875420981218304:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788541420.127662:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1788541420.127718:0:24272:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788541420.127762:0:24272:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788541420.127780:0:24272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842049800/0x2aac941e5f4a92be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a92c5 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541420.127790:0:24272:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6842049800/0x2aac941e5f4a92be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a92c5 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788541420.127833:0:24272:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788541420.127835:0:24272:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788541420.127836:0:24272:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788541420.127838:0:24272:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788541420.127839:0:24272:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788541420.127840:0:24272:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788541420.127841:0:24272:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788541420.127843:0:24272:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788541420.127845:0:24272:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788541420.127849:0:24272:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788541420.127851:0:24272:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788541420.127857:0:24272:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788541420.127858:0:24272:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788541420.127859:0:24272:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788541420.127860:0:24272:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788541420.127861:0:24272:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788541420.127862:0:24272:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788541420.127863:0:24272:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788541420.127864:0:24272:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788541420.127904:0:24272:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788541420.127918:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e711c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981218432:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788541420.127950:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541420.127965:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6802dae000 going to sleep for 11 seconds 00000100:00100000:2.0:1788541420.127985:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981218304 00000100:00100000:2.0:1788541420.127992:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981218304 00000100:00100000:2.0:1788541420.128024:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788541420.128031:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875420981218304:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788541420.128055:0:22771:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 701 last 0 00000020:00000080:2.0:1788541420.128085:0:22771:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x2aac941e5f4a92ef 00000004:00100000:2.0:1788541420.128099:0:22771:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788541420.128128:0:22771:0:(import.c:65:import_set_state_nolock()) ffff9a6837911800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788541420.128175:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875420981218304:12345-0@lo:38:llog_process_th.0 Request processed in 143us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541420.128182:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788541420.128204:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981218432 00000100:00100000:2.0:1788541420.128208:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981218432 00000100:00100000:2.0:1788541420.128233:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788541420.128239:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804597c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+21:24272:x1875420981218432:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788541420.128259:0:22766:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788541420.128272:0:22766:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1788541420.128399:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6708834700 x1875420981218304/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788541430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541420.128415:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788541420.128422:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1788541420.128430:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788541420.128434:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788541420.128436:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6815c6a800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788541420.128443:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875420981218304:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1788541420.136642:0:22766:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788541420.136657:0:22766:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788541420.137365:0:22787:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788541420.137371:0:22787:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788541420.137394:0:22787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a92f6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541420.137413:0:22787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6842172000/0x2aac941e5f4a9240 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a9239 expref: 21 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541420.137421:0:22787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a68043cda00/0x2aac941e5f4a924e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a9247 expref: 21 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541420.137429:0:22787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a92f6 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541420.137494:0:22787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a68043cda00/0x2aac941e5f4a924e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a9247 expref: 21 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541420.137510:0:22787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a68043cda00/0x2aac941e5f4a924e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a9247 expref: 21 pid: 22765 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541420.137525:0:22787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708836300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22787:1875420981218560:0@lo:104: 00000100:00100000:1.0:1788541420.137592:0:22787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788541420.137639:0:22787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6842172000/0x2aac941e5f4a9240 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a9239 expref: 21 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541420.137647:0:22787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6842172000/0x2aac941e5f4a9240 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a9239 expref: 21 pid: 22764 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541420.137655:0:22787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708836d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22787:1875420981218688:0@lo:104: 00000100:00100000:1.0:1788541420.137676:0:22787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541420.137691:0:22787:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6808989000 going to sleep for 11 seconds 00000100:00100000:1.0:1788541420.137730:0:22755:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788541420.137747:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981218560 00000100:00100000:1.0:1788541420.137753:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981218560 00000100:00100000:1.0:1788541420.137786:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981218688 00000100:00100000:1.0:1788541420.137788:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981218688 00000100:00100000:1.0:1788541420.137799:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788541420.137807:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708835c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee13e9d8-48fa-4214-b460-99ccd69f1274+4:22787:x1875420981218560:12345-0@lo:104: 00010000:00010000:1.0:1788541420.137820:0:22755:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a682e75fa00/0x2aac941e5f4a9247 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a924e expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541420.137882:0:22755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788541420.137893:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708835c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee13e9d8-48fa-4214-b460-99ccd69f1274+4:22787:x1875420981218560:12345-0@lo:104: Request processed in 86us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541420.137900:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788541420.137914:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788541420.137919:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708319450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee13e9d8-48fa-4214-b460-99ccd69f1274+3:22787:x1875420981218688:12345-0@lo:104: 00010000:00010000:1.0:1788541420.137926:0:22755:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a682e75f400/0x2aac941e5f4a9239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a9240 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541420.137954:0:22755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788541420.137958:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708319450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee13e9d8-48fa-4214-b460-99ccd69f1274+3:22787:x1875420981218688:12345-0@lo:104: Request processed in 40us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541420.137962:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788541420.138011:0:22787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708836300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22787:1875420981218560:0@lo:104: 00000100:00100000:1.0:1788541420.138018:0:22787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708836d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22787:1875420981218688:0@lo:104: 00010000:00010000:1.0:1788541420.138034:0:22787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a92f6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541420.138734:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788541420.138743:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a682e75fa00/0x2aac941e5f4a9247 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a924e expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541420.138750:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75fa00 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:0.0:1788541420.138754:0:22760:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75fa00/0x2aac941e5f4a9247 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a924e expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541420.138774:0:22760:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a682e75fa00/0x2aac941e5f4a9247 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a924e expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788541420.138781:0:22760:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75fa00/0x2aac941e5f4a9247 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a924e expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541420.138786:0:22760:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788541420.138816:0:22760:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a682e75fa00/0x2aac941e5f4a9247 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a924e expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541420.138822:0:22760:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788541420.138837:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a682e75fa00/0x2aac941e5f4a9247 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a924e expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541420.138845:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a682e75fa00/0x2aac941e5f4a9247 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a924e expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541420.138856:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541420.138859:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a682e75f400/0x2aac941e5f4a9239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a9240 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541420.138865:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75f400 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:0.0:1788541420.138887:0:22760:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75f400/0x2aac941e5f4a9239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a9240 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541420.138895:0:22760:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a682e75f400/0x2aac941e5f4a9239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a9240 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788541420.138902:0:22760:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75f400/0x2aac941e5f4a9239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a9240 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541420.138913:0:22760:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788541420.138925:0:22760:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a682e75f400/0x2aac941e5f4a9239 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a9240 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541420.138930:0:22760:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788541420.138944:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a682e75f400/0x2aac941e5f4a9239 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a9240 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541420.138949:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a682e75f400/0x2aac941e5f4a9239 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a9240 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541420.138961:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541420.138962:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541420.138964:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541420.138982:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee13e9d8-48fa-4214-b460-99ccd69f1274:3644:1875420981218816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788541420.139017:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541420.139055:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee13e9d8-48fa-4214-b460-99ccd69f1274:3641:1875420981218944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788541420.139076:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541420.139105:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981218816 00000100:00100000:0.0:1788541420.139110:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981218816 00010000:00010000:0.0:1788541420.139127:0:22758:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a68043cda00/0x2aac941e5f4a924e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a9247 expref: 22 pid: 22765 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541420.139144:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981218944 00000100:00100000:0.0:1788541420.139147:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981218944 00010000:00010000:0.0:1788541420.139156:0:22758:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6842172000/0x2aac941e5f4a9240 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a9239 expref: 23 pid: 22764 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541420.139167:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788541420.139179:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee13e9d8-48fa-4214-b460-99ccd69f1274+23:3644:x1875420981218816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788541420.139188:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541420.139194:0:22758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a68043cda00/0x2aac941e5f4a924e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a9247 expref: 23 pid: 22765 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541420.139204:0:22758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a68043cda00/0x2aac941e5f4a924e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a9247 expref: 23 pid: 22765 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541420.139217:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68043cda00/0x2aac941e5f4a924e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a9247 expref: 23 pid: 22765 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541420.139227:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541420.139254:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee13e9d8-48fa-4214-b460-99ccd69f1274+22:3644:x1875420981218816:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541420.139260:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788541420.139273:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788541420.139279:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee13e9d8-48fa-4214-b460-99ccd69f1274+21:3641:x1875420981218944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788541420.139286:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541420.139289:0:22758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6842172000/0x2aac941e5f4a9240 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a9239 expref: 21 pid: 22764 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541420.139297:0:22758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6842172000/0x2aac941e5f4a9240 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a9239 expref: 21 pid: 22764 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541420.139306:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6842172000/0x2aac941e5f4a9240 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a9239 expref: 21 pid: 22764 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541420.139316:0:22758:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a92f6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541420.139333:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a92f6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788541420.139345:0:22758:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007300579s 00010000:00010000:0.0:1788541420.139350:0:22758:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a92f6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541420.139357:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a92f6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541420.139363:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a92f6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541420.139370:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a92f6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541420.139375:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842172a00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541420.139379:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a92f6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541420.139386:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a92f6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541420.139399:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a92f6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541420.139407:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541420.139433:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee13e9d8-48fa-4214-b460-99ccd69f1274+20:3641:x1875420981218944:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541420.139439:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788541420.139493:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee13e9d8-48fa-4214-b460-99ccd69f1274:3644:1875420981218816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788541420.139513:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee13e9d8-48fa-4214-b460-99ccd69f1274:3641:1875420981218944:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788541420.139525:0:22787:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a92f6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541420.139533:0:22787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a92f6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541420.139538:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a92f6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541420.140325:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541420.140575:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804597c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+19:24272:x1875420981218432:12345-0@lo:253:mount.lustre.0 Request processed in 12334us (12621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541420.140584:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788541420.140747:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e711c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:24272:1875420981218432:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788541420.140758:0:24272:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788541420.140761:0:24272:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788541420.140762:0:24272:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788541420.140764:0:24272:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788541420.140765:0:24272:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788541420.140767:0:24272:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788541420.140768:0:24272:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788541420.140769:0:24272:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788541420.140771:0:24272:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788541420.140772:0:24272:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788541420.140783:0:24272:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:1.0:1788541420.145416:0:24272:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1788541420.149253:0:24272:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788541420.149262:0:24272:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788541420.149296:0:24272:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788541420.149338:0:24272:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.156@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788541420.149357:0:24272:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788541420.149384:0:24272:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1788541420.151173:0:24272:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788541420.151371:0:24272:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788541420.179061:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788541420.950808:0:24352:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788541420.951376:0:24352:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788541421.010338:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788541421.010361:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981219072:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788541421.010444:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541421.010753:0:23512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981219072 00000100:00100000:2.0:1788541421.010761:0:23512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981219072 00000100:00100000:2.0:1788541421.010808:0:23512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788541421.010817:0:23512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981219072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788541421.010848:0:23512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788541421.010922:0:23512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981219072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541421.010929:0:23512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788541421.010956:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788541421.010965:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981219200:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788541421.010993:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541421.011024:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981219200 00000100:00100000:2.0:1788541421.011028:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981219200 00000100:00100000:2.0:1788541421.011050:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788541421.011056:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981219200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788541421.011074:0:22776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788541421.011109:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981219200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541421.011115:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788541421.011155:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981219200:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788541421.011186:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981219072:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788541421.194100:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788541421.642229:0:22768:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788541421.642236:0:22768:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a683533d000 from 13 10000000:01000000:0.0:1788541421.642240:0:22768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788541421.642284:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75f200/0x2aac941e5f4a92fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541421.642293:0:22768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a682e75f200/0x2aac941e5f4a92fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541421.642301:0:22768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a682e75f200/0x2aac941e5f4a92fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541421.642321:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981219328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788541421.642400:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541421.642485:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682e76f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788541421.643972:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981219328 00000100:00100000:2.0:1788541421.643984:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981219328 00000100:00100000:2.0:1788541421.644111:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788541421.644123:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804597450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+19:22768:x1875420981219328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788541421.644140:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541421.644159:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6842049600/0x2aac941e5f4a9304 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a92fd expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541421.644186:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6842049600/0x2aac941e5f4a9304 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a92fd expref: 20 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541421.644198:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6842049600/0x2aac941e5f4a9304 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a92fd expref: 20 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541421.644208:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842049600, rc 0) 00000100:00100000:2.0:1788541421.644315:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804597450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+20:22768:x1875420981219328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (1914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541421.644322:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788541421.644419:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981219328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788541421.644436:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a682e75f200/0x2aac941e5f4a92fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9304 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541421.644445:0:22768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a682e75f200/0x2aac941e5f4a92fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a9304 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541421.644511:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981219456:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788541421.644557:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541421.644841:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682e71a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541421.644951:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981219456 00000100:00100000:0.0:1788541421.644957:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981219456 00000100:00100000:0.0:1788541421.644985:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788541421.644999:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804594850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+20:22768:x1875420981219456:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788541421.645015:0:22765:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788541421.645032:0:22765:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788541421.645035:0:22765:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1788541421.645130:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804594850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+20:22768:x1875420981219456:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541421.645138:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788541421.645216:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981219456:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788541421.645285:0:22768:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788541421.645292:0:22768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75f200/0x2aac941e5f4a92fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9304 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541421.645301:0:22768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a682e75f200/0x2aac941e5f4a92fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9304 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541421.645310:0:22768:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788541421.645313:0:22768:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a682e797000 from 13 10000000:01000000:3.0:1788541421.645315:0:22768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788541421.645346:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68043cc000/0x2aac941e5f4a930b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541421.645354:0:22768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a68043cc000/0x2aac941e5f4a930b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541421.645362:0:22768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a68043cc000/0x2aac941e5f4a930b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541421.645376:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981219584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788541421.645401:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541421.645428:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682e71a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541421.645562:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981219584 00000100:00100000:0.0:1788541421.645567:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981219584 00000100:00100000:0.0:1788541421.645586:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788541421.645593:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804594050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+20:22768:x1875420981219584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788541421.645601:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541421.645610:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a682e75fe00/0x2aac941e5f4a9312 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a930b expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541421.645626:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75fe00/0x2aac941e5f4a9312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a930b expref: 21 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541421.645635:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a682e75fe00/0x2aac941e5f4a9312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a930b expref: 21 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541421.645642:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75fe00, rc 0) 00000100:00100000:0.0:1788541421.645679:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804594050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+21:22768:x1875420981219584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541421.645684:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788541421.645814:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981219584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788541421.645825:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a68043cc000/0x2aac941e5f4a930b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9312 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541421.645846:0:22768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a68043cc000/0x2aac941e5f4a930b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a9312 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541421.645919:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981219712:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788541421.645948:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541421.645966:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682e71a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541421.646022:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981219712 00000100:00100000:0.0:1788541421.646026:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981219712 00000100:00100000:0.0:1788541421.646057:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788541421.646064:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804594450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+21:22768:x1875420981219712:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788541421.646082:0:22765:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788541421.646095:0:22765:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788541421.646098:0:22765:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1788541421.646163:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804594450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+21:22768:x1875420981219712:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 100us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541421.646169:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788541421.647071:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981219712:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788541421.647142:0:22768:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788541421.647151:0:22768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68043cc000/0x2aac941e5f4a930b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9312 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541421.647160:0:22768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a68043cc000/0x2aac941e5f4a930b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9312 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541422.218735:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541423.242393:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788541423.631493:0:22807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788541424.266012:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541425.291492:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788541425.612189:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788541425.612197:0:18310:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788541425.612200:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788541425.612203:0:18310:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788541425.612220:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788541425.612223:0:18310:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788541425.612226:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788541425.612229:0:18310:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788541425.612282:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981219968:0@lo:400:kworker.0 00000100:00100000:0.0:1788541425.612352:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541425.612420:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981220480:0@lo:400:kworker.0 00000100:00100000:0.0:1788541425.612463:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541425.612490:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788541425.612497:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981220096:0@lo:400:kworker.0 00000100:00100000:0.0:1788541425.612521:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541425.612552:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981220608:0@lo:400:kworker.0 00000100:00100000:0.0:1788541425.612577:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541425.612614:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981219968 00000100:00100000:0.0:1788541425.612624:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981219968 00000100:00100000:0.0:1788541425.612689:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788541425.612700:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981219968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541425.612761:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981219968:12345-0@lo:400:kworker.0 Request processed in 64us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541425.612769:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788541425.612801:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981220480 00000100:00100000:0.0:1788541425.612805:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981220480 00000100:00100000:0.0:1788541425.612838:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981220096 00000100:00100000:0.0:1788541425.612841:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981220096 00000100:00100000:0.0:1788541425.612851:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981220608 00000100:00100000:0.0:1788541425.612853:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981220608 00000100:00100000:0.0:1788541425.612865:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788541425.612909:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981220480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541425.612941:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981220480:12345-0@lo:400:kworker.0 Request processed in 34us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541425.612948:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788541425.612960:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788541425.612966:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981220096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541425.612991:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981220096:12345-0@lo:400:kworker.0 Request processed in 26us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541425.612997:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788541425.613007:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788541425.613013:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981220608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541425.613049:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981220608:12345-0@lo:400:kworker.0 Request processed in 36us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541425.613055:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788541425.613094:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788541425.613098:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788541425.613126:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a67088a1c00 x1875420981220096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541425.613140:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981220096:0@lo:400:kworker.0 00010000:00080000:0.0:1788541425.613153:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a67088a1880 x1875420981220608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541425.613161:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981220608:0@lo:400:kworker.0 00000100:00100000:0.0:1788541425.613170:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981219968:0@lo:400:kworker.0 00010000:00080000:0.0:1788541425.613179:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a67088a0380 x1875420981220480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541425.613187:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981220480:0@lo:400:kworker.0 00000100:00100000:1.0:1788541425.613307:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee13e9d8-48fa-4214-b460-99ccd69f1274:3644:1875420981219840:0@lo:400:kworker.0 00000100:00100000:1.0:1788541425.613343:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541425.613371:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875420981220352:0@lo:400:kworker.0 00000100:00100000:1.0:1788541425.613393:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541425.613412:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788541425.613418:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981220224:0@lo:400:kworker.0 00000100:00100000:1.0:1788541425.613440:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541425.613466:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981219840 00000100:00100000:1.0:1788541425.613470:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981219840 00000100:00100000:1.0:1788541425.613497:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788541425.613505:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804595850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+21:3644:x1875420981219840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541425.613538:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804595850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+21:3644:x1875420981219840:12345-0@lo:400:kworker.0 Request processed in 34us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541425.613545:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788541425.613571:0:23512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981220224 00000100:00100000:1.0:1788541425.613574:0:23512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981220224 00000100:00100000:1.0:1788541425.613597:0:23512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788541425.613604:0:23512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981220224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541425.613634:0:23512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981220224:12345-0@lo:400:kworker.0 Request processed in 31us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541425.613641:0:23512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788541425.613667:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981220224:0@lo:400:kworker.0 00000100:00100000:1.0:1788541425.613697:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee13e9d8-48fa-4214-b460-99ccd69f1274:3644:1875420981219840:0@lo:400:kworker.0 00000100:00100000:1.0:1788541425.613728:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981220352 00000100:00100000:1.0:1788541425.613732:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981220352 00000100:00100000:1.0:1788541425.613755:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788541425.613761:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875420981220352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541425.613792:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875420981220352:12345-0@lo:400:kworker.0 Request processed in 31us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541425.613798:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788541425.613820:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a67088a1500 x1875420981220352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541425.613829:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875420981220352:0@lo:400:kworker.0 00000100:00100000:0.0:1788541426.127214:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981220736:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788541426.127295:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541426.127379:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981220736 00000100:00100000:0.0:1788541426.127387:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981220736 00000100:00100000:0.0:1788541426.127434:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788541426.127442:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981220736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788541426.127481:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788541426.127533:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981220736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541426.127559:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788541426.127607:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981220736:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788541426.130972:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788541426.130995:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981220864:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788541426.131064:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541426.132708:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981220864 00000100:00100000:1.0:1788541426.132721:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981220864 00000100:00100000:1.0:1788541426.132784:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788541426.132794:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981220864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788541426.132831:0:22776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788541426.132937:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981220864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 144us (1871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541426.132944:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788541426.132996:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981220864:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788541426.324139:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788541426.990006:0:24643:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg256-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:2.0:1788541427.085722:0:23524:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788541427.341781:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788541428.108310:0:24695:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788541428.108537:0:24695:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788541428.366178:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788541429.135239:0:24745:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788541429.135462:0:24745:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788541429.387363:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541430.347997:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788541415/real 1788541415] req@ffff9a68045f5c00 x1875420981213824/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541430 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541430.348044:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a68045f5c00 x1875420981213824/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541430 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541430.348154:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788541415/real 1788541415] req@ffff9a68045f5f80 x1875420981213952/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541430 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541430.348169:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a68045f5f80 x1875420981213952/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541430 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788541430.348192:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a67082f2000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788541430.348215:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788541430.348219:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981213824:0@lo:8:kworker.0 00000100:00080000:2.0:1788541430.348224:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6837950800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788541430.348229:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788541430.348233:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981213952:0@lo:8:kworker.0 00000100:00080000:1.0:1788541430.349214:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788541430.349220:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788541430.349223:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788541430.349225:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788541430.349274:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788541430.349277:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788541430.349280:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a67082f2000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788541430.349287:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 696 00000100:00080000:1.0:1788541430.349293:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788541430.349300:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9a67082f2000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:1.0:1788541430.349321:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6708836680 x1875420981221504/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788541430.349336:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788541430.349339:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788541430.349341:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a6837950800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788541430.349344:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 696 00000100:00080000:1.0:1788541430.349346:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788541430.349349:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a6837950800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:1.0:1788541430.349360:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6708834700 x1875420981221632/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788541430.349557:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee13e9d8-48fa-4214-b460-99ccd69f1274:3641:1875420981220992:0@lo:400:kworker.0 00000100:00100000:0.0:1788541430.349649:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541430.349715:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788541430.349721:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981221120:0@lo:400:kworker.0 00000100:00100000:0.0:1788541430.349753:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541430.349788:0:23512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981221120 00000100:00100000:0.0:1788541430.349797:0:23512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981221120 00000100:00100000:0.0:1788541430.349844:0:23512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788541430.349854:0:23512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981221120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541430.350412:0:23512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981221120:12345-0@lo:400:kworker.0 Request processed in 558us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541430.350420:0:23512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788541430.350461:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981221120:0@lo:400:kworker.0 00000100:00100000:0.0:1788541430.350501:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981221376:0@lo:400:kworker.0 00000100:00100000:0.0:1788541430.350525:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541430.350866:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788541430.350900:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420981221248:0@lo:400:kworker.0 00000100:00100000:0.0:1788541430.350928:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541430.350955:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981221376 00000100:00100000:0.0:1788541430.350959:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981221376 00000100:00100000:0.0:1788541430.350989:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788541430.350996:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981221376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541430.351044:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981221376:12345-0@lo:400:kworker.0 Request processed in 49us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541430.351060:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788541430.351081:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981221248 00000100:00100000:0.0:1788541430.351085:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981221248 00000100:00100000:0.0:1788541430.351108:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788541430.351114:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420981221248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541430.351143:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420981221248:12345-0@lo:400:kworker.0 Request processed in 29us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541430.351148:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788541430.351174:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6708835880 x1875420981221248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541430.351184:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420981221248:0@lo:400:kworker.0 00000100:00100000:0.0:1788541430.351193:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981221376:0@lo:400:kworker.0 00000100:00100000:0.0:1788541430.351216:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981221504:0@lo:8:kworker.0 00000100:00100000:0.0:1788541430.351240:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541430.351265:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981221632:0@lo:8:kworker.0 00000100:00100000:0.0:1788541430.351283:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541430.351320:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981220992 00000100:00100000:0.0:1788541430.351329:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981220992 00000100:00100000:0.0:1788541430.351352:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788541430.351359:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804595050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+21:3641:x1875420981220992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541430.351386:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804595050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+21:3641:x1875420981220992:12345-0@lo:400:kworker.0 Request processed in 28us (1739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541430.351393:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788541430.351429:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981221760:0@lo:400:kworker.0 00000100:00100000:0.0:1788541430.351450:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541430.351470:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee13e9d8-48fa-4214-b460-99ccd69f1274:3641:1875420981220992:0@lo:400:kworker.0 00000100:00100000:0.0:1788541430.351481:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788541430.351485:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981221888:0@lo:400:kworker.0 00000100:00100000:0.0:1788541430.351502:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541430.351521:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981221760 00000100:00100000:0.0:1788541430.351524:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981221760 00000100:00100000:0.0:1788541430.351542:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981221888 00000100:00100000:0.0:1788541430.351544:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981221888 00000100:00100000:0.0:1788541430.351577:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788541430.351582:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981221760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541430.351612:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981221760:12345-0@lo:400:kworker.0 Request processed in 29us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541430.351618:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788541430.351638:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788541430.351645:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981221888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541430.351681:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981221888:12345-0@lo:400:kworker.0 Request processed in 37us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541430.351687:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788541430.351710:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788541430.351729:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6708837100 x1875420981221888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541430.351739:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981221888:0@lo:400:kworker.0 00010000:00080000:0.0:1788541430.351748:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6708836a00 x1875420981221760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541430.351756:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981221760:0@lo:400:kworker.0 00000100:00100000:2.0:1788541430.352066:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981221504 00000100:00100000:2.0:1788541430.352072:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981221504 00000100:00100000:2.0:1788541430.352096:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981221632 00000100:00100000:2.0:1788541430.352105:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981221632 00000100:00100000:2.0:1788541430.352117:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788541430.352123:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1875420981221504:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788541430.352147:0:24277:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 711 last 0 00000020:00000080:2.0:1788541430.352172:0:24277:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2aac941e5f4a9319 00002000:00100000:2.0:1788541430.352185:0:24277:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9a670667d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788541430.352190:0:24277:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1788541430.352193:0:24277:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788541430.352344:0:24277:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788541430.352377:0:24277:0:(import.c:65:import_set_state_nolock()) ffff9a6706678800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788541430.352419:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1875420981221504:12345-0@lo:8:kworker.0 Request processed in 295us (1178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541430.352425:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788541430.352436:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788541430.352440:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1875420981221632:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788541430.352450:0:24277:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788541430.353388:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788541430.353403:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67082f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875420981222016:0@lo:400:kworker.0 00000100:00100000:0.0:1788541430.353442:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788541430.357273:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6708836680 x1875420981221504/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788541450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541430.357291:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788541430.357302:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788541430.357310:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788541430.357316:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788541430.357319:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a67082f2000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788541430.357342:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788541430.357348:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981221504:0@lo:8:kworker.0 00000004:00080000:0.0:1788541430.357453:0:23513:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788541430.357541:0:23513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 711275669649ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788541430.357558:0:23513:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1788541430.360297:0:23504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1788541430.361152:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981222016 00000100:00100000:1.0:1788541430.361164:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981222016 00000100:00100000:1.0:1788541430.361236:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788541430.361246:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875420981222016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541430.361334:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875420981222016:12345-0@lo:400:kworker.0 Request processed in 89us (7891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541430.361342:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1788541430.361431:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788541430.361529:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a67082f8380 x1875420981222016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541430.361683:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67082f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875420981222016:0@lo:400:kworker.0 00000004:00080000:3.0:1788541430.362178:0:23514:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788541430.362202:0:23514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23514:1875420981222272:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1788541430.362247:0:23514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541430.362271:0:23514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682fdb2480 going to sleep for 11 seconds 00000100:00100000:3.0:1788541430.362292:0:24278:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788541430.362299:0:24278:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788541430.362311:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788541430.362319:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981222144:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788541430.362342:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541430.364959:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981222144 00000100:00100000:3.0:1788541430.364970:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981222144 00000100:00100000:3.0:1788541430.365036:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788541430.365046:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875420981222144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788541430.365143:0:24280:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788541430.365221:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875420981222144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 177us (2877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541430.365228:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788541430.365248:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788541430.365279:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68045f6680 x1875420981222144/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541430.365300:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981222144:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788541430.366929:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981222272 00000100:00100000:1.0:1788541430.366940:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981222272 00000100:00100000:3.0:1788541430.367173:0:24795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788541430.367183:0:24795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23514:x1875420981222272:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:0.0:1788541430.371770:0:24795:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788541430.371780:0:24795:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1788541430.371944:0:24795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23514:x1875420981222272:12345-0@lo:7:osp-pre-0-1.0 Request processed in 4758us (9692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541430.371959:0:24795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788541430.375497:0:23514:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68045f4380 x1875420981222272/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788541446 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541430.375531:0:23514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23514:1875420981222272:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1788541430.375821:0:23514:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:3.0:1788541430.375891:0:23514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23514:1875420981222400:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788541430.375958:0:23514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541430.375996:0:23514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682fdb2480 going to sleep for 11 seconds 00000100:00100000:0.0:1788541430.376131:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981222400 00000100:00100000:0.0:1788541430.376138:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981222400 00000100:00100000:0.0:1788541430.376194:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788541430.376204:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23514:x1875420981222400:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788541430.376235:0:24278:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1788541430.376276:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23514:x1875420981222400:12345-0@lo:5:osp-pre-0-1.0 Request processed in 75us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541430.376283:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788541430.376997:0:23514:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68045f4380 x1875420981222400/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788541446 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541430.377011:0:23514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23514:1875420981222400:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788541430.377022:0:23514:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1788541430.377125:0:23514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23514:1875420981222528:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788541430.377160:0:23514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541430.377190:0:23514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682fdb2480 going to sleep for 11 seconds 00000100:00100000:0.0:1788541430.377233:0:24795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981222528 00000100:00100000:0.0:1788541430.377243:0:24795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981222528 00000100:00100000:0.0:1788541430.377284:0:24795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788541430.377291:0:24795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23514:x1875420981222528:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788541430.377320:0:24795:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:0.0:1788541430.391332:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1875420981221632:12345-0@lo:8:kworker.0 Request processed in 38883us (40041us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788541430.391346:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788541430.391510:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6837950800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788541430.391516:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788541430.391521:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981221632:0@lo:8:kworker.0 00000001:00080000:2.0:1788541430.405366:0:24273:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:2.0:1788541430.405383:0:24273:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788541430.405686:0:24795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23514:x1875420981222528:12345-0@lo:5:osp-pre-0-1.0 Request processed in 28390us (28520us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788541430.405703:0:24795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788541430.405930:0:23514:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68045f4380 x1875420981222528/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788541446 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541430.405945:0:23514:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1788541430.405953:0:23514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23514:1875420981222528:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788541430.405972:0:23514:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:3.0:1788541430.406029:0:23514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23514:1875420981222656:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788541430.406081:0:23514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541430.406105:0:23514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682fdb2480 going to sleep for 11 seconds 00000100:00100000:1.0:1788541430.406238:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981222656 00000100:00100000:1.0:1788541430.406245:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981222656 00000100:00100000:1.0:1788541430.406287:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788541430.406296:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23514:x1875420981222656:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788541430.406353:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23514:x1875420981222656:12345-0@lo:900:osp-pre-0-1.0 Request processed in 57us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541430.406360:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788541430.406425:0:23514:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68045f4380 x1875420981222656/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788541446 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541430.406437:0:23514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23514:1875420981222656:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1788541430.412794:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541431.242865:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788541431.242921:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981222784:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788541431.242997:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541431.243064:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981222784 00000100:00100000:0.0:1788541431.243071:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981222784 00000100:00100000:0.0:1788541431.243118:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788541431.243127:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981222784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788541431.243159:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788541431.243214:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981222784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541431.243221:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788541431.243247:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981222912:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788541431.243271:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541431.243323:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981222784:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788541431.243354:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981222912 00000100:00100000:0.0:1788541431.243357:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981222912 00000100:00100000:0.0:1788541431.243391:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788541431.243397:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981222912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788541431.243415:0:22776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788541431.243956:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981222912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 557us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541431.243976:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788541431.244014:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981222912:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788541431.434058:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541432.462222:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541433.483099:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788541433.868209:0:22807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788541434.512110:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541435.530061:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541435.860112:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981223040:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788541435.860191:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541435.860333:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981223040 00000100:00100000:2.0:1788541435.860343:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981223040 00000100:00080000:3.0:1788541435.860487:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788541435.860521:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788541435.860532:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981223040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788541435.860563:0:24280:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788541435.860630:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981223040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541435.860637:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788541435.860993:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a682e711c00 x1875420981223040/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541435.861012:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981223040:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788541435.861343:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541435.861347:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788541435.861350:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541435.861353:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788541435.861367:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541435.861370:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788541435.861374:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a6837950800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788541435.861378:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 711 00000100:00080000:3.0:1788541435.861383:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788541435.861387:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a6837950800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1788541435.861469:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68045f5f80 x1875420981223680/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788541435.861513:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420981223424:0@lo:400:kworker.0 00000100:00100000:3.0:1788541435.861552:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541435.861575:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875420981224064:0@lo:400:kworker.0 00000100:00100000:3.0:1788541435.861630:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541435.861652:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788541435.861767:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981223296:0@lo:400:kworker.0 00000100:00100000:3.0:1788541435.861797:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541435.861826:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875420981223936:0@lo:400:kworker.0 00000100:00100000:3.0:1788541435.861860:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541435.861915:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981223424 00000100:00100000:3.0:1788541435.861921:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981223424 00000100:00100000:3.0:1788541435.861951:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981224064 00000100:00100000:3.0:1788541435.861955:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981224064 00000100:00100000:3.0:1788541435.861978:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981223936 00000100:00100000:3.0:1788541435.861981:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981223936 00000100:00100000:3.0:1788541435.861999:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788541435.862005:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670917c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420981223424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541435.862046:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670917c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420981223424:12345-0@lo:400:kworker.0 Request processed in 41us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541435.862052:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788541435.862067:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788541435.862073:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670917e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875420981224064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541435.862101:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670917e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875420981224064:12345-0@lo:400:kworker.0 Request processed in 28us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541435.862107:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788541435.862118:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788541435.862124:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670917d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875420981223936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541435.862148:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670917d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875420981223936:12345-0@lo:400:kworker.0 Request processed in 25us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541435.862154:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788541435.862172:0:23512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981223296 00000100:00100000:3.0:1788541435.862176:0:23512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981223296 00000100:00100000:3.0:1788541435.862201:0:23512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788541435.862208:0:23512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670917f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981223296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541435.862241:0:23512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670917f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981223296:12345-0@lo:400:kworker.0 Request processed in 34us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541435.862254:0:23512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788541435.862273:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788541435.862277:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788541435.862299:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981223296:0@lo:400:kworker.0 00010000:00080000:3.0:1788541435.862312:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68045f4e00 x1875420981223936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541435.862323:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875420981223936:0@lo:400:kworker.0 00010000:00080000:3.0:1788541435.862333:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68045f4000 x1875420981223424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541435.862341:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420981223424:0@lo:400:kworker.0 00010000:00080000:3.0:1788541435.862350:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68045f4a80 x1875420981224064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541435.862359:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875420981224064:0@lo:400:kworker.0 00000100:00100000:0.0:1788541435.862609:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981223552:0@lo:400:kworker.0 00000100:00100000:0.0:1788541435.862642:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541435.862890:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788541435.862899:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee13e9d8-48fa-4214-b460-99ccd69f1274:3643:1875420981223168:0@lo:400:kworker.0 00000100:00100000:0.0:1788541435.862936:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541435.862966:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981223808:0@lo:400:kworker.0 00000100:00100000:0.0:1788541435.862988:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541435.863083:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981223680:0@lo:8:kworker.0 00000100:00100000:1.0:1788541435.863115:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541435.863154:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981223808 00000100:00100000:1.0:1788541435.863158:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981223808 00000100:00100000:1.0:1788541435.863184:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788541435.863191:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981223808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541435.863232:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981223808:12345-0@lo:400:kworker.0 Request processed in 41us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541435.863238:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1788541435.863271:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68045f5c00 x1875420981223808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541435.863290:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981223808:0@lo:400:kworker.0 00000100:00100000:0.0:1788541435.864528:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981223680 00000100:00100000:0.0:1788541435.864538:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981223680 00000100:00100000:0.0:1788541435.864567:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788541435.864574:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1875420981223680:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788541435.864605:0:24276:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788541435.864675:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1875420981223680:12345-0@lo:8:kworker.0 Request processed in 99us (1557us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788541435.864682:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788541435.866610:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6837950800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788541435.866622:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788541435.866627:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981223680:0@lo:8:kworker.0 00000100:00100000:3.0:1788541435.866778:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981223168 00000100:00100000:3.0:1788541435.866786:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981223168 00000100:00100000:3.0:1788541435.866840:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788541435.866849:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804596c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+21:3643:x1875420981223168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541435.866952:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804596c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+21:3643:x1875420981223168:12345-0@lo:400:kworker.0 Request processed in 104us (4015us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541435.866960:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788541435.867019:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee13e9d8-48fa-4214-b460-99ccd69f1274:3643:1875420981223168:0@lo:400:kworker.0 00000100:00100000:2.0:1788541435.874026:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981223552 00000100:00100000:2.0:1788541435.874043:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981223552 00000100:00100000:2.0:1788541435.874101:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788541435.874111:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981223552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541435.874208:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981223552:12345-0@lo:400:kworker.0 Request processed in 98us (11564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541435.874215:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788541435.874332:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981223552:0@lo:400:kworker.0 00000100:00100000:0.0:1788541436.362051:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788541436.362077:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981224192:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788541436.362166:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541436.362219:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981224320:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788541436.362234:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981224192 00000100:00100000:0.0:1788541436.362242:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541436.362244:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981224192 00000100:00100000:0.0:1788541436.362272:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981224320 00000100:00100000:0.0:1788541436.362276:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981224320 00000100:00100000:2.0:1788541436.362292:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788541436.362302:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981224192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788541436.362335:0:22776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788541436.362382:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981224192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541436.372514:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788541436.372544:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981224320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788541436.372610:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788541436.372684:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981224320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 148us (10438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541436.372691:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788541436.372757:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981224320:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788541436.372774:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981224192:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788541436.374654:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000020:01000004:1.0:1788541436.513338:0:25091:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788541436.513342:0:25091:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788541436.513343:0:25091:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788541436.513456:0:25091:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a68112db800 00000020:01000004:1.0:1788541436.513472:0:25091:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788541436.513488:0:25091:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788541436.513504:0:25091:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9a6835583380) 00000020:00000080:1.0:1788541436.513522:0:25091:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00010000:00010000:3.0:1788541436.557054:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788541436.618284:0:25091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788541436.619605:0:25091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788541436.619934:0:25091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788541436.622279:0:25091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788541436.622671:0:25091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788541436.622944:0:25091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788541436.623413:0:25091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:3.0:1788541436.639383:0:25091:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788541436.640090:0:25091:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788541436.640107:0:25091:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788541436.640132:0:25091:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2aac941e5f4a9327 00000020:01000004:3.0:1788541436.640139:0:25091:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788541436.640164:0:25091:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.156@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788541436.640167:0:25091:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.156@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788541436.640172:0:25091:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788541436.640201:0:25091:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788541436.640206:0:25091:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.156@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788541436.673845:0:25091:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.156@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788541436.673922:0:25091:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.156@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788541436.673927:0:25091:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788541436.673929:0:25091:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788541436.673931:0:25091:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788541436.673933:0:25091:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788541436.673934:0:25091:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788541436.673936:0:25091:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788541436.673937:0:25091:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788541436.673939:0:25091:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788541436.673941:0:25091:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788541436.673945:0:25091:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788541436.673947:0:25091:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788541436.673948:0:25091:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788541436.673950:0:25091:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788541436.673951:0:25091:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788541436.673952:0:25091:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788541436.673953:0:25091:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788541436.673954:0:25091:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788541436.673955:0:25091:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788541436.673956:0:25091:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788541436.673987:0:25091:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788541436.674011:0:25091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e710e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981224448:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788541436.674102:0:25091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541436.675422:0:25091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68042dd900 going to sleep for 11 seconds 00000100:00100000:0.0:1788541436.675846:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981224448 00000100:00100000:0.0:1788541436.675856:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981224448 00000100:00100000:0.0:1788541436.675948:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788541436.675957:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804595c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+21:25091:x1875420981224448:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788541436.675990:0:22765:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788541436.675993:0:22765:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788541436.675998:0:22765:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788541436.677863:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804595c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+21:25091:x1875420981224448:12345-0@lo:253:mount.lustre.0 Request processed in 1902us (3755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541436.677904:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788541436.678532:0:25091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e710e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981224448:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788541436.678549:0:25091:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788541436.678552:0:25091:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788541436.678565:0:25091:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788541436.678566:0:25091:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788541436.678567:0:25091:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788541436.678568:0:25091:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788541436.678578:0:25091:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788541436.678579:0:25091:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788541436.678588:0:25091:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788541436.678590:0:25091:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788541436.678613:0:25091:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a68112db800 from lustre-OST0001 10000000:01000000:2.0:1788541436.678646:0:25091:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788541436.678649:0:25091:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788541436.678657:0:25091:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a670695b380 local copy 00010000:00010000:2.0:1788541436.678668:0:25091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842173c00/0x2aac941e5f4a9041 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9048 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541436.678767:0:25091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e710e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981224576:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788541436.678812:0:25091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541436.678858:0:25091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68042dd300 going to sleep for 11 seconds 00000100:00100000:3.0:1788541436.678968:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981224576 00000100:00100000:3.0:1788541436.678975:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981224576 00000100:00100000:3.0:1788541436.679026:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788541436.679035:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+21:25091:x1875420981224576:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788541436.679125:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+21:25091:x1875420981224576:12345-0@lo:501:mount.lustre.0 Request processed in 83us (304us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788541436.679133:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788541436.679757:0:25091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e710e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981224576:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788541436.679777:0:25091:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.156@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788541436.679799:0:25091:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.156@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788541436.679806:0:25091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842173c00/0x2aac941e5f4a9041 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9048 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541436.679815:0:25091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6842173c00/0x2aac941e5f4a9041 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9048 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541436.679844:0:25091:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a68112db800 10000000:01000000:2.0:1788541436.679849:0:25091:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788541436.679855:0:25091:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788541436.679857:0:25091:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788541436.679901:0:25091:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788541436.679905:0:25091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788541436.679931:0:25091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551ba00/0x2aac941e5f4a932e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541436.679940:0:25091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a683551ba00/0x2aac941e5f4a932e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541436.679949:0:25091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a683551ba00/0x2aac941e5f4a932e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541436.679965:0:25091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e710e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981224704:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788541436.680000:0:25091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541436.680037:0:25091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68042dd300 going to sleep for 11 seconds 00000100:00100000:0.0:1788541436.680138:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981224704 00000100:00100000:0.0:1788541436.680144:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981224704 00000100:00100000:0.0:1788541436.680186:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788541436.680194:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+21:25091:x1875420981224704:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788541436.680204:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541436.680218:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a682e75f600/0x2aac941e5f4a9335 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a932e expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541436.680241:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75f600/0x2aac941e5f4a9335 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a932e expref: 22 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541436.680259:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a682e75f600/0x2aac941e5f4a9335 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a932e expref: 22 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541436.680268:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75f600, rc 0) 00000100:00100000:0.0:1788541436.680315:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+22:25091:x1875420981224704:12345-0@lo:101:mount.lustre.0 Request processed in 122us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541436.680321:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788541436.680529:0:25091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e710e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981224704:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788541436.680542:0:25091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a683551ba00/0x2aac941e5f4a932e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9335 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541436.680551:0:25091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a683551ba00/0x2aac941e5f4a932e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a9335 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788541436.682326:0:25091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1788541436.684512:0:25091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788541436.684989:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788541436.685019:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788541436.685032:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788541436.685048:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788541436.685062:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788541436.685074:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788541436.685087:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788541436.685112:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1788541436.690147:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:1.0:1788541436.690198:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:1.0:1788541436.690205:0:25091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:1.0:1788541436.690324:0:25091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67082f9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981224832:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541436.690804:0:25091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541436.690861:0:25091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68076fb780 going to sleep for 11 seconds 00000100:00100000:3.0:1788541436.691133:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981224832 00000100:00100000:3.0:1788541436.691142:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981224832 00000100:00100000:3.0:1788541436.691201:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788541436.691210:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+22:25091:x1875420981224832:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788541436.691380:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+22:25091:x1875420981224832:12345-0@lo:501:mount.lustre.0 Request processed in 171us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541436.691388:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788541436.691792:0:25091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67082f9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981224832:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541436.691838:0:25091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67082f9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981224960:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788541436.691933:0:25091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541436.691965:0:25091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68076fb780 going to sleep for 11 seconds 00000100:00100000:3.0:1788541436.692085:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981224960 00000100:00100000:3.0:1788541436.692090:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981224960 00000100:00100000:3.0:1788541436.692134:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788541436.692143:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+22:25091:x1875420981224960:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788541436.693791:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+22:25091:x1875420981224960:12345-0@lo:503:mount.lustre.0 Request processed in 1642us (1851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541436.693802:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788541436.700010:0:25091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67082f9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981224960:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788541436.701406:0:25091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788541436.701976:0:25091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67082fa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981225088:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788541436.702066:0:25091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541436.702178:0:25091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68076fb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788541436.708282:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981225088 00000100:00100000:2.0:1788541436.708298:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981225088 00000100:00100000:2.0:1788541436.708414:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788541436.708426:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+22:25091:x1875420981225088:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788541436.710763:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+22:25091:x1875420981225088:12345-0@lo:502:mount.lustre.0 Request processed in 2328us (8687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541436.710778:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788541436.711080:0:25091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67082fa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981225088:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788541436.711368:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1788541436.711418:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1788541436.711434:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1788541436.711446:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1788541436.711461:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1788541436.711474:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1788541436.711496:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1788541436.711513:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1788541436.711526:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:0.0:1788541436.711565:0:25091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981225216:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788541436.711629:0:25091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541436.729519:0:25091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6807d1d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788541436.730345:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981225216 00000100:00100000:1.0:1788541436.730357:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981225216 00000100:00100000:1.0:1788541436.730425:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788541436.730436:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+22:25091:x1875420981225216:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788541436.730648:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+22:25091:x1875420981225216:12345-0@lo:502:mount.lustre.0 Request processed in 213us (19018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541436.730657:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788541436.731130:0:25091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981225216:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788541436.731223:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:0.0:1788541436.731241:0:25091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1788541436.732355:0:25095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788541436.732367:0:25095:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1788541436.732380:0:25095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541436.732382:0:25095:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788541436.732389:0:25095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788541436.732417:0:25095:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9a67079119c0) 00000020:00000080:0.0:1788541436.732443:0:25095:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788541436.732450:0:25095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788541436.732530:0:25095:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a68112db800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788541436.732538:0:25095:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788541436.732545:0:25095:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2aac941e5f4a9343 00010000:00010000:1.0:1788541436.740895:0:25095:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1788541436.741511:0:25095:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:1.0:1788541436.745054:0:25095:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1788541436.749083:0:25095:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788541436.749099:0:25095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788541436.749108:0:25095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541436.749110:0:25095:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788541436.749127:0:25095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788541436.749150:0:25095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541436.749152:0:25095:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788541436.749156:0:25095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788541436.749158:0:25095:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788541436.749161:0:25095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788541436.749163:0:25095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541436.749164:0:25095:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788541436.749166:0:25095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788541436.749169:0:25095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541436.749170:0:25095:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788541436.749173:0:25095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788541436.749208:0:25095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788541436.749212:0:25095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541436.749213:0:25095:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788541436.749217:0:25095:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:0.0:1788541436.751778:0:25091:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788541436.751828:0:25091:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788541436.751860:0:25091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551ba00/0x2aac941e5f4a932e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9335 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541436.751901:0:25091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a683551ba00/0x2aac941e5f4a932e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9335 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541436.751910:0:25091:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a68112db800 from 1 10000000:01000000:0.0:1788541436.751913:0:25091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788541436.751960:0:25091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a934a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541436.751969:0:25091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a934a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541436.751980:0:25091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a934a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541436.752005:0:25091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981225344:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788541436.752081:0:25091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541436.752129:0:25091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6807d1dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788541436.752270:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981225344 00000100:00100000:1.0:1788541436.752284:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981225344 00000100:00100000:1.0:1788541436.752338:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788541436.752347:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+22:25091:x1875420981225344:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788541436.752361:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541436.752375:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a9351 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a934a expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541436.752410:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a9351 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a934a expref: 23 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541436.752421:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a9351 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a934a expref: 23 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541436.752430:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842172a00, rc 0) 00000100:00100000:1.0:1788541436.752469:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+23:25091:x1875420981225344:12345-0@lo:101:mount.lustre.0 Request processed in 124us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541436.752476:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788541436.753469:0:25091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981225344:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788541436.753503:0:25091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a934a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9351 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541436.753515:0:25091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a934a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a9351 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788541436.755032:0:25091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1788541436.755318:0:25091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788541436.755521:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1788541436.755549:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1788541436.755565:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1788541436.756022:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1788541436.756044:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1788541436.756060:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1788541436.756074:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1788541436.756087:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1788541436.756101:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1788541436.756246:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1788541436.756264:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1788541436.756285:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1788541436.756292:0:25091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1788541436.756377:0:25091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981225472:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788541436.756459:0:25091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541436.756628:0:25091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6807d1db40 going to sleep for 11 seconds 00000100:00100000:1.0:1788541436.761186:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981225472 00000100:00100000:1.0:1788541436.761205:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981225472 00000100:00100000:1.0:1788541436.761268:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788541436.761279:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+23:25091:x1875420981225472:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541436.761500:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+23:25091:x1875420981225472:12345-0@lo:501:mount.lustre.0 Request processed in 212us (5029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541436.761508:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788541436.780399:0:25091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981225472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788541436.780460:0:25091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981225600:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788541436.780532:0:25091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541436.780589:0:25091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682fdb2840 going to sleep for 11 seconds 00000100:00100000:1.0:1788541436.780595:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981225600 00000100:00100000:1.0:1788541436.780602:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981225600 00000100:00100000:1.0:1788541436.780660:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788541436.780670:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+23:25091:x1875420981225600:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788541436.780814:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+23:25091:x1875420981225600:12345-0@lo:503:mount.lustre.0 Request processed in 145us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541436.780822:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788541436.780891:0:25091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981225600:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788541436.781314:0:25091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788541436.781392:0:25091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981225728:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788541436.781433:0:25091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541436.781463:0:25091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682fdb2840 going to sleep for 11 seconds 00000100:00100000:2.0:1788541436.781481:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981225728 00000100:00100000:2.0:1788541436.781487:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981225728 00000100:00100000:2.0:1788541436.781532:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788541436.781540:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+23:25091:x1875420981225728:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788541436.781657:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+23:25091:x1875420981225728:12345-0@lo:502:mount.lustre.0 Request processed in 117us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541436.781665:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788541436.781795:0:25091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981225728:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788541436.782014:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1788541436.782042:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1788541436.782054:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1788541436.782066:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1788541436.782088:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1788541436.782100:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1788541436.782111:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1788541436.782124:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1788541436.782135:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1788541436.782146:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1788541436.782158:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1788541436.782182:0:25091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981225856:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788541436.782220:0:25091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541436.782247:0:25091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6807d1dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788541436.782434:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981225856 00000100:00100000:2.0:1788541436.782440:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981225856 00000100:00100000:2.0:1788541436.782477:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788541436.782495:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+23:25091:x1875420981225856:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788541436.782594:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+23:25091:x1875420981225856:12345-0@lo:502:mount.lustre.0 Request processed in 108us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541436.782601:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788541436.782656:0:25091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981225856:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788541436.782699:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1788541436.782707:0:25091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788541436.783660:0:25099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788541436.783673:0:25099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541436.783684:0:25099:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788541436.783691:0:25099:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a68112db800 00000020:00000080:2.0:1788541436.783694:0:25099:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788541436.783702:0:25099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788541436.783705:0:25099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541436.783706:0:25099:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788541436.783709:0:25099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788541436.783711:0:25099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541436.783713:0:25099:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788541436.783716:0:25099:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a68112db800 00000020:00000080:2.0:1788541436.783718:0:25099:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788541436.786653:0:25099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788541436.790143:0:25099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541436.790151:0:25099:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788541436.790161:0:25099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788541436.790167:0:25099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541436.790169:0:25099:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788541436.790174:0:25099:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a68112db800 00000020:00000080:1.0:1788541436.790176:0:25099:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788541436.790238:0:25099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788541436.790242:0:25099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541436.790243:0:25099:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788541436.790246:0:25099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788541436.790248:0:25099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541436.790250:0:25099:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788541436.790253:0:25099:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a68112db800 00000020:00000080:1.0:1788541436.790255:0:25099:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788541436.790300:0:25099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788541436.790304:0:25099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541436.790305:0:25099:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788541436.790308:0:25099:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1788541436.790468:0:25091:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788541436.790513:0:25091:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788541436.790535:0:25091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a934a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9351 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541436.790547:0:25091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a934a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9351 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541436.790643:0:25091:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788541436.790646:0:25091:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a68112db800 10000000:01000000:2.0:1788541436.790649:0:25091:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a68112db800 10000000:01000000:2.0:1788541436.790653:0:25091:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788541436.790659:0:25091:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a68112db800 from 1 10000000:01000000:2.0:1788541436.790662:0:25091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788541436.790701:0:25091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551be00/0x2aac941e5f4a9358 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541436.790711:0:25091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a683551be00/0x2aac941e5f4a9358 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541436.790743:0:25091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a683551be00/0x2aac941e5f4a9358 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541436.790768:0:25091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e710e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981225984:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788541436.790838:0:25091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541436.790909:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981225984 00000100:00100000:2.0:1788541436.790916:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981225984 00000100:00100000:2.0:1788541436.790978:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788541436.790987:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+23:25091:x1875420981225984:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788541436.791000:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541436.791012:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a683551b000/0x2aac941e5f4a935f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a9358 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541436.791034:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a683551b000/0x2aac941e5f4a935f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a9358 expref: 24 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541436.791044:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a683551b000/0x2aac941e5f4a935f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a9358 expref: 24 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541436.791052:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551b000, rc 0) 00000100:00100000:2.0:1788541436.791087:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+24:25091:x1875420981225984:12345-0@lo:101:mount.lustre.0 Request processed in 101us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541436.791093:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788541436.791148:0:25091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68042dd480 going to sleep for 11 seconds 00000100:00100000:2.0:1788541436.791172:0:25091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e710e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981225984:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788541436.791186:0:25091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a683551be00/0x2aac941e5f4a9358 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a935f expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541436.791204:0:25091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a683551be00/0x2aac941e5f4a9358 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a935f expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788541436.804783:0:25091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1788541436.805104:0:25091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788541436.805320:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788541436.805346:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1788541436.805359:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1788541436.805372:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1788541436.805385:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1788541436.805415:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1788541436.805431:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1788541436.805445:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1788541436.805460:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788541436.805475:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1788541436.805510:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1788541436.805524:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1788541436.805538:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1788541436.805551:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1788541436.805601:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1788541436.805618:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1788541436.805633:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1788541436.805644:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1788541436.805655:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1788541436.805668:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1788541436.805682:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1788541436.805692:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1788541436.805703:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1788541436.805714:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1788541436.805725:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1788541436.805736:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1788541436.805758:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1788541436.805769:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1788541436.805780:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1788541436.805790:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1788541436.805818:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1788541436.805834:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1788541436.805848:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1788541436.805861:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1788541436.805895:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1788541436.805911:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1788541436.805923:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1788541436.805936:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1788541436.805949:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1788541436.805962:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1788541436.805975:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1788541436.805989:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1788541436.806001:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1788541436.806012:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1788541436.806024:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1788541436.806034:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1788541436.806058:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1788541436.806070:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1788541436.806180:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1788541436.806198:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1788541436.806212:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1788541436.806217:0:25091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1788541436.806303:0:25091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e710e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981226112:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788541436.806365:0:25091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541436.806411:0:25091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68042ddb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788541436.806439:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981226112 00000100:00100000:1.0:1788541436.806447:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981226112 00000100:00100000:1.0:1788541436.806504:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788541436.806513:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+24:25091:x1875420981226112:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541436.807103:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+24:25091:x1875420981226112:12345-0@lo:501:mount.lustre.0 Request processed in 590us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541436.807112:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788541436.809170:0:25091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e710e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981226112:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788541436.809224:0:25091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e710e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981226240:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788541436.809291:0:25091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541436.809324:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981226240 00000100:00100000:2.0:1788541436.809330:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981226240 00000100:00100000:2.0:1788541436.809375:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788541436.809384:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+24:25091:x1875420981226240:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788541436.809502:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+24:25091:x1875420981226240:12345-0@lo:503:mount.lustre.0 Request processed in 108us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541436.809509:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788541436.809554:0:25091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68042ddb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788541436.809565:0:25091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e710e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981226240:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788541436.810942:0:25091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788541436.811038:0:25091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e710e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981226368:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788541436.811105:0:25091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541436.811210:0:25091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68042dd480 going to sleep for 11 seconds 00000100:00100000:0.0:1788541436.811738:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981226368 00000100:00100000:0.0:1788541436.811746:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981226368 00000100:00100000:0.0:1788541436.811809:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788541436.811818:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+24:25091:x1875420981226368:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788541436.811957:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+24:25091:x1875420981226368:12345-0@lo:502:mount.lustre.0 Request processed in 139us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541436.811965:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788541436.812173:0:25091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e710e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981226368:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788541436.812827:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788541436.812862:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1788541436.812907:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1788541436.812921:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1788541436.812932:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1788541436.812943:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1788541436.812953:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1788541436.812964:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1788541436.812989:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788541436.813001:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1788541436.813011:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1788541436.813022:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1788541436.813042:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1788541436.813053:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1788541436.813063:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1788541436.813074:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1788541436.813086:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1788541436.813097:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1788541436.813109:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1788541436.813121:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1788541436.813132:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1788541436.813143:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1788541436.813154:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1788541436.813166:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1788541436.813190:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1788541436.813203:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1788541436.813213:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1788541436.813225:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1788541436.813237:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1788541436.813249:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1788541436.813260:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1788541436.813270:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1788541436.813280:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1788541436.813292:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1788541436.813302:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1788541436.813312:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1788541436.813323:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1788541436.813335:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1788541436.813346:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1788541436.813357:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1788541436.813380:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1788541436.813408:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1788541436.813425:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1788541436.813438:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1788541436.813452:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1788541436.813477:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1788541436.813492:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1788541436.813505:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1788541436.813564:0:25091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e710e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981226496:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788541436.813640:0:25091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541436.814720:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981226496 00000100:00100000:0.0:1788541436.814732:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981226496 00000100:00100000:0.0:1788541436.814792:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788541436.814802:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+24:25091:x1875420981226496:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788541436.817004:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+24:25091:x1875420981226496:12345-0@lo:502:mount.lustre.0 Request processed in 2195us (3355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541436.817021:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788541436.817273:0:25091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68042dd480 going to sleep for 11 seconds 00000100:00100000:2.0:1788541436.817307:0:25091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e710e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981226496:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788541436.820364:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1788541436.820557:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1788541436.820627:0:25091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e710e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981226624:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788541436.820705:0:25091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541436.820753:0:25091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68042dd480 going to sleep for 11 seconds 00000100:00100000:3.0:1788541436.826312:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981226624 00000100:00100000:3.0:1788541436.826330:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981226624 00000100:00100000:3.0:1788541436.826402:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788541436.826413:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706b73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+24:25091:x1875420981226624:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788541436.826591:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706b73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+24:25091:x1875420981226624:12345-0@lo:502:mount.lustre.0 Request processed in 179us (5886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541436.826599:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788541436.826900:0:25091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e710e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981226624:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788541436.826985:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1788541436.826998:0:25091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788541436.830025:0:25104:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788541436.830043:0:25104:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9a682fe0b380) 00000020:00000080:3.0:1788541436.830082:0:25104:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1788541436.830174:0:25104:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a68112db800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788541436.830413:0:25104:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a68112db800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788541436.830417:0:25104:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a68112db800 3 00010000:00080000:3.0:1788541436.830456:0:25104:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a670697e000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.156@tcp at head 00010000:00010000:1.0:1788541436.840481:0:25104:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1788541436.840748:0:25104:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788541436.840802:0:25104:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788541436.840817:0:25104:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2aac941e5f4a936d 00000100:00080000:1.0:1788541436.840828:0:25104:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788541436.840834:0:25104:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a670697e000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:1.0:1788541436.840900:0:25104:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a67082f9500 x1875420981226752/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788541436.840924:0:25104:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788541436.840951:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788541436.840956:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788541436.840958:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788541436.840961:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788541436.840996:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788541436.841000:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788541436.841004:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a6837950800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1788541436.841004:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67082f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875420981226752:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788541436.841013:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 716 00000100:00080000:1.0:1788541436.841016:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788541436.841020:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a6837950800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:1.0:1788541436.841036:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a67082f8e00 x1875420981227136/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788541436.841085:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541436.841100:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67082fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981226880:0@lo:400:kworker.0 00000100:00100000:1.0:1788541436.841136:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541436.841151:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67082f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981227136:0@lo:8:kworker.0 00000100:00100000:1.0:1788541436.841160:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67082fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981227520:0@lo:400:kworker.0 00000100:00100000:0.0:1788541436.841194:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541436.841228:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981227136 00000100:00100000:0.0:1788541436.841235:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981227136 00000100:00100000:0.0:1788541436.841265:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788541436.841273:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1875420981227136:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788541436.841333:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1875420981227136:12345-0@lo:8:kworker.0 Request processed in 58us (137us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788541436.841341:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788541436.841371:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788541436.841377:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6837950800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788541436.841380:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788541436.841384:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67082f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981227136:0@lo:8:kworker.0 00000100:00100000:1.0:1788541436.842173:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541436.842212:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67082f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875420981227392:0@lo:400:kworker.0 00000100:00100000:0.0:1788541436.842244:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67082f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981227264:0@lo:400:kworker.0 00000100:00100000:0.0:1788541436.842268:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67082fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981227008:0@lo:400:kworker.0 00000100:00100000:0.0:1788541436.842289:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541436.842337:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981227008 00000100:00100000:0.0:1788541436.842341:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981227008 00000100:00100000:0.0:1788541436.842748:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788541436.842755:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981227008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541436.842798:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981227008:12345-0@lo:400:kworker.0 Request processed in 44us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541436.842805:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788541436.842837:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a67082fa680 x1875420981227008/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541436.842861:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67082fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981227008:0@lo:400:kworker.0 00000020:01000004:0.0:1788541436.843054:0:25104:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788541436.843068:0:25104:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9a6707910000) 00000020:00000080:0.0:1788541436.843088:0:25104:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000100:00100000:3.0:1788541436.844000:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981226752 00000100:00100000:3.0:1788541436.844007:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981226752 00000100:00100000:3.0:1788541436.844030:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981226880 00000100:00100000:3.0:1788541436.844034:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981226880 00000100:00100000:3.0:1788541436.844051:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981227520 00000100:00100000:3.0:1788541436.844054:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981227520 00000100:00100000:3.0:1788541436.844074:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788541436.844083:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981226880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541436.844152:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981226880:12345-0@lo:400:kworker.0 Request processed in 71us (3017us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541436.844159:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788541436.844171:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788541436.844188:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981227520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541436.844217:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981227520:12345-0@lo:400:kworker.0 Request processed in 41us (2047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541436.844223:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788541436.844234:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788541436.844237:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875420981226752:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788541436.844256:0:22771:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 717 last 0 00000020:00000080:3.0:1788541436.844295:0:22771:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2aac941e5f4a937b 00000004:00100000:3.0:1788541436.844311:0:22771:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788541436.844344:0:22771:0:(import.c:65:import_set_state_nolock()) ffff9a670697a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788541436.844542:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875420981226752:12345-0@lo:38:llog_process_th.0 Request processed in 303us (3458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541436.844549:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:0.0:1788541436.844604:0:25104:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a68112db800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788541436.844611:0:25104:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a68112db800 from lustre-OST0001, refs=3 00010000:00080000:3.0:1788541436.844613:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a67082f9500 x1875420981226752/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788541446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:01000004:0.0:1788541436.844615:0:25104:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a68112db800 3 00000100:00100000:3.0:1788541436.844632:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788541436.844641:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1788541436.844649:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00010000:00080000:0.0:1788541436.844650:0:25104:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a6707b93800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.156@tcp at head 00000100:00080000:3.0:1788541436.844656:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788541436.844659:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a670697e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788541436.844666:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67082f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875420981226752:0@lo:38:llog_process_th.0 00010000:00010000:0.0:1788541436.850554:0:25104:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00010000:00080000:1.0:1788541436.850940:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a67082fb800 x1875420981226880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541436.850976:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67082fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981226880:0@lo:400:kworker.0 00010000:00080000:1.0:1788541436.850993:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a67082fbb80 x1875420981227520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541436.851003:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67082fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981227520:0@lo:400:kworker.0 00000100:00100000:1.0:1788541436.851040:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541436.851094:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981227392 00000100:00100000:1.0:1788541436.851101:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981227392 00000100:00100000:1.0:1788541436.851143:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788541436.851153:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875420981227392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541436.851333:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875420981227392:12345-0@lo:400:kworker.0 Request processed in 182us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541436.851341:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788541436.851447:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a67082f9c00 x1875420981227392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541436.851456:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67082f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875420981227392:0@lo:400:kworker.0 00000100:00100000:1.0:1788541436.851476:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541436.851507:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981227264 00000100:00100000:1.0:1788541436.851511:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981227264 00000100:00100000:1.0:1788541436.851536:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788541436.851543:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981227264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541436.851594:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981227264:12345-0@lo:400:kworker.0 Request processed in 51us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541436.851601:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788541436.851639:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a67082f9f80 x1875420981227264/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541436.851649:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67082f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981227264:0@lo:400:kworker.0 00000020:00000080:1.0:1788541436.854063:0:25104:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788541436.854123:0:25104:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788541436.854138:0:25104:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x2aac941e5f4a9382 00000100:00080000:1.0:1788541436.854149:0:25104:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788541436.854156:0:25104:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9a6707b93800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:1.0:1788541436.854263:0:25104:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a67082f9f80 x1875420981227648/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788541436.854307:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67082f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875420981227648:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788541436.854436:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541436.854501:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981227648 00000100:00100000:1.0:1788541436.854507:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981227648 00000100:00100000:1.0:1788541436.854534:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788541436.854541:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875420981227648:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788541436.854565:0:22773:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 717 last 0 00000020:00000080:1.0:1788541436.854604:0:22773:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x2aac941e5f4a9389 00000004:00100000:1.0:1788541436.854618:0:22773:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788541436.854647:0:22773:0:(import.c:65:import_set_state_nolock()) ffff9a6706a47800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788541436.854701:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875420981227648:12345-0@lo:38:llog_process_th.0 Request processed in 159us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541436.854708:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788541436.854729:0:25104:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788541436.854748:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788541436.854760:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788541436.854762:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788541436.854765:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1788541436.854934:0:25104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00010000:00080000:3.0:1788541436.857272:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a67082f9f80 x1875420981227648/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788541446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541436.857289:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788541436.857299:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1788541436.857307:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788541436.857312:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788541436.857315:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6707b93800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788541436.857322:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67082f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875420981227648:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1788541436.857356:0:25091:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788541436.857463:0:25091:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788541436.857483:0:25091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551be00/0x2aac941e5f4a9358 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a935f expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541436.857674:0:25091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a683551be00/0x2aac941e5f4a9358 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a935f expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788541436.857731:0:25091:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788541436.857734:0:25091:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788541436.857736:0:25091:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788541436.857741:0:25091:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788541436.857742:0:25091:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788541436.857744:0:25091:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788541436.857745:0:25091:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788541436.857746:0:25091:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788541436.857747:0:25091:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788541436.857752:0:25091:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788541436.857754:0:25091:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788541436.857755:0:25091:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788541436.857756:0:25091:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788541436.857757:0:25091:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788541436.857758:0:25091:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788541436.857759:0:25091:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788541436.857759:0:25091:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788541436.857760:0:25091:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788541436.857761:0:25091:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788541436.857786:0:25091:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788541436.857804:0:25091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981227776:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788541436.857895:0:25091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541436.857939:0:25091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68352ef540 going to sleep for 11 seconds 00000100:00100000:2.0:1788541436.862328:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981227776 00000100:00100000:2.0:1788541436.862343:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981227776 00000100:00100000:2.0:1788541436.862478:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788541436.862721:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706b72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+24:25091:x1875420981227776:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788541436.862761:0:22764:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788541436.862776:0:22764:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788541436.876305:0:22764:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788541436.876320:0:22764:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788541436.876366:0:22787:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788541436.876371:0:22787:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788541436.876393:0:22787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a9390 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541436.876413:0:22787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6842049600/0x2aac941e5f4a9304 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a92fd expref: 24 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541436.876420:0:22787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a682e75fe00/0x2aac941e5f4a9312 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a930b expref: 24 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541436.876428:0:22787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a9390 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541436.876469:0:22787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a682e75fe00/0x2aac941e5f4a9312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a930b expref: 24 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541436.876484:0:22787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a682e75fe00/0x2aac941e5f4a9312 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a930b expref: 24 pid: 22765 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541436.876510:0:22787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a0380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22787:1875420981227904:0@lo:104: 00000100:00100000:0.0:1788541436.876595:0:22787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788541436.876646:0:22787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6842049600/0x2aac941e5f4a9304 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a92fd expref: 24 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541436.876655:0:22787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6842049600/0x2aac941e5f4a9304 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a92fd expref: 24 pid: 22764 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541436.876675:0:22787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22787:1875420981228032:0@lo:104: 00000100:00100000:0.0:1788541436.876698:0:22787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541436.876721:0:22787:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67069b29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788541436.876739:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981227904 00000100:00100000:3.0:1788541436.876747:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981227904 00000100:00100000:3.0:1788541436.876783:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981228032 00000100:00100000:3.0:1788541436.876786:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981228032 00000100:00100000:3.0:1788541436.876799:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788541436.876808:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee13e9d8-48fa-4214-b460-99ccd69f1274+4:22787:x1875420981227904:12345-0@lo:104: 00010000:00010000:3.0:1788541436.876823:0:22755:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a68043cc000/0x2aac941e5f4a930b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a9312 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541436.876932:0:22755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788541436.876940:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee13e9d8-48fa-4214-b460-99ccd69f1274+4:22787:x1875420981227904:12345-0@lo:104: Request processed in 132us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541436.876948:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788541436.876968:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788541436.876983:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee13e9d8-48fa-4214-b460-99ccd69f1274+3:22787:x1875420981228032:12345-0@lo:104: 00010000:00010000:3.0:1788541436.876991:0:22755:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a682e75f200/0x2aac941e5f4a92fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a9304 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541436.877029:0:22755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788541436.877034:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee13e9d8-48fa-4214-b460-99ccd69f1274+3:22787:x1875420981228032:12345-0@lo:104: Request processed in 55us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541436.877052:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788541436.877069:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788541436.877075:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541436.877077:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a68043cc000/0x2aac941e5f4a930b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a9312 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541436.877086:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68043cc000 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:3.0:1788541436.877090:0:22760:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a68043cc000/0x2aac941e5f4a930b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a9312 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541436.877097:0:22760:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a68043cc000/0x2aac941e5f4a930b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a9312 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788541436.877104:0:22760:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a68043cc000/0x2aac941e5f4a930b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a9312 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541436.877109:0:22760:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788541436.877142:0:22760:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a68043cc000/0x2aac941e5f4a930b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a9312 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541436.877149:0:22760:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788541436.877170:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a68043cc000/0x2aac941e5f4a930b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a9312 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541436.877189:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a68043cc000/0x2aac941e5f4a930b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a9312 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541436.877202:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541436.877204:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541436.877206:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541436.877215:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788541436.877227:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee13e9d8-48fa-4214-b460-99ccd69f1274:3641:1875420981228160:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788541436.877228:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541436.877237:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a682e75f200/0x2aac941e5f4a92fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a9304 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541436.877250:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75f200 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:1.0:1788541436.877254:0:22761:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75f200/0x2aac941e5f4a92fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a9304 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541436.877262:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788541436.877266:0:22761:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a682e75f200/0x2aac941e5f4a92fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a9304 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788541436.877275:0:22761:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75f200/0x2aac941e5f4a92fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a9304 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788541436.877281:0:22761:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788541436.877305:0:22761:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a682e75f200/0x2aac941e5f4a92fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a9304 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541436.877312:0:22761:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788541436.877338:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a682e75f200/0x2aac941e5f4a92fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a9304 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541436.877345:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a682e75f200/0x2aac941e5f4a92fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a9304 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541436.877439:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541436.877442:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541436.877444:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541436.877458:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788541436.877469:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67082fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee13e9d8-48fa-4214-b460-99ccd69f1274:3644:1875420981228288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788541436.877505:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541436.877509:0:22787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a0380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22787:1875420981227904:0@lo:104: 00000100:00100000:0.0:1788541436.877524:0:22787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22787:1875420981228032:0@lo:104: 00010000:00010000:1.0:1788541436.877537:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541436.877541:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541436.877546:0:22787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a9390 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541436.877745:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981228160 00000100:00100000:0.0:1788541436.877750:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981228160 00010000:00010000:0.0:1788541436.877768:0:22757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a682e75fe00/0x2aac941e5f4a9312 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a930b expref: 25 pid: 22765 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541436.877785:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981228288 00000100:00100000:0.0:1788541436.877788:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981228288 00010000:00010000:0.0:1788541436.877799:0:22757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6842049600/0x2aac941e5f4a9304 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a92fd expref: 26 pid: 22764 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541436.877812:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788541436.877818:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670917dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee13e9d8-48fa-4214-b460-99ccd69f1274+26:3641:x1875420981228160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788541436.877836:0:22757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541436.877841:0:22757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a682e75fe00/0x2aac941e5f4a9312 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a930b expref: 26 pid: 22765 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541436.877851:0:22757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a682e75fe00/0x2aac941e5f4a9312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a930b expref: 26 pid: 22765 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541436.877864:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a682e75fe00/0x2aac941e5f4a9312 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a930b expref: 26 pid: 22765 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541436.877908:0:22757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541436.877941:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670917dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee13e9d8-48fa-4214-b460-99ccd69f1274+25:3641:x1875420981228160:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541436.877949:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788541436.877963:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788541436.877969:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee13e9d8-48fa-4214-b460-99ccd69f1274+24:3644:x1875420981228288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788541436.877976:0:22757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541436.877980:0:22757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6842049600/0x2aac941e5f4a9304 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a92fd expref: 24 pid: 22764 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541436.877987:0:22757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6842049600/0x2aac941e5f4a9304 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a92fd expref: 24 pid: 22764 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541436.877996:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6842049600/0x2aac941e5f4a9304 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a92fd expref: 24 pid: 22764 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541436.878006:0:22757:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a9390 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541436.878013:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a9390 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788541436.878031:0:22757:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007300579s 00010000:00010000:0.0:1788541436.878035:0:22757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a9390 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541436.878042:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a9390 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541436.878049:0:22757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a9390 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541436.878057:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a9390 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541436.878062:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75e200 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541436.878066:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a9390 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541436.878072:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a9390 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541436.878085:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a9390 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541436.878094:0:22757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541436.878839:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee13e9d8-48fa-4214-b460-99ccd69f1274+23:3644:x1875420981228288:12345-0@lo:103:ldlm_bl.0 Request processed in 865us (1330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541436.878848:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788541436.878901:0:22787:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a9390 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541436.878921:0:22787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a9390 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541436.878928:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a9390 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541436.878963:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67082fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee13e9d8-48fa-4214-b460-99ccd69f1274:3644:1875420981228288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788541436.880491:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee13e9d8-48fa-4214-b460-99ccd69f1274:3641:1875420981228160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788541436.881729:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706b72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+22:25091:x1875420981227776:12345-0@lo:253:mount.lustre.0 Request processed in 19237us (23853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541436.881742:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788541436.881826:0:25091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee13e9d8-48fa-4214-b460-99ccd69f1274:25091:1875420981227776:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788541436.881842:0:25091:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788541436.881845:0:25091:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788541436.881846:0:25091:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788541436.881848:0:25091:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788541436.881849:0:25091:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788541436.881850:0:25091:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788541436.881851:0:25091:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788541436.881853:0:25091:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788541436.881854:0:25091:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788541436.881856:0:25091:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788541436.881895:0:25091:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:0.0:1788541436.893858:0:25091:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1788541436.897586:0:25091:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788541436.897596:0:25091:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788541436.897639:0:25091:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788541436.897696:0:25091:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.156@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788541436.897714:0:25091:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1788541436.897738:0:25091:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1788541436.911217:0:25091:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788541436.911617:0:25091:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1788541437.325250:0:23524:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788541437.580471:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788541437.746552:0:25159:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788541437.747075:0:25159:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788541437.898859:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788541416/real 1788541416] req@ffff9a682e712300 x1875420981214720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541436 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541437.898906:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a682e712300 x1875420981214720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541436 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541437.898916:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788541416/real 1788541416] req@ffff9a682e713800 x1875420981214848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541436 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541437.898936:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a682e713800 x1875420981214848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541436 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788541437.898955:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a682fdc6800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788541437.898974:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788541437.898978:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981214720:0@lo:8:kworker.0 00000100:00080000:3.0:1788541437.898984:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a68398d5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788541437.898989:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788541437.898992:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981214848:0@lo:8:kworker.0 00000100:00080000:3.0:1788541437.899080:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541437.899084:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788541437.899086:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a682fdc6800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788541437.899090:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 697 00000100:00080000:3.0:1788541437.899096:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788541437.899103:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a682fdc6800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1788541437.899123:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a670917f800 x1875420981228672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788541437.899136:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541437.899139:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788541437.899140:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a68398d5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788541437.899143:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 697 00000100:00080000:3.0:1788541437.899145:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788541437.899148:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a68398d5000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1788541437.899158:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a670917e680 x1875420981228800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788541437.899190:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541437.899194:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788541437.899195:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a6837950800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788541437.899200:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a6837950800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1788541437.899210:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a670917c380 x1875420981229312/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788541437.899274:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee13e9d8-48fa-4214-b460-99ccd69f1274:3644:1875420981228416:0@lo:400:kworker.0 00000100:00100000:3.0:1788541437.899339:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541437.899373:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981229184:0@lo:400:kworker.0 00000100:00100000:3.0:1788541437.899397:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541437.899416:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875420981229824:0@lo:400:kworker.0 00000100:00100000:3.0:1788541437.899437:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541437.899459:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788541437.899464:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981229056:0@lo:400:kworker.0 00000100:00100000:3.0:1788541437.899486:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541437.899503:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875420981229696:0@lo:400:kworker.0 00000100:00100000:3.0:1788541437.899521:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541437.899545:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981228544:0@lo:400:kworker.0 00000100:00100000:3.0:1788541437.899577:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541437.899592:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981229440:0@lo:400:kworker.0 00000100:00100000:3.0:1788541437.899608:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541437.899726:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875420981229952:0@lo:400:kworker.0 00000100:00100000:3.0:1788541437.899753:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541437.899773:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788541437.899779:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981228928:0@lo:400:kworker.0 00000100:00100000:3.0:1788541437.899799:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541437.899809:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981229568:0@lo:400:kworker.0 00000100:00100000:3.0:1788541437.899825:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541437.899849:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981229184 00000100:00100000:3.0:1788541437.899855:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981229184 00000100:00100000:3.0:1788541437.899930:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788541437.899938:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981229184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541437.899981:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981229184:12345-0@lo:400:kworker.0 Request processed in 45us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541437.899988:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788541437.900008:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981229824 00000100:00100000:3.0:1788541437.900010:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981229824 00000100:00100000:3.0:1788541437.900026:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981229696 00000100:00100000:3.0:1788541437.900029:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981229696 00000100:00100000:3.0:1788541437.900038:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981229440 00000100:00100000:3.0:1788541437.900041:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981229440 00000100:00100000:3.0:1788541437.900048:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981229952 00000100:00100000:3.0:1788541437.900051:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981229952 00000100:00100000:3.0:1788541437.900061:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981228928 00000100:00100000:3.0:1788541437.900063:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981228928 00000100:00100000:3.0:1788541437.900071:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981229568 00000100:00100000:3.0:1788541437.900073:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981229568 00000100:00100000:3.0:1788541437.900084:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788541437.900090:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875420981229824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541437.900118:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875420981229824:12345-0@lo:400:kworker.0 Request processed in 28us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541437.900125:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788541437.900142:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788541437.900148:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875420981229696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541437.900175:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875420981229696:12345-0@lo:400:kworker.0 Request processed in 28us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541437.900181:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788541437.900190:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788541437.900196:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981229440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541437.900225:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981229440:12345-0@lo:400:kworker.0 Request processed in 29us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541437.900231:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788541437.900241:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788541437.900245:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875420981229952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541437.900268:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875420981229952:12345-0@lo:400:kworker.0 Request processed in 22us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541437.900273:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788541437.900282:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788541437.900287:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981228928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541437.900310:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981228928:12345-0@lo:400:kworker.0 Request processed in 23us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541437.900316:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788541437.900327:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788541437.900333:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f2cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981229568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541437.900357:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f2cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981229568:12345-0@lo:400:kworker.0 Request processed in 25us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541437.900362:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788541437.900386:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981229056 00000100:00100000:3.0:1788541437.900390:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981229056 00000100:00100000:3.0:1788541437.900411:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981228544 00000100:00100000:3.0:1788541437.900413:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981228544 00000100:00100000:3.0:1788541437.900424:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788541437.900429:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981229056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541437.900458:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981229056:12345-0@lo:400:kworker.0 Request processed in 29us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541437.900465:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788541437.900476:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788541437.900482:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981228544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541437.900521:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981228544:12345-0@lo:400:kworker.0 Request processed in 40us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541437.900527:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1788541437.900547:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788541437.900550:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788541437.900552:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541437.900599:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981228672:0@lo:8:kworker.0 00000100:00100000:3.0:1788541437.901704:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541437.901755:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981228800:0@lo:8:kworker.0 00000100:00100000:3.0:1788541437.901793:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541437.901812:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981229312:0@lo:8:kworker.0 00000100:00100000:3.0:1788541437.901854:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541437.901907:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981228672 00000100:00100000:3.0:1788541437.901912:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981228672 00000100:00100000:3.0:1788541437.901935:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981228800 00000100:00100000:3.0:1788541437.901937:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981228800 00000100:00100000:3.0:1788541437.901945:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981229312 00000100:00100000:3.0:1788541437.901953:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981229312 00000100:00100000:3.0:1788541437.901967:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788541437.901972:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f2cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1875420981228672:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788541437.901999:0:24278:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 718 last 0 00000020:00000080:3.0:1788541437.902026:0:24278:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2aac941e5f4a9397 00002000:00100000:3.0:1788541437.902040:0:24278:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9a670697f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788541437.902044:0:24278:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788541437.902046:0:24278:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788541437.902129:0:24278:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788541437.902154:0:24278:0:(import.c:65:import_set_state_nolock()) ffff9a6706978800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788541437.902198:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f2cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1875420981228672:12345-0@lo:8:kworker.0 Request processed in 224us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541437.902206:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788541437.902221:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788541437.902225:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f2cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1875420981228800:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788541437.902240:0:24278:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 718 last 0 00000020:00000080:3.0:1788541437.902254:0:24278:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2aac941e5f4a939e 00002000:00100000:3.0:1788541437.902259:0:24278:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9a670697d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788541437.902263:0:24278:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788541437.902265:0:24278:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788541437.902400:0:24278:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788541437.902413:0:24278:0:(import.c:65:import_set_state_nolock()) ffff9a670697b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788541437.902440:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f2cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1875420981228800:12345-0@lo:8:kworker.0 Request processed in 213us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541437.902446:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788541437.902459:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788541437.902470:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f2ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1875420981229312:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788541437.902483:0:24278:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 718 last 0 00000020:00000080:3.0:1788541437.902500:0:24278:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2aac941e5f4a93a5 00002000:00100000:3.0:1788541437.902505:0:24278:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9a670697d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788541437.902508:0:24278:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1788541437.902510:0:24278:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788541437.902530:0:24278:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788541437.902541:0:24278:0:(import.c:65:import_set_state_nolock()) ffff9a6706979800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788541437.902582:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f2ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3640:x1875420981229312:12345-0@lo:8:kworker.0 Request processed in 110us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541437.902587:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788541437.902631:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670917ca80 x1875420981228928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541437.902741:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981228416 00000100:00100000:2.0:1788541437.902746:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981228416 00000100:00100000:2.0:1788541437.902787:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788541437.902794:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706b72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+22:3644:x1875420981228416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541437.902834:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706b72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+22:3644:x1875420981228416:12345-0@lo:400:kworker.0 Request processed in 41us (3495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541437.902839:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788541437.903950:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981229056:0@lo:400:kworker.0 00010000:00080000:2.0:1788541437.903965:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670917ed80 x1875420981229696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541437.903975:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875420981229696:0@lo:400:kworker.0 00000100:00100000:2.0:1788541437.903983:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee13e9d8-48fa-4214-b460-99ccd69f1274:3644:1875420981228416:0@lo:400:kworker.0 00010000:00080000:2.0:1788541437.903993:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670917d180 x1875420981229184/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541437.904001:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981229184:0@lo:400:kworker.0 00010000:00080000:2.0:1788541437.904014:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670917df80 x1875420981229824/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541437.904022:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875420981229824:0@lo:400:kworker.0 00000100:00100000:3.0:1788541437.904744:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981228928:0@lo:400:kworker.0 00010000:00080000:3.0:1788541437.904765:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670917d880 x1875420981229568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541437.904773:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981229568:0@lo:400:kworker.0 00000100:00100000:3.0:1788541437.904785:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981228544:0@lo:400:kworker.0 00010000:00080000:3.0:1788541437.904796:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670917fb80 x1875420981229440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541437.904805:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981229440:0@lo:400:kworker.0 00010000:00080000:3.0:1788541437.904817:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670917f100 x1875420981229952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541437.904837:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875420981229952:0@lo:400:kworker.0 00010000:00080000:3.0:1788541437.905771:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670917f800 x1875420981228672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788541462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541437.905781:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788541437.905790:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788541437.905798:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788541437.905803:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788541437.905807:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a682fdc6800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788541437.905835:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788541437.905842:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981228672:0@lo:8:kworker.0 00010000:00080000:3.0:1788541437.905856:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670917e680 x1875420981228800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788541462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541437.905864:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788541437.905884:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788541437.905889:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788541437.905892:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788541437.905894:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a68398d5000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788541437.905909:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788541437.905913:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981228800:0@lo:8:kworker.0 00010000:00080000:3.0:1788541437.905928:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670917c380 x1875420981229312/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788541462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788541437.905937:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788541437.905942:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788541437.905944:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788541437.905953:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6837950800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788541437.905963:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788541437.905967:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981229312:0@lo:8:kworker.0 00000004:00080000:3.0:1788541437.905996:0:22795:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788541437.906080:0:22795:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 718824209344ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788541437.906086:0:22795:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1788541437.906105:0:22797:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788541437.906130:0:22797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 718824259594ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788541437.906134:0:22797:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1788541437.906178:0:23516:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788541437.906200:0:23516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f2cce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23516:1875420981230208:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788541437.906255:0:23516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541437.906279:0:23516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a681084bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788541437.906417:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f2cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981230080:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788541437.906444:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541437.906474:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981230208 00000100:00100000:3.0:1788541437.906480:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981230208 00000100:00100000:3.0:1788541437.906525:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788541437.906533:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f2cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23516:x1875420981230208:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1788541437.906761:0:22796:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:2.0:1788541437.906776:0:22796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e710380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22796:1875420981230464:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788541437.906807:0:22796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541437.906823:0:22796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68042dd3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788541437.906837:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981230080 00000100:00100000:2.0:1788541437.906840:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981230080 00000100:00100000:2.0:1788541437.906867:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788541437.906887:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f2cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3642:x1875420981230080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788541437.906901:0:24280:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915866112 avail 3684343808 00000100:00100000:2.0:1788541437.906953:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f2cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3642:x1875420981230080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541437.906960:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788541437.906981:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981230336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788541437.907003:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541437.907022:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981230336 00000100:00100000:2.0:1788541437.907025:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981230336 00000100:00100000:2.0:1788541437.907042:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788541437.907047:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875420981230336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788541437.907061:0:24280:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788541437.907084:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875420981230336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (81us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541437.907089:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788541437.907111:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a682e710e00 x1875420981230336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541437.907127:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981230336:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788541437.907152:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a683f2cf800 x1875420981230080/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541437.907163:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f2cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981230080:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788541437.907180:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981230464 00000100:00100000:2.0:1788541437.907184:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981230464 00000100:00100000:2.0:1788541437.907203:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788541437.907209:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22796:x1875420981230464:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788541437.908466:0:24277:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1788541437.908474:0:24277:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:2.0:1788541437.908479:0:24277:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:65) 00000004:00080000:0.0:1788541437.909199:0:22798:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:0.0:1788541437.909224:0:22798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22798:1875420981230720:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788541437.909274:0:22798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541437.909295:0:22798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67069b2540 going to sleep for 11 seconds 00000004:00080000:0.0:1788541437.909310:0:23515:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788541437.909380:0:23515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 718827508725ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788541437.909765:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981230592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788541437.909799:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:00080000:0.0:1788541437.912187:0:23515:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788541437.913194:0:24276:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788541437.913207:0:24276:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00080000:3.0:1788541437.913224:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788541437.913229:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788541437.913252:0:22752:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1788541437.913265:0:22752:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788541437.916750:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981230720 00000100:00100000:3.0:1788541437.916768:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981230720 00000100:00080000:3.0:1788541437.916849:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788541437.916958:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788541437.916976:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:22798:x1875420981230720:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788541437.917733:0:23504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:3.0:1788541437.922547:0:24278:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788541437.922567:0:24278:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788541437.924959:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f2cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23516:x1875420981230208:12345-0@lo:7:osp-pre-1-1.0 Request processed in 18417us (18693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541437.924986:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788541437.925065:0:23516:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a683f2cce00 x1875420981230208/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788541453 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541437.925080:0:23516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f2cce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23516:1875420981230208:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1788541437.925095:0:23516:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788541437.925145:0:23516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f2cce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23516:1875420981230848:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788541437.925197:0:23516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541437.925222:0:23516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a681084bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788541437.925240:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981230848 00000100:00100000:3.0:1788541437.925246:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981230848 00000100:00100000:3.0:1788541437.925286:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788541437.925296:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f2cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23516:x1875420981230848:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788541437.925322:0:24276:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1788541437.925356:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f2cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23516:x1875420981230848:12345-0@lo:5:osp-pre-1-1.0 Request processed in 63us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541437.925362:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788541437.925383:0:23516:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a683f2cce00 x1875420981230848/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788541453 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541437.925392:0:23516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f2cce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23516:1875420981230848:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788541437.925400:0:23516:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788541437.925438:0:23516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f2cce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23516:1875420981230976:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788541437.925459:0:23516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541437.925473:0:23516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a681084bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788541437.925482:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981230976 00000100:00100000:3.0:1788541437.925486:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981230976 00000100:00100000:3.0:1788541437.925503:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788541437.925509:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f2ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23516:x1875420981230976:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788541437.925534:0:24276:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000100:00100000:2.0:1788541437.931548:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981230592 00000100:00100000:2.0:1788541437.934187:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981230592 00000100:00100000:2.0:1788541437.934253:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788541437.934262:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1875420981230592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788541437.934289:0:24280:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 896 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788541437.934377:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1875420981230592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (24577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541437.934386:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788541437.934956:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670831c700 x1875420981230592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541437.934979:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981230592:0@lo:13:osp-pre-1-0.0 00002000:00010000:2.0:1788541437.938142:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541437.938160:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a93ac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.938178:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788541437.938183:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541437.938191:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a93ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.938210:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a93ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.938221:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a93ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.938229:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a93ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.938251:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788541437.940535:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541437.940548:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4f374b3/0x2aac941e5f4a93b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.940574:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788541437.940578:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541437.940584:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4f374b3/0x2aac941e5f4a93b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.940598:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4f374b3/0x2aac941e5f4a93b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.940607:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4f374b3/0x2aac941e5f4a93b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.940615:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4f374b3/0x2aac941e5f4a93b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.943577:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788541437.944597:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541437.944608:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7a4d3f0/0x2aac941e5f4a93ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.944626:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788541437.944631:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541437.944750:0:25109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788541437.944759:0:25109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a93ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.944768:0:25109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551a800 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541437.944773:0:25109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a93ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.944783:0:25109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a93ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.944804:0:25109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a93ac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.944813:0:25109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a93ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.944833:0:25109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541437.944836:0:25109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4f374b3/0x2aac941e5f4a93b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.944842:0:25109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551aa00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541437.944846:0:25109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4f374b3/0x2aac941e5f4a93b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.944853:0:25109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4f374b3/0x2aac941e5f4a93b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.944888:0:25109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4f374b3/0x2aac941e5f4a93b3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.944897:0:25109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4f374b3/0x2aac941e5f4a93b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.944911:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541437.944913:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541437.944915:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541437.945127:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7a4d3f0/0x2aac941e5f4a93ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.945152:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7a4d3f0/0x2aac941e5f4a93ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.945161:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7a4d3f0/0x2aac941e5f4a93ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.945169:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7a4d3f0/0x2aac941e5f4a93ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.945193:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788541437.945721:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541437.945728:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdfeb40c/0x2aac941e5f4a93c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.945739:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788541437.945742:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541437.945747:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdfeb40c/0x2aac941e5f4a93c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.945756:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdfeb40c/0x2aac941e5f4a93c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.945764:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdfeb40c/0x2aac941e5f4a93c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.945783:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdfeb40c/0x2aac941e5f4a93c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.945804:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788541437.945927:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788541437.945933:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7a4d3f0/0x2aac941e5f4a93ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.945940:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551a600 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541437.945945:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7a4d3f0/0x2aac941e5f4a93ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.945953:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7a4d3f0/0x2aac941e5f4a93ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.947819:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541437.947833:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdfeb40c/0x2aac941e5f4a93c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.947846:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551a000 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541437.947850:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdfeb40c/0x2aac941e5f4a93c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.947861:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdfeb40c/0x2aac941e5f4a93c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.948245:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdfeb40c/0x2aac941e5f4a93c1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.948255:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdfeb40c/0x2aac941e5f4a93c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.948276:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541437.948289:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541437.948291:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788541437.948444:0:25171:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788541437.948454:0:25171:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:3.0:1788541437.948460:0:25171:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00010000:00010000:0.0:1788541437.949014:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541437.949391:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7a4d3f0/0x2aac941e5f4a93ba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.949403:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7a4d3f0/0x2aac941e5f4a93ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.949421:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541437.949423:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541437.949425:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788541437.950618:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788541437.950630:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9b9cbb7/0x2aac941e5f4a93c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.950711:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1788541437.950715:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541437.950722:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b9cbb7/0x2aac941e5f4a93c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.950738:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9b9cbb7/0x2aac941e5f4a93c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.950748:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9b9cbb7/0x2aac941e5f4a93c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.950757:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b9cbb7/0x2aac941e5f4a93c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.950785:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541437.951206:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541437.951213:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9b9cbb7/0x2aac941e5f4a93c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.951221:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75f400 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541437.951226:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9b9cbb7/0x2aac941e5f4a93c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.951236:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9b9cbb7/0x2aac941e5f4a93c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.951251:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9b9cbb7/0x2aac941e5f4a93c8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.951258:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9b9cbb7/0x2aac941e5f4a93c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.951275:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541437.951276:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541437.951278:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788541437.954760:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541437.954789:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a93cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.954805:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788541437.954809:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541437.954815:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a93cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.954828:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a93cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.954838:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a93cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.954845:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a93cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.954887:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541437.955236:0:25109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541437.955243:0:25109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a93cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.955250:0:25109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b200 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541437.955261:0:25109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a93cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.955270:0:25109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a93cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.955286:0:25109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a93cf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.955292:0:25109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a93cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.955311:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541437.955313:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541437.955315:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788541437.956447:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541437.956456:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b82ae0e/0x2aac941e5f4a93d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.956470:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788541437.956475:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541437.956492:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b82ae0e/0x2aac941e5f4a93d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.956505:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b82ae0e/0x2aac941e5f4a93d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.956524:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b82ae0e/0x2aac941e5f4a93d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.956533:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b82ae0e/0x2aac941e5f4a93d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.956557:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541437.956866:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541437.956894:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b82ae0e/0x2aac941e5f4a93d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.956902:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b600 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541437.956907:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b82ae0e/0x2aac941e5f4a93d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.956915:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b82ae0e/0x2aac941e5f4a93d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.956929:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b82ae0e/0x2aac941e5f4a93d6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.956943:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b82ae0e/0x2aac941e5f4a93d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.956959:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541437.956961:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541437.956963:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788541437.958219:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541437.958230:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7e15114/0x2aac941e5f4a93dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.958245:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788541437.958249:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541437.958255:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7e15114/0x2aac941e5f4a93dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.958268:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7e15114/0x2aac941e5f4a93dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.958278:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7e15114/0x2aac941e5f4a93dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.958286:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7e15114/0x2aac941e5f4a93dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.958321:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541437.958607:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541437.958613:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7e15114/0x2aac941e5f4a93dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.958629:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551bc00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541437.958641:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7e15114/0x2aac941e5f4a93dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.958650:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7e15114/0x2aac941e5f4a93dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.958666:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7e15114/0x2aac941e5f4a93dd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.958673:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7e15114/0x2aac941e5f4a93dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.958691:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541437.958693:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541437.958694:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788541437.961054:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541437.961070:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f18cec65/0x2aac941e5f4a93e4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.961087:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788541437.961091:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541437.961098:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f18cec65/0x2aac941e5f4a93e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.961113:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f18cec65/0x2aac941e5f4a93e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.961123:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f18cec65/0x2aac941e5f4a93e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.961131:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f18cec65/0x2aac941e5f4a93e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.961188:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788541437.963197:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541437.963211:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ec00a0b/0x2aac941e5f4a93eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.963227:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788541437.963243:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541437.963250:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ec00a0b/0x2aac941e5f4a93eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.963264:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ec00a0b/0x2aac941e5f4a93eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.963274:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ec00a0b/0x2aac941e5f4a93eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.963283:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ec00a0b/0x2aac941e5f4a93eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.963430:0:25109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788541437.963438:0:25109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f18cec65/0x2aac941e5f4a93e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.963447:0:25109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551a200 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541437.963451:0:25109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f18cec65/0x2aac941e5f4a93e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.963461:0:25109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f18cec65/0x2aac941e5f4a93e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.963488:0:25109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f18cec65/0x2aac941e5f4a93e4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.963496:0:25109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f18cec65/0x2aac941e5f4a93e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.963517:0:25109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541437.963521:0:25109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ec00a0b/0x2aac941e5f4a93eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.963527:0:25109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551ac00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541437.963530:0:25109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ec00a0b/0x2aac941e5f4a93eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.963537:0:25109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ec00a0b/0x2aac941e5f4a93eb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.963569:0:25109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ec00a0b/0x2aac941e5f4a93eb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.963578:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541437.963580:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541437.963582:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541437.963779:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788541437.963784:0:24277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ec00a0b/0x2aac941e5f4a93eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.964101:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788541437.965001:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541437.965011:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000265d9b95/0x2aac941e5f4a93f2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.965024:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788541437.965028:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541437.965033:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000265d9b95/0x2aac941e5f4a93f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.965045:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000265d9b95/0x2aac941e5f4a93f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.965063:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000265d9b95/0x2aac941e5f4a93f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.965070:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000265d9b95/0x2aac941e5f4a93f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.965088:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541437.965327:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541437.965333:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000265d9b95/0x2aac941e5f4a93f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.965345:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b400 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541437.965350:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000265d9b95/0x2aac941e5f4a93f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.965358:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000265d9b95/0x2aac941e5f4a93f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.965373:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000265d9b95/0x2aac941e5f4a93f2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.965381:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000265d9b95/0x2aac941e5f4a93f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.965404:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541437.965406:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541437.965414:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788541437.965802:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541437.965809:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006273aee1/0x2aac941e5f4a93f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.965819:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788541437.965822:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541437.965827:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006273aee1/0x2aac941e5f4a93f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.965836:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006273aee1/0x2aac941e5f4a93f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.965843:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006273aee1/0x2aac941e5f4a93f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.965851:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006273aee1/0x2aac941e5f4a93f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.965899:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541437.967228:0:25109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541437.967235:0:25109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006273aee1/0x2aac941e5f4a93f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.967246:0:25109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551a400 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541437.967251:0:25109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006273aee1/0x2aac941e5f4a93f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.967261:0:25109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006273aee1/0x2aac941e5f4a93f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.967275:0:25109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006273aee1/0x2aac941e5f4a93f9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.967282:0:25109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006273aee1/0x2aac941e5f4a93f9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.967301:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541437.967303:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541437.967304:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788541437.972849:0:25171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788541437.972861:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a9400 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.972894:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1788541437.972898:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541437.972905:0:25171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a9400 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.972922:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a9400 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.972932:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a9400 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.972940:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a9400 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.972960:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541437.974183:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541437.974192:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a9400 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.974202:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68043cd400 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541437.974206:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a9400 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.974229:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a9400 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.974249:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a9400 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.974256:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a9400 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.974278:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541437.974280:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541437.974281:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788541437.979961:0:25171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788541437.979974:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba0b5f2a/0x2aac941e5f4a9407 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.980724:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1788541437.980729:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541437.980736:0:25171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba0b5f2a/0x2aac941e5f4a9407 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.980752:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba0b5f2a/0x2aac941e5f4a9407 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.980762:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba0b5f2a/0x2aac941e5f4a9407 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.980771:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba0b5f2a/0x2aac941e5f4a9407 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.980795:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541437.981767:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541437.981777:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba0b5f2a/0x2aac941e5f4a9407 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.981788:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68043cc000 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541437.981793:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba0b5f2a/0x2aac941e5f4a9407 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.981804:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba0b5f2a/0x2aac941e5f4a9407 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.981821:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba0b5f2a/0x2aac941e5f4a9407 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.981842:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba0b5f2a/0x2aac941e5f4a9407 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541437.981861:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541437.981863:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541437.981864:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788541437.981954:0:25171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788541437.981961:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afb8a3bd/0x2aac941e5f4a940e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.981971:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1788541437.981976:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00002000:00010000:2.0:1788541437.983526:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541437.983536:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c561d3e/0x2aac941e5f4a9415 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.983550:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788541437.983555:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541437.983573:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c561d3e/0x2aac941e5f4a9415 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.983586:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c561d3e/0x2aac941e5f4a9415 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.983596:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c561d3e/0x2aac941e5f4a9415 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.983604:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c561d3e/0x2aac941e5f4a9415 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.983623:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541437.983633:0:25109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541437.983637:0:25109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c561d3e/0x2aac941e5f4a9415 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.983645:0:25109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551ae00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541437.983654:0:25109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c561d3e/0x2aac941e5f4a9415 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.983664:0:25109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c561d3e/0x2aac941e5f4a9415 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.983678:0:25109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c561d3e/0x2aac941e5f4a9415 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.983686:0:25109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c561d3e/0x2aac941e5f4a9415 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.983704:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541437.983706:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541437.983707:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541437.983956:0:25171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afb8a3bd/0x2aac941e5f4a940e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.983968:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afb8a3bd/0x2aac941e5f4a940e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.983987:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afb8a3bd/0x2aac941e5f4a940e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.983995:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afb8a3bd/0x2aac941e5f4a940e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.984016:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541437.984375:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541437.984381:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afb8a3bd/0x2aac941e5f4a940e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.984389:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68043cca00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541437.984392:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afb8a3bd/0x2aac941e5f4a940e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.984400:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afb8a3bd/0x2aac941e5f4a940e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.984414:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afb8a3bd/0x2aac941e5f4a940e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.984432:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afb8a3bd/0x2aac941e5f4a940e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.984450:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541437.984452:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541437.984453:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788541437.984974:0:25171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788541437.984992:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ef70e77/0x2aac941e5f4a941c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.985004:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1788541437.985007:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541437.985012:0:25171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ef70e77/0x2aac941e5f4a941c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.985022:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ef70e77/0x2aac941e5f4a941c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.985029:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ef70e77/0x2aac941e5f4a941c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.985037:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ef70e77/0x2aac941e5f4a941c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.985068:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541437.985446:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541437.985452:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ef70e77/0x2aac941e5f4a941c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.985460:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68043cd200 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541437.985465:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ef70e77/0x2aac941e5f4a941c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.985474:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ef70e77/0x2aac941e5f4a941c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.985496:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ef70e77/0x2aac941e5f4a941c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.985504:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ef70e77/0x2aac941e5f4a941c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.985517:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541437.985519:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541437.985520:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788541437.985862:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541437.985888:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9ec6a63/0x2aac941e5f4a9423 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.985898:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788541437.985901:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541437.985905:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9ec6a63/0x2aac941e5f4a9423 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.985915:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9ec6a63/0x2aac941e5f4a9423 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.985923:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9ec6a63/0x2aac941e5f4a9423 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.985930:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9ec6a63/0x2aac941e5f4a9423 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.986216:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541437.986225:0:25109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541437.986230:0:25109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9ec6a63/0x2aac941e5f4a9423 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.986237:0:25109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b800 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541437.986241:0:25109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9ec6a63/0x2aac941e5f4a9423 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.986259:0:25109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9ec6a63/0x2aac941e5f4a9423 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.986269:0:25109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9ec6a63/0x2aac941e5f4a9423 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.986277:0:25109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9ec6a63/0x2aac941e5f4a9423 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541437.986292:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541437.986294:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541437.986295:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788541437.993677:0:25171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788541437.993692:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b060b4c/0x2aac941e5f4a942a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.993708:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1788541437.993712:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541437.993718:0:25171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b060b4c/0x2aac941e5f4a942a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.993734:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b060b4c/0x2aac941e5f4a942a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.993744:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b060b4c/0x2aac941e5f4a942a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.993752:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b060b4c/0x2aac941e5f4a942a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.993773:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788541437.995339:0:25171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788541437.995350:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c54b6883/0x2aac941e5f4a9431 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.995367:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1788541437.995378:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541437.995399:0:25171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c54b6883/0x2aac941e5f4a9431 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.995412:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c54b6883/0x2aac941e5f4a9431 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.995422:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c54b6883/0x2aac941e5f4a9431 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.995431:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c54b6883/0x2aac941e5f4a9431 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.995450:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788541437.996933:0:25171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788541437.996943:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009654f4a6/0x2aac941e5f4a9438 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541437.996957:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1788541437.996960:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541437.996966:0:25171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009654f4a6/0x2aac941e5f4a9438 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541437.996989:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009654f4a6/0x2aac941e5f4a9438 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541437.996999:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009654f4a6/0x2aac941e5f4a9438 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541437.997012:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009654f4a6/0x2aac941e5f4a9438 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541437.997030:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788541437.997364:0:25109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788541437.997373:0:25109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b060b4c/0x2aac941e5f4a942a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.997392:0:25109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68043cc200 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541437.997396:0:25109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b060b4c/0x2aac941e5f4a942a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.997407:0:25109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b060b4c/0x2aac941e5f4a942a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.997424:0:25109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b060b4c/0x2aac941e5f4a942a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.997444:0:25109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b060b4c/0x2aac941e5f4a942a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.997461:0:25109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788541437.997465:0:25109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c54b6883/0x2aac941e5f4a9431 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.997471:0:25109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68043cdc00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541437.997474:0:25109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c54b6883/0x2aac941e5f4a9431 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.997493:0:25109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c54b6883/0x2aac941e5f4a9431 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.997503:0:25109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c54b6883/0x2aac941e5f4a9431 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.997510:0:25109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c54b6883/0x2aac941e5f4a9431 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.997522:0:25109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541437.997526:0:25109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009654f4a6/0x2aac941e5f4a9438 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.997531:0:25109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842172000 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541437.997540:0:25109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009654f4a6/0x2aac941e5f4a9438 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.997547:0:25109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009654f4a6/0x2aac941e5f4a9438 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.997556:0:25109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009654f4a6/0x2aac941e5f4a9438 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.997576:0:25109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009654f4a6/0x2aac941e5f4a9438 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.997591:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541437.997593:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541437.997595:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788541437.999389:0:25171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788541437.999400:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a943f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.999414:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1788541437.999418:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541437.999425:0:25171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a943f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.999438:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a943f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.999447:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a943f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.999460:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a943f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541437.999698:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788541438.000467:0:25109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541438.000476:0:25109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a943f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.000495:0:25109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68043cd400 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:1.0:1788541438.000500:0:25109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a943f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.000509:0:25109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a943f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.000525:0:25109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a943f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.000532:0:25109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a943f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.000551:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541438.000553:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541438.000555:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788541438.000838:0:25171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788541438.000846:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cafec747/0x2aac941e5f4a9446 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.000857:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1788541438.000860:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541438.000866:0:25171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cafec747/0x2aac941e5f4a9446 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.000890:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cafec747/0x2aac941e5f4a9446 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.000899:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cafec747/0x2aac941e5f4a9446 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.000907:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cafec747/0x2aac941e5f4a9446 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.000924:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788541438.001097:0:25109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541438.001106:0:25109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cafec747/0x2aac941e5f4a9446 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.001113:0:25109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68043cda00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:1.0:1788541438.001117:0:25109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cafec747/0x2aac941e5f4a9446 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.001124:0:25109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cafec747/0x2aac941e5f4a9446 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.001135:0:25109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cafec747/0x2aac941e5f4a9446 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.001142:0:25109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cafec747/0x2aac941e5f4a9446 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.001154:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541438.001156:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541438.001157:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541438.001977:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541438.001985:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788541438.002037:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541438.002045:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ec00a0b/0x2aac941e5f4a944d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.002057:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788541438.002062:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541438.002067:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ec00a0b/0x2aac941e5f4a944d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.002078:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ec00a0b/0x2aac941e5f4a944d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.002097:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ec00a0b/0x2aac941e5f4a944d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.002104:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ec00a0b/0x2aac941e5f4a944d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.002122:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788541438.002343:0:25109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541438.002350:0:25109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ec00a0b/0x2aac941e5f4a944d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.002364:0:25109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551ac00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541438.002368:0:25109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ec00a0b/0x2aac941e5f4a944d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.002377:0:25109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ec00a0b/0x2aac941e5f4a944d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.002390:0:25109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ec00a0b/0x2aac941e5f4a944d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.002397:0:25109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ec00a0b/0x2aac941e5f4a944d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.002415:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541438.002417:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541438.002418:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788541438.004303:0:25171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541438.004313:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7a4d3f0/0x2aac941e5f4a9454 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.004328:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788541438.004333:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541438.004339:0:25171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7a4d3f0/0x2aac941e5f4a9454 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.004351:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7a4d3f0/0x2aac941e5f4a9454 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.004360:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7a4d3f0/0x2aac941e5f4a9454 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.004367:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7a4d3f0/0x2aac941e5f4a9454 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788541438.004491:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788541438.004498:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba0b5f2a/0x2aac941e5f4a945b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.004505:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1788541438.004508:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541438.004512:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba0b5f2a/0x2aac941e5f4a945b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.004522:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba0b5f2a/0x2aac941e5f4a945b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.004537:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba0b5f2a/0x2aac941e5f4a945b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.004545:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba0b5f2a/0x2aac941e5f4a945b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.004572:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788541438.006787:0:25171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541438.006799:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdfeb40c/0x2aac941e5f4a9462 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.006815:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788541438.006819:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541438.006824:0:25171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdfeb40c/0x2aac941e5f4a9462 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.006836:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdfeb40c/0x2aac941e5f4a9462 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.006846:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdfeb40c/0x2aac941e5f4a9462 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.006853:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdfeb40c/0x2aac941e5f4a9462 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.008852:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788541438.008866:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7a4d3f0/0x2aac941e5f4a9454 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.008892:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551a600 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:1.0:1788541438.008897:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7a4d3f0/0x2aac941e5f4a9454 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.008923:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7a4d3f0/0x2aac941e5f4a9454 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.008944:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7a4d3f0/0x2aac941e5f4a9454 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.008953:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7a4d3f0/0x2aac941e5f4a9454 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.012595:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788541438.014637:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788541438.014649:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba0b5f2a/0x2aac941e5f4a945b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.014662:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68043cc000 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541438.014668:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba0b5f2a/0x2aac941e5f4a945b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.014679:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba0b5f2a/0x2aac941e5f4a945b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.014700:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba0b5f2a/0x2aac941e5f4a945b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.014708:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba0b5f2a/0x2aac941e5f4a945b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.014730:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541438.014742:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdfeb40c/0x2aac941e5f4a9462 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.014749:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551a000 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541438.014752:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdfeb40c/0x2aac941e5f4a9462 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.014759:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdfeb40c/0x2aac941e5f4a9462 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.014770:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdfeb40c/0x2aac941e5f4a9462 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.014778:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541438.014780:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541438.014783:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541438.014789:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541438.014791:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541438.014793:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788541438.016426:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788541438.016437:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cafec747/0x2aac941e5f4a9469 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.016454:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1788541438.016458:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541438.016466:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cafec747/0x2aac941e5f4a9469 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.016614:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cafec747/0x2aac941e5f4a9469 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.016625:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cafec747/0x2aac941e5f4a9469 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.016693:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cafec747/0x2aac941e5f4a9469 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.016717:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788541438.016730:0:25109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541438.016734:0:25109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cafec747/0x2aac941e5f4a9469 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.016741:0:25109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68043cda00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541438.016745:0:25109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cafec747/0x2aac941e5f4a9469 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.016754:0:25109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cafec747/0x2aac941e5f4a9469 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.016770:0:25109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cafec747/0x2aac941e5f4a9469 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.016777:0:25109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cafec747/0x2aac941e5f4a9469 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.016801:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541438.016803:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541438.016805:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788541438.017571:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788541438.017578:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a9470 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.017590:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1788541438.017593:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541438.017598:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a9470 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.017608:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a9470 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.017616:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a9470 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.017623:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a9470 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.017722:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:1.0:1788541438.023540:0:25092:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:1.0:1788541438.023574:0:25092:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788541438.023580:0:25092:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788541438.023738:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f2ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23516:x1875420981230976:12345-0@lo:5:osp-pre-1-1.0 Request processed in 98224us (98273us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788541438.023749:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788541438.023804:0:23516:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1788541438.023812:0:23516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f2cce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23516:1875420981230976:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788541438.023831:0:23516:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:1.0:1788541438.023905:0:23516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67082f8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23516:1875420981231104:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788541438.023941:0:23516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541438.023963:0:23516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682e78fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788541438.023987:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981231104 00000100:00100000:1.0:1788541438.023992:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981231104 00000100:00100000:1.0:1788541438.024027:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788541438.024044:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23516:x1875420981231104:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788541438.024089:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23516:x1875420981231104:12345-0@lo:900:osp-pre-1-1.0 Request processed in 46us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541438.024096:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788541438.024127:0:23516:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67082f8000 x1875420981231104/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788541454 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541438.024137:0:23516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67082f8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23516:1875420981231104:0@lo:900:osp-pre-1-1.0 00010000:00010000:2.0:1788541438.024378:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541438.024400:0:25171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdfeb40c/0x2aac941e5f4a9462 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.024434:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541438.024441:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a9470 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.024457:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68043cd400 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541438.024461:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a9470 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.024472:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a9470 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.024502:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a9470 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.024510:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a9470 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.024526:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541438.024528:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541438.024529:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788541438.026719:0:25171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541438.026731:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9ec6a63/0x2aac941e5f4a9477 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.026746:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788541438.026750:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541438.026756:0:25171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9ec6a63/0x2aac941e5f4a9477 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.026769:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9ec6a63/0x2aac941e5f4a9477 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.026787:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9ec6a63/0x2aac941e5f4a9477 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.026795:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9ec6a63/0x2aac941e5f4a9477 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.026824:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788541438.027249:0:25109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541438.027256:0:25109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9ec6a63/0x2aac941e5f4a9477 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.027264:0:25109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b800 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:1.0:1788541438.027269:0:25109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9ec6a63/0x2aac941e5f4a9477 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.027277:0:25109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9ec6a63/0x2aac941e5f4a9477 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.027291:0:25109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9ec6a63/0x2aac941e5f4a9477 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.027299:0:25109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9ec6a63/0x2aac941e5f4a9477 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.027315:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541438.027317:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541438.027323:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788541438.027406:0:25171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541438.027412:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c561d3e/0x2aac941e5f4a947e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.027420:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788541438.027423:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541438.027427:0:25171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c561d3e/0x2aac941e5f4a947e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.027436:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c561d3e/0x2aac941e5f4a947e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.027444:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c561d3e/0x2aac941e5f4a947e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.027452:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c561d3e/0x2aac941e5f4a947e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.027690:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541438.027700:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541438.027704:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c561d3e/0x2aac941e5f4a947e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.027712:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551ae00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541438.027715:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c561d3e/0x2aac941e5f4a947e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.027723:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c561d3e/0x2aac941e5f4a947e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.027734:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c561d3e/0x2aac941e5f4a947e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.027741:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c561d3e/0x2aac941e5f4a947e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.027755:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541438.027757:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541438.027759:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788541438.028717:0:25171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541438.028726:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006273aee1/0x2aac941e5f4a9485 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.028739:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788541438.028751:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541438.028757:0:25171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006273aee1/0x2aac941e5f4a9485 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.028769:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006273aee1/0x2aac941e5f4a9485 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.028777:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006273aee1/0x2aac941e5f4a9485 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.028784:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006273aee1/0x2aac941e5f4a9485 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.028848:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788541438.029668:0:25171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541438.029677:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000265d9b95/0x2aac941e5f4a948c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.029687:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788541438.029691:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541438.029695:0:25171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000265d9b95/0x2aac941e5f4a948c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.029706:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000265d9b95/0x2aac941e5f4a948c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.029715:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000265d9b95/0x2aac941e5f4a948c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.029727:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000265d9b95/0x2aac941e5f4a948c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.029743:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788541438.029752:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788541438.029757:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006273aee1/0x2aac941e5f4a9485 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.029764:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551a400 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541438.029769:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006273aee1/0x2aac941e5f4a9485 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.029778:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006273aee1/0x2aac941e5f4a9485 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.029792:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006273aee1/0x2aac941e5f4a9485 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.029800:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006273aee1/0x2aac941e5f4a9485 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.029816:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541438.029819:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000265d9b95/0x2aac941e5f4a948c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.029836:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b400 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541438.029839:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000265d9b95/0x2aac941e5f4a948c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.029847:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000265d9b95/0x2aac941e5f4a948c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.029857:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000265d9b95/0x2aac941e5f4a948c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.029864:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000265d9b95/0x2aac941e5f4a948c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.029894:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541438.029896:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541438.029898:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788541438.030573:0:25171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541438.030581:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f18cec65/0x2aac941e5f4a9493 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.030592:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788541438.030595:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541438.030599:0:25171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f18cec65/0x2aac941e5f4a9493 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.030607:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f18cec65/0x2aac941e5f4a9493 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.030620:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f18cec65/0x2aac941e5f4a9493 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.030627:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f18cec65/0x2aac941e5f4a9493 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.030704:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541438.030712:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541438.030716:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f18cec65/0x2aac941e5f4a9493 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.030723:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551a200 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541438.030727:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f18cec65/0x2aac941e5f4a9493 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.030735:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f18cec65/0x2aac941e5f4a9493 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.030746:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f18cec65/0x2aac941e5f4a9493 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.030753:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f18cec65/0x2aac941e5f4a9493 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.030766:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541438.030772:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541438.030774:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788541438.031577:0:25171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541438.031584:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7e15114/0x2aac941e5f4a949a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.031594:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788541438.031598:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541438.031602:0:25171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7e15114/0x2aac941e5f4a949a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.031612:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7e15114/0x2aac941e5f4a949a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.031620:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7e15114/0x2aac941e5f4a949a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.031626:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7e15114/0x2aac941e5f4a949a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.031703:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541438.031713:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541438.031717:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7e15114/0x2aac941e5f4a949a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.031723:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551bc00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541438.031727:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7e15114/0x2aac941e5f4a949a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.031746:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7e15114/0x2aac941e5f4a949a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.031759:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7e15114/0x2aac941e5f4a949a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.031766:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7e15114/0x2aac941e5f4a949a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.031780:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541438.031782:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541438.031783:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541438.032080:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788541438.032467:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788541438.032474:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ef70e77/0x2aac941e5f4a94a1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.032509:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1788541438.032513:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541438.032518:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ef70e77/0x2aac941e5f4a94a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.032529:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ef70e77/0x2aac941e5f4a94a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.032538:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ef70e77/0x2aac941e5f4a94a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.032545:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ef70e77/0x2aac941e5f4a94a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.032570:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788541438.033109:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788541438.033115:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c54b6883/0x2aac941e5f4a94a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.033126:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1788541438.033129:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541438.033134:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c54b6883/0x2aac941e5f4a94a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.033144:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c54b6883/0x2aac941e5f4a94a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.033163:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c54b6883/0x2aac941e5f4a94a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.033171:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c54b6883/0x2aac941e5f4a94a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.033184:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788541438.033192:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788541438.033196:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ef70e77/0x2aac941e5f4a94a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.033203:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68043cd200 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541438.033207:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ef70e77/0x2aac941e5f4a94a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.033215:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ef70e77/0x2aac941e5f4a94a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.033229:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ef70e77/0x2aac941e5f4a94a1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.033235:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ef70e77/0x2aac941e5f4a94a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.033248:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541438.033257:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c54b6883/0x2aac941e5f4a94a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.033263:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68043cdc00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541438.033266:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c54b6883/0x2aac941e5f4a94a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.033273:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c54b6883/0x2aac941e5f4a94a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.033284:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c54b6883/0x2aac941e5f4a94a8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.033292:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c54b6883/0x2aac941e5f4a94a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.033303:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541438.033305:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541438.033306:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541438.033763:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788541438.033825:0:25171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541438.033832:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b82ae0e/0x2aac941e5f4a94af lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.033843:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788541438.033846:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541438.033851:0:25171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b82ae0e/0x2aac941e5f4a94af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.033861:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b82ae0e/0x2aac941e5f4a94af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.033884:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b82ae0e/0x2aac941e5f4a94af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.033899:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b82ae0e/0x2aac941e5f4a94af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.033915:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541438.033923:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541438.033927:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b82ae0e/0x2aac941e5f4a94af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.033934:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b600 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541438.033937:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b82ae0e/0x2aac941e5f4a94af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.033945:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b82ae0e/0x2aac941e5f4a94af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.033956:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b82ae0e/0x2aac941e5f4a94af lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.033964:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b82ae0e/0x2aac941e5f4a94af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.033978:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541438.033979:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541438.033981:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788541438.034584:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788541438.034591:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b060b4c/0x2aac941e5f4a94b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.034602:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1788541438.034606:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541438.034610:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b060b4c/0x2aac941e5f4a94b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.034632:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b060b4c/0x2aac941e5f4a94b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.034711:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b060b4c/0x2aac941e5f4a94b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.034719:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b060b4c/0x2aac941e5f4a94b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.034737:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541438.035554:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541438.035578:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b060b4c/0x2aac941e5f4a94b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.035588:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68043cc200 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541438.035592:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b060b4c/0x2aac941e5f4a94b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.035600:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b060b4c/0x2aac941e5f4a94b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.035616:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b060b4c/0x2aac941e5f4a94b6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.035624:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b060b4c/0x2aac941e5f4a94b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788541438.035782:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788541438.035789:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afb8a3bd/0x2aac941e5f4a94bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.035798:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1788541438.035802:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541438.035808:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afb8a3bd/0x2aac941e5f4a94bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.035818:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afb8a3bd/0x2aac941e5f4a94bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.035826:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afb8a3bd/0x2aac941e5f4a94bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.035844:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afb8a3bd/0x2aac941e5f4a94bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.035866:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541438.036196:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541438.036201:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afb8a3bd/0x2aac941e5f4a94bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.036209:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68043cca00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541438.036212:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afb8a3bd/0x2aac941e5f4a94bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.036221:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afb8a3bd/0x2aac941e5f4a94bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.036245:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afb8a3bd/0x2aac941e5f4a94bd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.036253:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afb8a3bd/0x2aac941e5f4a94bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.036266:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541438.036269:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541438.036270:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541438.036278:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788541438.036322:0:25171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541438.036327:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a94c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.036336:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788541438.036339:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541438.036344:0:25171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a94c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.036353:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a94c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.036361:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a94c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.036368:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a94c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.036549:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788541438.036752:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788541438.036759:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d188245/0x2aac941e5f4a94cb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.036768:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1788541438.036771:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541438.036775:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d188245/0x2aac941e5f4a94cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.036785:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d188245/0x2aac941e5f4a94cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.036793:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d188245/0x2aac941e5f4a94cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.036800:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d188245/0x2aac941e5f4a94cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.036820:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541438.037460:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541438.037466:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d188245/0x2aac941e5f4a94cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.037474:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842049600 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541438.037540:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d188245/0x2aac941e5f4a94cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.037551:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d188245/0x2aac941e5f4a94cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.037574:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d188245/0x2aac941e5f4a94cb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.037581:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d188245/0x2aac941e5f4a94cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.037599:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541438.037600:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541438.037602:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541438.037614:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541438.037621:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541438.037626:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a94c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.037744:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b200 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541438.037756:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a94c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.037765:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a94c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.037775:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a94c4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.037782:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a94c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.037796:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541438.037798:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541438.037799:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788541438.039052:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788541438.039064:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d1fd243/0x2aac941e5f4a94d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.039084:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1788541438.039089:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541438.039095:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d1fd243/0x2aac941e5f4a94d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.039108:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d1fd243/0x2aac941e5f4a94d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.039118:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d1fd243/0x2aac941e5f4a94d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.039124:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d1fd243/0x2aac941e5f4a94d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.039144:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788541438.039795:0:25109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541438.039803:0:25109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d1fd243/0x2aac941e5f4a94d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.039812:0:25109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842048400 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:1.0:1788541438.039817:0:25109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d1fd243/0x2aac941e5f4a94d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.039826:0:25109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d1fd243/0x2aac941e5f4a94d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.039845:0:25109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d1fd243/0x2aac941e5f4a94d2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.039853:0:25109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d1fd243/0x2aac941e5f4a94d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.039889:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541438.039891:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541438.039893:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788541438.041116:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788541438.041126:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cafec747/0x2aac941e5f4a94d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.041139:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1788541438.041144:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541438.041150:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cafec747/0x2aac941e5f4a94d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.041163:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cafec747/0x2aac941e5f4a94d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.041189:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cafec747/0x2aac941e5f4a94d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.041197:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cafec747/0x2aac941e5f4a94d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.041215:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541438.041465:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541438.041471:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cafec747/0x2aac941e5f4a94d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.041549:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68043cda00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541438.041553:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cafec747/0x2aac941e5f4a94d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.041572:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cafec747/0x2aac941e5f4a94d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.041584:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cafec747/0x2aac941e5f4a94d9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.041597:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cafec747/0x2aac941e5f4a94d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.041609:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541438.041611:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541438.041613:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788541438.042433:0:25171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788541438.042442:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba0b5f2a/0x2aac941e5f4a94e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.042454:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1788541438.042458:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541438.042464:0:25171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba0b5f2a/0x2aac941e5f4a94e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.042474:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba0b5f2a/0x2aac941e5f4a94e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788541438.043323:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541438.043332:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdfeb40c/0x2aac941e5f4a94e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.043343:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788541438.043346:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541438.043351:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdfeb40c/0x2aac941e5f4a94e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.043361:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdfeb40c/0x2aac941e5f4a94e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.043370:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdfeb40c/0x2aac941e5f4a94e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.043377:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdfeb40c/0x2aac941e5f4a94e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.043403:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788541438.044086:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba0b5f2a/0x2aac941e5f4a94e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.044095:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba0b5f2a/0x2aac941e5f4a94e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.044138:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788541438.044287:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788541438.044295:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdfeb40c/0x2aac941e5f4a94e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.044304:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551a000 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541438.044309:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdfeb40c/0x2aac941e5f4a94e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.044318:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdfeb40c/0x2aac941e5f4a94e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.044334:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdfeb40c/0x2aac941e5f4a94e7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.044342:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdfeb40c/0x2aac941e5f4a94e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.044365:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541438.044368:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba0b5f2a/0x2aac941e5f4a94e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.044388:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68043cc000 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541438.044391:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba0b5f2a/0x2aac941e5f4a94e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.044400:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba0b5f2a/0x2aac941e5f4a94e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.044412:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba0b5f2a/0x2aac941e5f4a94e0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.044420:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba0b5f2a/0x2aac941e5f4a94e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.044436:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541438.044438:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541438.044440:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541438.044498:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788541438.045117:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541438.045125:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4f374b3/0x2aac941e5f4a94ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.045137:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788541438.045140:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541438.045145:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4f374b3/0x2aac941e5f4a94ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.045157:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4f374b3/0x2aac941e5f4a94ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.045166:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4f374b3/0x2aac941e5f4a94ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.045174:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4f374b3/0x2aac941e5f4a94ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.045192:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788541438.045518:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541438.045524:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4f374b3/0x2aac941e5f4a94ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.045532:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551aa00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541438.045535:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4f374b3/0x2aac941e5f4a94ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.045544:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4f374b3/0x2aac941e5f4a94ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.045567:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4f374b3/0x2aac941e5f4a94ee lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.045575:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4f374b3/0x2aac941e5f4a94ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.045590:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541438.045592:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541438.045594:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788541438.045853:0:25171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541438.045859:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a0a6b27/0x2aac941e5f4a94f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.045867:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788541438.045898:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541438.045903:0:25171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a0a6b27/0x2aac941e5f4a94f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.045925:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a0a6b27/0x2aac941e5f4a94f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.045932:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a0a6b27/0x2aac941e5f4a94f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.045938:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a0a6b27/0x2aac941e5f4a94f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.045952:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541438.046222:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541438.046229:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a0a6b27/0x2aac941e5f4a94f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.046236:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551a800 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541438.046240:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a0a6b27/0x2aac941e5f4a94f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.046248:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a0a6b27/0x2aac941e5f4a94f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.046269:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a0a6b27/0x2aac941e5f4a94f5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.046276:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a0a6b27/0x2aac941e5f4a94f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.046290:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541438.046293:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541438.046294:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788541438.046815:0:25171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541438.046821:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7a4d3f0/0x2aac941e5f4a94fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.046830:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788541438.046833:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541438.046836:0:25171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7a4d3f0/0x2aac941e5f4a94fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.046845:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7a4d3f0/0x2aac941e5f4a94fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.046852:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7a4d3f0/0x2aac941e5f4a94fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.046893:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7a4d3f0/0x2aac941e5f4a94fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.046911:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541438.047058:0:25109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541438.047063:0:25109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7a4d3f0/0x2aac941e5f4a94fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.047072:0:25109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551a600 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541438.047076:0:25109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7a4d3f0/0x2aac941e5f4a94fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.047086:0:25109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7a4d3f0/0x2aac941e5f4a94fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.047098:0:25109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7a4d3f0/0x2aac941e5f4a94fc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.047116:0:25109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7a4d3f0/0x2aac941e5f4a94fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.047143:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541438.047145:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541438.047147:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788541438.047599:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788541438.047607:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a9503 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.047615:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1788541438.047624:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541438.047629:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a9503 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.048577:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a9503 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.048588:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a9503 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.048597:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a9503 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.048616:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541438.049850:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541438.049860:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a9503 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.049890:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68043cd400 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541438.049895:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a9503 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.049905:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a9503 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.049923:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a9503 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.049930:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055d0fc7d/0x2aac941e5f4a9503 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.049952:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541438.049954:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541438.049956:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788541438.050833:0:25171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788541438.050843:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056eb80e7/0x2aac941e5f4a950a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.050856:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1788541438.050860:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541438.050865:0:25171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056eb80e7/0x2aac941e5f4a950a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.050900:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056eb80e7/0x2aac941e5f4a950a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.050908:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056eb80e7/0x2aac941e5f4a950a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.050922:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056eb80e7/0x2aac941e5f4a950a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.050942:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788541438.051623:0:25171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1788541438.051844:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541438.051857:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ec00a0b/0x2aac941e5f4a9518 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.051883:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788541438.051886:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541438.051891:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ec00a0b/0x2aac941e5f4a9518 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.051901:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ec00a0b/0x2aac941e5f4a9518 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.051909:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ec00a0b/0x2aac941e5f4a9518 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.051915:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ec00a0b/0x2aac941e5f4a9518 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.051931:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788541438.051940:0:25109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788541438.051945:0:25109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056eb80e7/0x2aac941e5f4a950a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.051953:0:25109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075acc00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541438.051957:0:25109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056eb80e7/0x2aac941e5f4a950a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.051965:0:25109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056eb80e7/0x2aac941e5f4a950a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.051987:0:25109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056eb80e7/0x2aac941e5f4a950a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.051995:0:25109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056eb80e7/0x2aac941e5f4a950a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.052012:0:25109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541438.052015:0:25109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ec00a0b/0x2aac941e5f4a9518 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.052021:0:25109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551ac00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541438.052024:0:25109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ec00a0b/0x2aac941e5f4a9518 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.052031:0:25109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ec00a0b/0x2aac941e5f4a9518 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.052040:0:25109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ec00a0b/0x2aac941e5f4a9518 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.052046:0:25109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ec00a0b/0x2aac941e5f4a9518 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.052059:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541438.052061:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541438.052069:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541438.052606:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541438.052717:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000720f7b13/0x2aac941e5f4a9511 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.052731:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1788541438.052734:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541438.052739:0:25171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000720f7b13/0x2aac941e5f4a9511 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.052748:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000720f7b13/0x2aac941e5f4a9511 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.052757:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000720f7b13/0x2aac941e5f4a9511 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.052764:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000720f7b13/0x2aac941e5f4a9511 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.052784:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541438.053749:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541438.053757:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000720f7b13/0x2aac941e5f4a9511 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.053768:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ad200 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541438.053772:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000720f7b13/0x2aac941e5f4a9511 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.053781:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000720f7b13/0x2aac941e5f4a9511 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.053796:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000720f7b13/0x2aac941e5f4a9511 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.053804:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000720f7b13/0x2aac941e5f4a9511 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.053822:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541438.053824:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541438.053825:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788541438.053920:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541438.053926:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bafc3c65/0x2aac941e5f4a951f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.053936:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788541438.053939:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541438.053944:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bafc3c65/0x2aac941e5f4a951f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.053959:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bafc3c65/0x2aac941e5f4a951f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.053967:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bafc3c65/0x2aac941e5f4a951f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.053974:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bafc3c65/0x2aac941e5f4a951f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.053989:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541438.053997:0:25109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541438.054000:0:25109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bafc3c65/0x2aac941e5f4a951f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.054007:0:25109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6806806400 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541438.054010:0:25109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bafc3c65/0x2aac941e5f4a951f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.054017:0:25109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bafc3c65/0x2aac941e5f4a951f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.054027:0:25109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bafc3c65/0x2aac941e5f4a951f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.054034:0:25109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bafc3c65/0x2aac941e5f4a951f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.054054:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541438.054055:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541438.054057:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788541438.054413:0:25171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788541438.054420:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c72b64dd/0x2aac941e5f4a9526 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.054428:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1788541438.054431:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541438.054435:0:25171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c72b64dd/0x2aac941e5f4a9526 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.054444:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c72b64dd/0x2aac941e5f4a9526 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.054451:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c72b64dd/0x2aac941e5f4a9526 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.054457:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c72b64dd/0x2aac941e5f4a9526 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.054471:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541438.054767:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541438.054772:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c72b64dd/0x2aac941e5f4a9526 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.054791:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75fa00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541438.054795:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c72b64dd/0x2aac941e5f4a9526 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.054803:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c72b64dd/0x2aac941e5f4a9526 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.054815:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c72b64dd/0x2aac941e5f4a9526 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.054822:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c72b64dd/0x2aac941e5f4a9526 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.054837:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541438.054839:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541438.054840:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788541438.055894:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541438.055904:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f17b936/0x2aac941e5f4a952d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.055916:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788541438.055920:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541438.055925:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f17b936/0x2aac941e5f4a952d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.055937:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f17b936/0x2aac941e5f4a952d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.055946:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f17b936/0x2aac941e5f4a952d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.055953:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f17b936/0x2aac941e5f4a952d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.055974:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541438.056374:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541438.056432:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f17b936/0x2aac941e5f4a952d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.056441:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6806806e00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541438.056444:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f17b936/0x2aac941e5f4a952d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.056452:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f17b936/0x2aac941e5f4a952d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.056474:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f17b936/0x2aac941e5f4a952d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.056690:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f17b936/0x2aac941e5f4a952d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.056712:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541438.056714:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541438.056716:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788541438.056829:0:25171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541438.056834:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001820e3f3/0x2aac941e5f4a9534 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.056856:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788541438.056859:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541438.056863:0:25171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001820e3f3/0x2aac941e5f4a9534 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788541438.057630:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541438.058737:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001820e3f3/0x2aac941e5f4a9534 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.058752:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001820e3f3/0x2aac941e5f4a9534 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.058759:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001820e3f3/0x2aac941e5f4a9534 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541438.058809:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788541438.059333:0:25109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541438.059341:0:25109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001820e3f3/0x2aac941e5f4a9534 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.059350:0:25109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6806807000 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:1.0:1788541438.059355:0:25109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001820e3f3/0x2aac941e5f4a9534 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.059372:0:25109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001820e3f3/0x2aac941e5f4a9534 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.059393:0:25109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001820e3f3/0x2aac941e5f4a9534 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.059400:0:25109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001820e3f3/0x2aac941e5f4a9534 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.059421:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541438.059422:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541438.059424:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541438.059519:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e6f7d87/0x2aac941e5f4a953b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.059529:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1788541438.059534:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541438.059540:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e6f7d87/0x2aac941e5f4a953b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.059550:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e6f7d87/0x2aac941e5f4a953b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.059567:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e6f7d87/0x2aac941e5f4a953b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.059575:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e6f7d87/0x2aac941e5f4a953b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.059608:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788541438.060049:0:24277:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:0.0:1788541438.060142:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22796:x1875420981230464:12345-0@lo:5:osp-pre-0-0.0 Request processed in 152929us (153330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541438.060152:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788541438.060360:0:22796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e710380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22796:1875420981230464:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788541438.060378:0:22796:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:2.0:1788541438.060437:0:22796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e710380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22796:1875420981231232:0@lo:5:osp-pre-0-0.0 00010000:00010000:1.0:1788541438.060607:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541438.060613:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e6f7d87/0x2aac941e5f4a953b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.060623:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75fe00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:1.0:1788541438.060628:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e6f7d87/0x2aac941e5f4a953b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.060647:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e6f7d87/0x2aac941e5f4a953b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.060660:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e6f7d87/0x2aac941e5f4a953b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.060677:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e6f7d87/0x2aac941e5f4a953b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.060696:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541438.060698:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541438.060700:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541438.060828:0:22796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541438.060859:0:22796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f019d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788541438.060903:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981231232 00000100:00100000:2.0:1788541438.060910:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981231232 00000100:00100000:2.0:1788541438.060958:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788541438.060967:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22796:x1875420981231232:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788541438.061012:0:24278:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00002000:00010000:0.0:1788541438.061256:0:25171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788541438.061264:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d436e380/0x2aac941e5f4a9542 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.061276:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1788541438.061280:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541438.061286:0:25171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d436e380/0x2aac941e5f4a9542 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.061297:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d436e380/0x2aac941e5f4a9542 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.061305:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d436e380/0x2aac941e5f4a9542 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.061312:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d436e380/0x2aac941e5f4a9542 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.061331:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788541438.061462:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541438.061467:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d436e380/0x2aac941e5f4a9542 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.061475:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75e200 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:1.0:1788541438.061487:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d436e380/0x2aac941e5f4a9542 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.061496:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d436e380/0x2aac941e5f4a9542 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.061509:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d436e380/0x2aac941e5f4a9542 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.061516:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d436e380/0x2aac941e5f4a9542 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.061530:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541438.061532:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541438.061534:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788541438.063362:0:25171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788541438.063380:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007330cc41/0x2aac941e5f4a9549 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.063714:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1788541438.063719:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541438.063725:0:25171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007330cc41/0x2aac941e5f4a9549 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.063739:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007330cc41/0x2aac941e5f4a9549 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.063750:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007330cc41/0x2aac941e5f4a9549 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.063758:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007330cc41/0x2aac941e5f4a9549 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.064420:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788541438.072956:0:25109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541438.072971:0:25109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007330cc41/0x2aac941e5f4a9549 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.072985:0:25109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75f200 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:1.0:1788541438.072990:0:25109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007330cc41/0x2aac941e5f4a9549 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.073001:0:25109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007330cc41/0x2aac941e5f4a9549 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.073023:0:25109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007330cc41/0x2aac941e5f4a9549 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.073031:0:25109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007330cc41/0x2aac941e5f4a9549 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.073051:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541438.073052:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541438.073054:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788541438.074175:0:24273:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:2.0:1788541438.074222:0:24273:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788541438.074411:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22796:x1875420981231232:12345-0@lo:5:osp-pre-0-0.0 Request processed in 13441us (13931us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788541438.074421:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788541438.074541:0:22796:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1788541438.074550:0:22796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e710380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22796:1875420981231232:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788541438.074574:0:22796:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00002000:00010000:3.0:1788541438.081823:0:25171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788541438.081837:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093feed03/0x2aac941e5f4a9550 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.081861:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1788541438.081866:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541438.082210:0:25171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093feed03/0x2aac941e5f4a9550 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.082227:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093feed03/0x2aac941e5f4a9550 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.082239:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093feed03/0x2aac941e5f4a9550 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.082248:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093feed03/0x2aac941e5f4a9550 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.082309:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788541438.084608:0:25171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788541438.084620:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c72b64dd/0x2aac941e5f4a9557 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.084701:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1788541438.084706:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541438.084713:0:25171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c72b64dd/0x2aac941e5f4a9557 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.084730:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c72b64dd/0x2aac941e5f4a9557 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.084748:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c72b64dd/0x2aac941e5f4a9557 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.084756:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c72b64dd/0x2aac941e5f4a9557 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.084934:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788541438.084942:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093feed03/0x2aac941e5f4a9550 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.084951:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ac600 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:1.0:1788541438.084963:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093feed03/0x2aac941e5f4a9550 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.084974:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093feed03/0x2aac941e5f4a9550 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.084993:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093feed03/0x2aac941e5f4a9550 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.085001:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093feed03/0x2aac941e5f4a9550 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.085018:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541438.085022:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c72b64dd/0x2aac941e5f4a9557 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.085028:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75fa00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:1.0:1788541438.085031:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c72b64dd/0x2aac941e5f4a9557 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.085038:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c72b64dd/0x2aac941e5f4a9557 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.085048:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c72b64dd/0x2aac941e5f4a9557 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.085056:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541438.085063:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541438.085065:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541438.085344:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788541438.085350:0:25171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c72b64dd/0x2aac941e5f4a9557 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.085835:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788541438.085965:0:25171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788541438.085971:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007330cc41/0x2aac941e5f4a955e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.085981:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1788541438.085985:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541438.085990:0:25171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007330cc41/0x2aac941e5f4a955e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.086000:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007330cc41/0x2aac941e5f4a955e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.086007:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007330cc41/0x2aac941e5f4a955e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.086024:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007330cc41/0x2aac941e5f4a955e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.086042:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788541438.086076:0:25171:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:0.0:1788541438.086368:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:22798:x1875420981230720:12345-0@lo:5:osp-pre-1-0.0 Request processed in 169391us (177089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541438.086379:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788541438.086513:0:25109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541438.086520:0:25109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007330cc41/0x2aac941e5f4a955e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.086528:0:25109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75f200 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541438.086532:0:25109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007330cc41/0x2aac941e5f4a955e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.086541:0:25109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007330cc41/0x2aac941e5f4a955e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.086576:0:25109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007330cc41/0x2aac941e5f4a955e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.086583:0:25109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007330cc41/0x2aac941e5f4a955e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541438.086595:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541438.086597:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541438.086599:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541438.086667:0:22798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22798:1875420981230720:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788541438.086682:0:22798:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:1.0:1788541438.086725:0:22798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67082f8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22798:1875420981231360:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788541438.086761:0:22798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541438.086791:0:22798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682e78fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788541438.087273:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981231360 00000100:00100000:0.0:1788541438.087280:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981231360 00000100:00100000:0.0:1788541438.087332:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788541438.087342:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22798:x1875420981231360:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788541438.087392:0:24276:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:0.0:1788541438.092177:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22798:x1875420981231360:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4762us (5341us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1788541438.092190:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788541438.092491:0:22798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67082f8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22798:1875420981231360:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788541438.092507:0:22798:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:3.0:1788541438.603075:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788541438.926014:0:22768:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788541438.926022:0:22768:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a683533d000 from 14 10000000:01000000:1.0:1788541438.926028:0:22768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788541438.926078:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842172000/0x2aac941e5f4a9565 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.926091:0:22768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a6842172000/0x2aac941e5f4a9565 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541438.926103:0:22768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a6842172000/0x2aac941e5f4a9565 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541438.926130:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67082fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981231488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788541438.926206:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541438.926243:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a681084b480 going to sleep for 11 seconds 00000100:00100000:0.0:1788541438.926476:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981231488 00000100:00100000:0.0:1788541438.926485:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981231488 00000100:00100000:0.0:1788541438.926539:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788541438.926549:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706b72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+22:22768:x1875420981231488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788541438.926574:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541438.926588:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a956c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a9565 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.926610:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a956c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a9565 expref: 23 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.926634:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a956c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a9565 expref: 23 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.926644:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75e200, rc 0) 00000100:00100000:0.0:1788541438.926688:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706b72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+23:22768:x1875420981231488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541438.926695:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788541438.926758:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67082fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981231488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788541438.926772:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a6842172000/0x2aac941e5f4a9565 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a956c expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.926781:0:22768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a6842172000/0x2aac941e5f4a9565 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a956c expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541438.926827:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981231616:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788541438.926856:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541438.926904:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682fdb2600 going to sleep for 11 seconds 00000100:00100000:0.0:1788541438.926917:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981231616 00000100:00100000:0.0:1788541438.926920:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981231616 00000100:00100000:0.0:1788541438.926942:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788541438.926948:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706b70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+23:22768:x1875420981231616:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788541438.926962:0:22766:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788541438.926976:0:22766:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788541438.926979:0:22766:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1788541438.927051:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706b70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+23:22768:x1875420981231616:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 102us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541438.927066:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788541438.927095:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981231616:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788541438.927150:0:22768:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788541438.927156:0:22768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842172000/0x2aac941e5f4a9565 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a956c expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.927164:0:22768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6842172000/0x2aac941e5f4a9565 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a956c expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541438.927173:0:22768:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788541438.927175:0:22768:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a682e797000 from 14 10000000:01000000:0.0:1788541438.927178:0:22768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788541438.927192:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a9573 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.927200:0:22768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a9573 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.927207:0:22768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a9573 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541438.927219:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981231744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788541438.927242:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541438.927255:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682fdb2600 going to sleep for 11 seconds 00000100:00100000:0.0:1788541438.927266:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981231744 00000100:00100000:0.0:1788541438.927269:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981231744 00000100:00100000:0.0:1788541438.927289:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788541438.927295:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706b73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+23:22768:x1875420981231744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788541438.927308:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541438.927316:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a957a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a9573 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.927331:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a957a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a9573 expref: 24 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.927339:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a957a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a9573 expref: 24 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.927347:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75f400, rc 0) 00000100:00100000:0.0:1788541438.927442:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706b73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+24:22768:x1875420981231744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541438.927450:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788541438.927481:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981231744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788541438.927492:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a9573 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a957a expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.927499:0:22768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a9573 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a957a expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541438.927533:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981231872:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788541438.927569:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541438.927581:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682fdb2600 going to sleep for 11 seconds 00000100:00100000:0.0:1788541438.927592:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981231872 00000100:00100000:0.0:1788541438.927595:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981231872 00000100:00100000:0.0:1788541438.927615:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788541438.927621:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706b71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+24:22768:x1875420981231872:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788541438.927638:0:22764:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788541438.927649:0:22764:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788541438.927652:0:22764:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1788541438.927710:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706b71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+24:22768:x1875420981231872:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 88us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541438.927717:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788541438.927745:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981231872:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788541438.927782:0:22768:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788541438.927788:0:22768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a9573 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a957a expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541438.927794:0:22768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a9573 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a957a expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541439.626358:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541440.667462:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541440.975380:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788541440.975403:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981232000:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788541440.975470:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541440.975519:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981232000 00000100:00100000:2.0:1788541440.975526:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981232000 00000100:00100000:2.0:1788541440.975592:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788541440.975602:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981232000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788541440.975689:0:24280:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788541440.975733:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981232000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 133us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541440.975740:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788541440.975761:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788541440.975798:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981232000:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788541441.483017:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788541441.483041:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981232128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788541441.483109:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541441.483227:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981232128 00000100:00100000:3.0:1788541441.483236:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981232128 00000100:00100000:3.0:1788541441.483294:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788541441.483303:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981232128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788541441.483338:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788541441.483390:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981232128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541441.483397:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788541441.483490:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981232128:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788541441.483639:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981232256:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788541441.483667:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541441.483854:0:23512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981232256 00000100:00100000:2.0:1788541441.483859:0:23512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981232256 00000100:00100000:2.0:1788541441.483914:0:23512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788541441.483921:0:23512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f2cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981232256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788541441.483940:0:23512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788541441.483973:0:23512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f2cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981232256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541441.483992:0:23512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788541441.484100:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981232256:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788541441.675609:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541442.699209:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541443.018759:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981232384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788541443.018830:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541443.018921:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981232384 00000100:00100000:0.0:1788541443.018929:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981232384 00000100:00100000:0.0:1788541443.018976:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788541443.018986:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875420981232384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788541443.019030:0:24280:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788541443.019071:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875420981232384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541443.019077:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788541443.019096:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788541443.019130:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981232384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788541443.020468:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981232512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788541443.020528:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541443.020559:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788541443.020565:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981232640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788541443.020586:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541443.020616:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981232512 00000100:00100000:0.0:1788541443.020621:0:24281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981232512 00000100:00100000:0.0:1788541443.020649:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981232640 00000100:00100000:0.0:1788541443.020651:0:24281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981232640 00000100:00100000:0.0:1788541443.020666:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788541443.020673:0:24281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981232512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788541443.020697:0:24281:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788541443.020738:0:24281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981232512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541443.020744:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788541443.020759:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788541443.020765:0:24281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981232640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788541443.020773:0:24281:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788541443.020797:0:24281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981232640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541443.020815:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788541443.020829:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788541443.020833:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788541443.020858:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981232640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788541443.020885:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981232512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788541443.022069:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981233024:0@lo:400:kworker.0 00000100:00100000:0.0:1788541443.022117:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541443.022139:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981233536:0@lo:400:kworker.0 00000100:00100000:0.0:1788541443.022160:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541443.022176:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788541443.022181:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981233152:0@lo:400:kworker.0 00000100:00100000:0.0:1788541443.022204:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541443.022220:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981233664:0@lo:400:kworker.0 00000100:00100000:0.0:1788541443.022239:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541443.022264:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981233152 00000100:00100000:0.0:1788541443.022268:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981233152 00000100:00100000:0.0:1788541443.022304:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788541443.022312:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981233152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541443.023820:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee13e9d8-48fa-4214-b460-99ccd69f1274:3643:1875420981232768:0@lo:400:kworker.0 00000100:00100000:3.0:1788541443.023948:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981233024 00000100:00100000:3.0:1788541443.023955:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981233024 00000100:00100000:3.0:1788541443.024052:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981233536 00000100:00100000:3.0:1788541443.024056:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981233536 00000100:00100000:3.0:1788541443.024083:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981233664 00000100:00100000:3.0:1788541443.024092:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981233664 00000100:00100000:3.0:1788541443.024110:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788541443.024118:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981233024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541443.025907:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541443.025961:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981233280:0@lo:400:kworker.0 00000100:00100000:1.0:1788541443.026000:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541443.026028:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875420981233792:0@lo:400:kworker.0 00000100:00100000:1.0:1788541443.026053:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541443.026074:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788541443.026081:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981232896:0@lo:400:kworker.0 00000100:00100000:1.0:1788541443.026104:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541443.026123:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981233408:0@lo:400:kworker.0 00000100:00100000:1.0:1788541443.026141:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541443.026152:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981233920:0@lo:400:kworker.0 00000100:00100000:1.0:1788541443.026170:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541443.026248:0:24795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981233280 00000100:00100000:2.0:1788541443.026256:0:24795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981233280 00000100:00100000:2.0:1788541443.026309:0:24795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788541443.026318:0:24795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981233280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541443.026434:0:24795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981233280:12345-0@lo:400:kworker.0 Request processed in 116us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541443.026442:0:24795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788541443.026485:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981233280:0@lo:400:kworker.0 00000100:00100000:0.0:1788541443.027539:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981233152:12345-0@lo:400:kworker.0 Request processed in 5223us (5329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541443.027549:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788541443.027572:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981232896 00000100:00100000:0.0:1788541443.027576:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981232896 00000100:00100000:0.0:1788541443.027597:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788541443.027603:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981232896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541443.027655:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981232896:12345-0@lo:400:kworker.0 Request processed in 52us (1550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541443.027661:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788541443.027682:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981232768 00000100:00100000:0.0:1788541443.027686:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981232768 00000100:00100000:0.0:1788541443.027708:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788541443.027714:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706b71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+24:3643:x1875420981232768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541443.027744:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706b71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+24:3643:x1875420981232768:12345-0@lo:400:kworker.0 Request processed in 30us (1843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541443.027750:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788541443.027791:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981232896:0@lo:400:kworker.0 00000100:00100000:0.0:1788541443.027801:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee13e9d8-48fa-4214-b460-99ccd69f1274:3643:1875420981232768:0@lo:400:kworker.0 00000100:00100000:0.0:1788541443.027844:0:22772:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788541443.027853:0:22772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788541443.027867:0:22773:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788541443.027893:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981233792 00000100:00100000:0.0:1788541443.027897:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981233792 00000100:00100000:0.0:1788541443.027917:0:22773:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788541443.027921:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981233408 00000100:00100000:0.0:1788541443.027923:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981233408 00000100:00100000:0.0:1788541443.027933:0:22773:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788541443.027937:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981233920 00000100:00100000:0.0:1788541443.027939:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981233920 00000100:00100000:0.0:1788541443.027949:0:22773:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788541443.027955:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788541443.027962:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981233536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541443.027994:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981233536:12345-0@lo:400:kworker.0 Request processed in 32us (5833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541443.028009:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788541443.028022:0:22773:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788541443.028028:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788541443.028034:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708311c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981233664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541443.028062:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708311c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981233664:12345-0@lo:400:kworker.0 Request processed in 29us (5822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541443.028068:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788541443.028078:0:22773:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788541443.028084:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788541443.028090:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875420981233792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541443.028119:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875420981233792:12345-0@lo:400:kworker.0 Request processed in 29us (2065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541443.028125:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788541443.028134:0:22773:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788541443.028139:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788541443.028144:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981233408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541443.028171:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981233408:12345-0@lo:400:kworker.0 Request processed in 26us (2029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541443.028177:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788541443.028186:0:22773:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788541443.028191:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788541443.028197:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981233920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541443.028222:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981233920:12345-0@lo:400:kworker.0 Request processed in 25us (2051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541443.028228:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1788541443.028249:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788541443.028253:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788541443.028255:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788541443.028278:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670831f800 x1875420981233408/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541443.028290:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981233408:0@lo:400:kworker.0 00010000:00080000:0.0:1788541443.028305:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670831d180 x1875420981233920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541443.028312:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981233920:0@lo:400:kworker.0 00010000:00080000:0.0:1788541443.028322:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670831dc00 x1875420981233792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541443.028330:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875420981233792:0@lo:400:kworker.0 00000100:00100000:1.0:1788541443.028449:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981233152:0@lo:400:kworker.0 00010000:00080000:1.0:1788541443.028462:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670831e680 x1875420981233664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541443.028471:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981233664:0@lo:400:kworker.0 00010000:00080000:1.0:1788541443.028482:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670831e300 x1875420981233536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541443.028491:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981233536:0@lo:400:kworker.0 00000100:00100000:3.0:1788541443.028604:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981233024:12345-0@lo:400:kworker.0 Request processed in 4486us (6485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541443.028612:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1788541443.029535:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670831f100 x1875420981233024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541443.029547:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981233024:0@lo:400:kworker.0 00000040:00080000:3.0:1788541443.087268:0:22807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788541443.724133:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788541443.873923:0:25451:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg256-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000001:00080000:1.0:1788541444.052592:0:25092:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:3.0:1788541444.746797:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788541444.915069:0:25503:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788541444.915301:0:25503:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788541445.770696:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788541445.852232:0:25553:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788541445.852632:0:25553:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788541446.090283:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981234048:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788541446.090359:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541446.090558:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981234048 00000100:00100000:2.0:1788541446.090566:0:24281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981234048 00000100:00100000:2.0:1788541446.090633:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788541446.090643:0:24281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f2cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981234048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788541446.090672:0:24281:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788541446.091052:0:24281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f2cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981234048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 410us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541446.091060:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788541446.091177:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981234048:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788541446.091240:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788541446.213649:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541446.213838:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955951488 00000100:00100000:3.0:1788541446.213848:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955951488 00000100:00100000:3.0:1788541446.213913:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 115 00000100:00100000:3.0:1788541446.213922:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706b72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2393:x1875420955951488:12345-192.168.202.56@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788541446.213950:0:22765:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from fb464d9e-1538-4f36-92c9-4fbd9231889d@192.168.202.56@tcp t0 exp 0000000000000000 cur 727 last 0 00000020:00000080:3.0:1788541446.213978:0:22765:0:(genops.c:1385:class_connect()) connect: client fb464d9e-1538-4f36-92c9-4fbd9231889d, cookie 0x2aac941e5f4a9581 00000100:00080000:3.0:1788541446.214114:0:22765:0:(import.c:65:import_set_state_nolock()) ffff9a6707a06000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788541446.214182:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706b72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb464d9e-1538-4f36-92c9-4fbd9231889d+5:2393:x1875420955951488:12345-192.168.202.56@tcp:250:mount.lustre.0 Request processed in 259us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541446.214190:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 115 00000100:00100000:1.0:1788541446.232835:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541446.235239:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955951616 00000100:00100000:0.0:1788541446.235254:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955951616 00000100:00100000:3.0:1788541446.235397:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 116 00000100:00100000:3.0:1788541446.235428:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706b71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb464d9e-1538-4f36-92c9-4fbd9231889d+5:18073:x1875420955951616:12345-192.168.202.56@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788541446.235448:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541446.235466:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a67075ad600/0x2aac941e5f4a9588 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16473202a331777 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541446.235508:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a67075ad600/0x2aac941e5f4a9588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331777 expref: 6 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541446.235521:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a67075ad600/0x2aac941e5f4a9588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331777 expref: 6 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541446.235531:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ad600, rc 0) 00000100:00100000:3.0:1788541446.235591:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706b71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb464d9e-1538-4f36-92c9-4fbd9231889d+6:18073:x1875420955951616:12345-192.168.202.56@tcp:101:mount.lustre.0 Request processed in 169us (2766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541446.235599:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 116 00000100:00100000:3.0:1788541446.242850:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541446.243188:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955951744 00000100:00100000:1.0:1788541446.243199:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955951744 00000100:00100000:1.0:1788541446.243273:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 117 00000100:00100000:1.0:1788541446.243283:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706b71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb464d9e-1538-4f36-92c9-4fbd9231889d+6:18073:x1875420955951744:12345-192.168.202.56@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788541446.243468:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706b71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb464d9e-1538-4f36-92c9-4fbd9231889d+6:18073:x1875420955951744:12345-192.168.202.56@tcp:501:mount.lustre.0 Request processed in 186us (628us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788541446.243477:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 117 00000100:00100000:1.0:1788541446.249012:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541446.249107:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955951872 00000100:00100000:0.0:1788541446.249117:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955951872 00000100:00100000:0.0:1788541446.249172:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 118 00000100:00100000:0.0:1788541446.249182:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706b70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb464d9e-1538-4f36-92c9-4fbd9231889d+6:18073:x1875420955951872:12345-192.168.202.56@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788541446.249197:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541446.249216:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a682e75f200/0x2aac941e5f4a958f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16473202a33177e expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541446.249245:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75f200/0x2aac941e5f4a958f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33177e expref: 7 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541446.249257:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a682e75f200/0x2aac941e5f4a958f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33177e expref: 7 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541446.249282:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75f200, rc 0) 00000100:00100000:0.0:1788541446.249352:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706b70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb464d9e-1538-4f36-92c9-4fbd9231889d+7:18073:x1875420955951872:12345-192.168.202.56@tcp:101:mount.lustre.0 Request processed in 171us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541446.249360:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 118 00000100:00100000:2.0:1788541446.254190:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541446.254269:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955952000 00000100:00100000:3.0:1788541446.254278:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955952000 00000100:00100000:3.0:1788541446.254342:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 119 00000100:00100000:3.0:1788541446.254353:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706b70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb464d9e-1538-4f36-92c9-4fbd9231889d+7:18073:x1875420955952000:12345-192.168.202.56@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788541446.254522:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706b70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb464d9e-1538-4f36-92c9-4fbd9231889d+8:18073:x1875420955952000:12345-192.168.202.56@tcp:501:mount.lustre.0 Request processed in 169us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541446.254530:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 119 00000100:00100000:3.0:1788541446.257452:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541446.257602:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955952128 00000100:00100000:1.0:1788541446.257612:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955952128 00000100:00100000:1.0:1788541446.257667:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 120 00000100:00100000:1.0:1788541446.257677:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706b70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb464d9e-1538-4f36-92c9-4fbd9231889d+8:18073:x1875420955952128:12345-192.168.202.56@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788541446.257825:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706b70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb464d9e-1538-4f36-92c9-4fbd9231889d+8:18073:x1875420955952128:12345-192.168.202.56@tcp:503:mount.lustre.0 Request processed in 149us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541446.257834:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 120 00000100:00100000:1.0:1788541446.281835:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541446.282021:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955952256 00000100:00100000:0.0:1788541446.282042:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955952256 00000100:00100000:0.0:1788541446.282101:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 121 00000100:00100000:0.0:1788541446.282111:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706b73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb464d9e-1538-4f36-92c9-4fbd9231889d+8:18091:x1875420955952256:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788541446.282261:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706b73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb464d9e-1538-4f36-92c9-4fbd9231889d+8:18091:x1875420955952256:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 151us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541446.282270:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 121 00000100:00100000:2.0:1788541446.347141:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541446.347230:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955952384 00000100:00100000:3.0:1788541446.347243:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955952384 00000100:00100000:3.0:1788541446.347307:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 122 00000100:00100000:3.0:1788541446.347342:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706b73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb464d9e-1538-4f36-92c9-4fbd9231889d+8:18091:x1875420955952384:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788541446.347511:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706b73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb464d9e-1538-4f36-92c9-4fbd9231889d+8:18091:x1875420955952384:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 171us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541446.347519:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 122 00000100:00100000:3.0:1788541446.367766:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541446.367841:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955952512 00000100:00100000:1.0:1788541446.367852:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955952512 00000100:00100000:1.0:1788541446.367958:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 123 00000100:00100000:1.0:1788541446.367969:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708319050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb464d9e-1538-4f36-92c9-4fbd9231889d+8:18091:x1875420955952512:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788541446.368152:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708319050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb464d9e-1538-4f36-92c9-4fbd9231889d+8:18091:x1875420955952512:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 184us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541446.368161:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 123 00000100:00100000:1.0:1788541446.376247:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541446.376499:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955952640 00000100:00100000:0.0:1788541446.376509:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955952640 00000100:00100000:0.0:1788541446.376565:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 124 00000100:00100000:0.0:1788541446.376574:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb464d9e-1538-4f36-92c9-4fbd9231889d+8:18073:x1875420955952640:12345-192.168.202.56@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788541446.376592:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541446.376611:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a682e75fa00/0x2aac941e5f4a9596 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16473202a3317af expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541446.376641:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75fa00/0x2aac941e5f4a9596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3317af expref: 9 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541446.376652:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a682e75fa00/0x2aac941e5f4a9596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3317af expref: 9 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541446.376662:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75fa00, rc 0) 00000100:00100000:0.0:1788541446.376743:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb464d9e-1538-4f36-92c9-4fbd9231889d+9:18073:x1875420955952640:12345-192.168.202.56@tcp:101:mount.lustre.0 Request processed in 169us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541446.376750:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 124 00000100:00100000:2.0:1788541446.389594:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541446.389675:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955952768 00000100:00100000:3.0:1788541446.389686:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955952768 00000100:00100000:3.0:1788541446.389743:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 125 00000100:00100000:3.0:1788541446.389752:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708319850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb464d9e-1538-4f36-92c9-4fbd9231889d+9:18073:x1875420955952768:12345-192.168.202.56@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788541446.389775:0:22765:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788541446.389800:0:22765:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788541446.389804:0:22765:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788541446.389808:0:22765:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788541446.389811:0:22765:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788541446.389813:0:22765:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1788541446.401313:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708319850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb464d9e-1538-4f36-92c9-4fbd9231889d+9:18073:x1875420955952768:12345-192.168.202.56@tcp:256:mount.lustre.0 Request processed in 11543us (11709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541446.401328:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 125 00000100:00100000:1.0:1788541446.426099:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541446.426238:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955952896 00000100:00100000:0.0:1788541446.426248:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955952896 00000100:00100000:0.0:1788541446.426315:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 126 00000100:00100000:0.0:1788541446.426326:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb464d9e-1538-4f36-92c9-4fbd9231889d+9:18073:x1875420955952896:12345-192.168.202.56@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788541446.426344:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541446.426364:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6800030200/0x2aac941e5f4a959d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16473202a3317b6 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541446.426393:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6800030200/0x2aac941e5f4a959d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3317b6 expref: 10 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541446.426405:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6800030200/0x2aac941e5f4a959d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3317b6 expref: 10 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541446.426416:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6800030200, rc 0) 00000100:00100000:0.0:1788541446.426479:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb464d9e-1538-4f36-92c9-4fbd9231889d+10:18073:x1875420955952896:12345-192.168.202.56@tcp:101:mount.lustre.0 Request processed in 154us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541446.426513:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 126 00000100:00100000:2.0:1788541446.430390:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541446.430562:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955953024 00000100:00100000:0.0:1788541446.430573:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955953024 00000100:00100000:0.0:1788541446.430632:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 127 00000100:00100000:0.0:1788541446.430641:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb464d9e-1538-4f36-92c9-4fbd9231889d+10:18073:x1875420955953024:12345-192.168.202.56@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788541446.430809:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb464d9e-1538-4f36-92c9-4fbd9231889d+10:18073:x1875420955953024:12345-192.168.202.56@tcp:501:mount.lustre.0 Request processed in 168us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541446.430818:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 127 00000100:00100000:3.0:1788541446.432422:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541446.432605:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955953152 00000100:00100000:2.0:1788541446.432614:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955953152 00000100:00100000:2.0:1788541446.432664:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 128 00000100:00100000:2.0:1788541446.432674:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670690d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb464d9e-1538-4f36-92c9-4fbd9231889d+10:18073:x1875420955953152:12345-192.168.202.56@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788541446.432813:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670690d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb464d9e-1538-4f36-92c9-4fbd9231889d+10:18073:x1875420955953152:12345-192.168.202.56@tcp:503:mount.lustre.0 Request processed in 140us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541446.432822:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 128 00000100:00100000:3.0:1788541446.447077:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541446.448550:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955953280 00000100:00100000:1.0:1788541446.448564:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955953280 00000100:00100000:1.0:1788541446.448630:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 129 00000100:00100000:1.0:1788541446.448640:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670690fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb464d9e-1538-4f36-92c9-4fbd9231889d+10:18098:x1875420955953280:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788541446.448800:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670690fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb464d9e-1538-4f36-92c9-4fbd9231889d+10:18098:x1875420955953280:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 160us (1734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541446.448809:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 129 00000100:00100000:1.0:1788541446.479734:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541446.480070:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955953408 00000100:00100000:0.0:1788541446.480081:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955953408 00000100:00100000:0.0:1788541446.480137:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 130 00000100:00100000:0.0:1788541446.480147:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670690c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb464d9e-1538-4f36-92c9-4fbd9231889d+10:18098:x1875420955953408:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788541446.480310:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670690c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb464d9e-1538-4f36-92c9-4fbd9231889d+10:18098:x1875420955953408:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 158us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541446.480319:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 130 00000100:00100000:3.0:1788541446.493106:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541446.493214:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955953536 00000100:00100000:0.0:1788541446.493225:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955953536 00000100:00100000:0.0:1788541446.493279:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:0.0:1788541446.493288:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f2cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1875420955953536:12345-192.168.202.56@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788541446.493329:0:22773:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 99be596c-2540-43f5-83c8-4f74e1767f87@192.168.202.56@tcp t0 exp 0000000000000000 cur 727 last 0 00000020:00000080:0.0:1788541446.493383:0:22773:0:(genops.c:1385:class_connect()) connect: client 99be596c-2540-43f5-83c8-4f74e1767f87, cookie 0x2aac941e5f4a95a4 00000004:00100000:0.0:1788541446.493412:0:22773:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788541446.493631:0:22773:0:(import.c:65:import_set_state_nolock()) ffff9a6707b97000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788541446.493706:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f2cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99be596c-2540-43f5-83c8-4f74e1767f87+6:2393:x1875420955953536:12345-192.168.202.56@tcp:38:mount.lustre.0 Request processed in 417us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541446.493715:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:3.0:1788541446.495243:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541446.495424:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955953792 00000100:00100000:0.0:1788541446.495433:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955953792 00000100:00100000:0.0:1788541446.495479:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 8 00000100:00100000:0.0:1788541446.495496:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f2cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2393:x1875420955953792:12345-192.168.202.56@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788541446.495531:0:22772:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 99be596c-2540-43f5-83c8-4f74e1767f87@192.168.202.56@tcp t0 exp 0000000000000000 cur 727 last 0 00000020:00000080:0.0:1788541446.495575:0:22772:0:(genops.c:1385:class_connect()) connect: client 99be596c-2540-43f5-83c8-4f74e1767f87, cookie 0x2aac941e5f4a95ab 00000004:00100000:0.0:1788541446.495598:0:22772:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788541446.495811:0:22772:0:(import.c:65:import_set_state_nolock()) ffff9a6707b96000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788541446.495914:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f2cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99be596c-2540-43f5-83c8-4f74e1767f87+6:2393:x1875420955953792:12345-192.168.202.56@tcp:38:mount.lustre.0 Request processed in 417us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541446.495922:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 8 00000100:00100000:1.0:1788541446.508001:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541446.508059:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541446.508189:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955954048 00000100:00100000:3.0:1788541446.508199:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955954048 00000100:00100000:3.0:1788541446.508283:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955953664 00000100:00100000:3.0:1788541446.508287:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955953664 00000100:00080000:1.0:1788541446.508433:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541446.508534:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00100000:3.0:1788541446.508546:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99be596c-2540-43f5-83c8-4f74e1767f87+7:18073:x1875420955954048:12345-192.168.202.56@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788541446.508588:0:22771:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788541446.508674:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99be596c-2540-43f5-83c8-4f74e1767f87+7:18073:x1875420955954048:12345-192.168.202.56@tcp:41:mount.lustre.0 Request processed in 130us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541446.508694:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00100000:3.0:1788541446.508712:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:3.0:1788541446.508719:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99be596c-2540-43f5-83c8-4f74e1767f87+6:0:x1875420955953664:12345-192.168.202.56@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788541446.508729:0:22771:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788541446.508752:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99be596c-2540-43f5-83c8-4f74e1767f87+6:0:x1875420955953664:12345-192.168.202.56@tcp:41:mount.lustre.0 Request processed in 33us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541446.508758:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:3.0:1788541446.527265:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541446.527436:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955954176 00000100:00100000:2.0:1788541446.527446:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955954176 00000100:00100000:2.0:1788541446.527541:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 11 00000100:00100000:2.0:1788541446.527551:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f2cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99be596c-2540-43f5-83c8-4f74e1767f87+6:18073:x1875420955954176:12345-192.168.202.56@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788541446.527634:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f2cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99be596c-2540-43f5-83c8-4f74e1767f87+6:18073:x1875420955954176:12345-192.168.202.56@tcp:40:mount.lustre.0 Request processed in 84us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541446.527641:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 11 00000100:00100000:3.0:1788541446.528073:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541446.528186:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955953920 00000100:00100000:0.0:1788541446.528192:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955953920 00000100:00100000:0.0:1788541446.528246:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 12 00000100:00100000:0.0:1788541446.528254:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f2cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99be596c-2540-43f5-83c8-4f74e1767f87+6:0:x1875420955953920:12345-192.168.202.56@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788541446.528280:0:22771:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788541446.528356:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f2cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99be596c-2540-43f5-83c8-4f74e1767f87+6:0:x1875420955953920:12345-192.168.202.56@tcp:41:mount.lustre.0 Request processed in 102us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541446.528363:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 12 00000100:00080000:2.0:1788541446.528477:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788541446.532055:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541446.532198:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955954560 00000100:00100000:3.0:1788541446.532210:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955954560 00000100:00100000:3.0:1788541446.532280:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 3 00000100:00100000:3.0:1788541446.532291:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683630d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:99be596c-2540-43f5-83c8-4f74e1767f87+6:18073:x1875420955954560:12345-192.168.202.56@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788541446.532402:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683630d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:99be596c-2540-43f5-83c8-4f74e1767f87+6:18073:x1875420955954560:12345-192.168.202.56@tcp:900:mount.lustre.0 Request processed in 112us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541446.532410:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 3 00000100:00100000:2.0:1788541446.533478:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541446.533530:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541446.533889:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955954304 00000100:00100000:1.0:1788541446.533896:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955954304 00000100:00100000:1.0:1788541446.533940:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955954432 00000100:00100000:1.0:1788541446.533943:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955954432 00000100:00100000:1.0:1788541446.533970:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:1.0:1788541446.533978:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2393:x1875420955954304:12345-192.168.202.56@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788541446.534013:0:24277:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 99be596c-2540-43f5-83c8-4f74e1767f87@192.168.202.56@tcp t0 exp 0000000000000000 cur 727 last 0 00000020:00000080:1.0:1788541446.534060:0:24277:0:(genops.c:1385:class_connect()) connect: client 99be596c-2540-43f5-83c8-4f74e1767f87, cookie 0x2aac941e5f4a95b2 00002000:00100000:1.0:1788541446.534077:0:24277:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 99be596c-2540-43f5-83c8-4f74e1767f87/ffff9a67082da800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788541446.534090:0:24277:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788541446.534301:0:24277:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:3.0:1788541446.534402:0:24795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 18 00000100:00100000:3.0:1788541446.534409:0:24795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2393:x1875420955954432:12345-192.168.202.56@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788541446.534428:0:24795:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 99be596c-2540-43f5-83c8-4f74e1767f87@192.168.202.56@tcp t0 exp 0000000000000000 cur 727 last 0 00000020:00000080:3.0:1788541446.534446:0:24795:0:(genops.c:1385:class_connect()) connect: client 99be596c-2540-43f5-83c8-4f74e1767f87, cookie 0x2aac941e5f4a95b9 00002000:00100000:3.0:1788541446.534451:0:24795:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 99be596c-2540-43f5-83c8-4f74e1767f87/ffff9a6707a00000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788541446.534465:0:24795:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788541446.534608:0:24795:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788541446.534642:0:24795:0:(import.c:65:import_set_state_nolock()) ffff9a6707a04000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788541446.534704:0:24795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99be596c-2540-43f5-83c8-4f74e1767f87+6:2393:x1875420955954432:12345-192.168.202.56@tcp:8:mount.lustre.0 Request processed in 293us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541446.534712:0:24795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 18 00000100:00080000:1.0:1788541446.535241:0:24277:0:(import.c:65:import_set_state_nolock()) ffff9a67082da000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788541446.535339:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99be596c-2540-43f5-83c8-4f74e1767f87+6:2393:x1875420955954304:12345-192.168.202.56@tcp:8:mount.lustre.0 Request processed in 1360us (1864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541446.535348:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:2.0:1788541446.545667:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541446.545785:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955954688 00000100:00100000:1.0:1788541446.545795:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955954688 00000100:00100000:1.0:1788541446.545902:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 0 00000100:00100000:1.0:1788541446.545912:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99be596c-2540-43f5-83c8-4f74e1767f87+6:18073:x1875420955954688:12345-192.168.202.56@tcp:33:mount.lustre.0 00000004:00080000:0.0:1788541446.559591:0:22774:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 13581us 00000004:00200000:1.0:1788541446.595322:0:22774:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788541446.595477:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99be596c-2540-43f5-83c8-4f74e1767f87+6:18073:x1875420955954688:12345-192.168.202.56@tcp:33:mount.lustre.0 Request processed in 49561us (49814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541446.595498:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 0 00000100:00100000:1.0:1788541446.602130:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788541446.602154:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708313800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981234176:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788541446.602228:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541446.602340:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981234176 00000100:00100000:0.0:1788541446.602348:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981234176 00000100:00100000:0.0:1788541446.602409:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788541446.602419:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683630ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981234176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788541446.602444:0:22776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788541446.602505:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683630ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981234176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541446.602511:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788541446.602586:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708313800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981234176:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788541446.602757:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788541446.602768:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682e710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981234304:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788541446.602798:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541446.602904:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981234304 00000100:00100000:3.0:1788541446.602909:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981234304 00000100:00100000:3.0:1788541446.602934:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788541446.602940:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683630e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981234304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788541446.602954:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788541446.603003:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683630e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981234304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541446.603010:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788541446.603106:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682e710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981234304:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788541446.794897:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541446.843627:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541446.843743:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955954816 00000100:00100000:0.0:1788541446.843767:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955954816 00000100:00100000:0.0:1788541446.843830:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 13 00000100:00100000:0.0:1788541446.843839:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99be596c-2540-43f5-83c8-4f74e1767f87+6:18121:x1875420955954816:12345-192.168.202.56@tcp:101:mkdir.0 00010000:00010000:0.0:1788541446.843860:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541446.843915:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a95c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3317e7 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541446.843979:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030a00/0x2aac941e5f4a95c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541446.843994:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030a00/0x2aac941e5f4a95c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541446.844009:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030a00/0x2aac941e5f4a95c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541446.844072:0:22772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788541446.844077:0:22772:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788541446.844112:0:22772:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030a00/0x2aac941e5f4a95c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541446.844137:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a95c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3317e7 expref: 8 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541446.844157:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030a00/0x2aac941e5f4a95c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3317e7 expref: 7 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541446.844166:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6835327b00) 00010000:00010000:0.0:1788541446.844168:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788541446.844172:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6800030a00, rc 0) 00000100:00100000:0.0:1788541446.844247:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99be596c-2540-43f5-83c8-4f74e1767f87+7:18121:x1875420955954816:12345-192.168.202.56@tcp:101:mkdir.0 Request processed in 408us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541446.844254:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 13 00000040:00080000:0.0:1788541447.562620:0:23524:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788541447.818151:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541448.138123:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788541448.138144:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708311500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981234432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788541448.138440:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541448.138761:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981234432 00000100:00100000:3.0:1788541448.138768:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981234432 00000100:00100000:3.0:1788541448.138832:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788541448.138843:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708312300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981234432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788541448.138897:0:24280:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788541448.138946:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708312300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981234432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541448.138953:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788541448.138977:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f2cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981234688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541448.139016:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541448.139040:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788541448.139047:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683630c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981234560:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788541448.139104:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541448.139126:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981234688 00000100:00100000:3.0:1788541448.139129:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981234688 00000100:00100000:3.0:1788541448.139146:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981234560 00000100:00100000:3.0:1788541448.139149:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981234560 00000100:00100000:3.0:1788541448.139162:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788541448.139367:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f2ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981234688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788541448.139388:0:24280:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788541448.139423:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f2ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981234688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 254us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541448.139429:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788541448.139441:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788541448.139447:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f2cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981234560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788541448.139456:0:24280:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788541448.139491:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f2cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981234560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541448.139497:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788541448.139533:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683630c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981234560:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788541448.139542:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1788541448.139559:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f2cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981234688:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788541448.140648:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788541448.140655:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788541448.140980:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708311500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981234432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788541448.143416:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981234944:0@lo:400:kworker.0 00000100:00100000:1.0:1788541448.143496:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541448.143546:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875420981235456:0@lo:400:kworker.0 00000100:00100000:1.0:1788541448.143571:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541448.143590:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875420981235968:0@lo:400:kworker.0 00000100:00100000:1.0:1788541448.143609:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541448.143632:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788541448.143669:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee13e9d8-48fa-4214-b460-99ccd69f1274:3644:1875420981234816:0@lo:400:kworker.0 00000100:00100000:1.0:1788541448.143698:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541448.143728:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981235328:0@lo:400:kworker.0 00000100:00100000:1.0:1788541448.143751:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541448.143778:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875420981235840:0@lo:400:kworker.0 00000100:00100000:1.0:1788541448.143807:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541448.143844:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981235456 00000100:00100000:1.0:1788541448.143852:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981235456 00000100:00100000:1.0:1788541448.143947:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981235968 00000100:00100000:1.0:1788541448.143958:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981235968 00000100:00100000:1.0:1788541448.143981:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981235840 00000100:00100000:1.0:1788541448.143983:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981235840 00000100:00100000:1.0:1788541448.143998:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788541448.144006:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683630f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875420981235456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541448.144075:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683630f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875420981235456:12345-0@lo:400:kworker.0 Request processed in 68us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541448.144082:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788541448.144101:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788541448.144108:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683630d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875420981235968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541448.144136:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683630d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875420981235968:12345-0@lo:400:kworker.0 Request processed in 29us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541448.144142:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788541448.144152:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788541448.144158:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683630ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875420981235840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541448.144183:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683630ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875420981235840:12345-0@lo:400:kworker.0 Request processed in 26us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541448.144198:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788541448.144215:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981235328 00000100:00100000:1.0:1788541448.144218:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981235328 00000100:00100000:1.0:1788541448.144243:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788541448.144249:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683630c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981235328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541448.144294:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683630c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981235328:12345-0@lo:400:kworker.0 Request processed in 45us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541448.144301:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788541448.144318:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788541448.144322:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788541448.144323:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788541448.144351:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981235328:0@lo:400:kworker.0 00000100:00100000:1.0:1788541448.144362:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875420981235840:0@lo:400:kworker.0 00000100:00100000:1.0:1788541448.144383:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875420981235456:0@lo:400:kworker.0 00010000:00080000:1.0:1788541448.144401:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670831c380 x1875420981235968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541448.144411:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875420981235968:0@lo:400:kworker.0 00000100:00100000:0.0:1788541448.144599:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981235072:0@lo:400:kworker.0 00000100:00100000:0.0:1788541448.144646:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541448.144678:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981235584:0@lo:400:kworker.0 00000100:00100000:0.0:1788541448.144705:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541448.144724:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788541448.144730:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981235200:0@lo:400:kworker.0 00000100:00100000:0.0:1788541448.144752:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541448.144773:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981235712:0@lo:400:kworker.0 00000100:00100000:0.0:1788541448.144793:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541448.144826:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981235072 00000100:00100000:0.0:1788541448.144830:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981235072 00000100:00100000:0.0:1788541448.144856:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981235584 00000100:00100000:0.0:1788541448.144858:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981235584 00000100:00100000:0.0:1788541448.144913:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981235712 00000100:00100000:0.0:1788541448.144924:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981235712 00000100:00100000:0.0:1788541448.144940:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788541448.144946:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708311500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981235072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541448.144985:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708311500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981235072:12345-0@lo:400:kworker.0 Request processed in 39us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541448.144998:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788541448.145011:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788541448.145017:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708312d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981235584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541448.145046:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708312d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981235584:12345-0@lo:400:kworker.0 Request processed in 29us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541448.145051:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788541448.145089:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788541448.145095:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708312680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981235712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541448.145121:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708312680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981235712:12345-0@lo:400:kworker.0 Request processed in 27us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541448.145127:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1788541448.145153:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670831c700 x1875420981235712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541448.145163:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981235712:0@lo:400:kworker.0 00000100:00100000:0.0:1788541448.145174:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981235072:0@lo:400:kworker.0 00000100:00100000:0.0:1788541448.145182:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981235584:0@lo:400:kworker.0 00000100:00100000:2.0:1788541448.145365:0:23512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981234944 00000100:00100000:2.0:1788541448.145370:0:23512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981234944 00000100:00100000:2.0:1788541448.145405:0:23512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981235200 00000100:00100000:2.0:1788541448.145409:0:23512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981235200 00000100:00100000:2.0:1788541448.145422:0:23512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788541448.145429:0:23512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683630ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981234944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541448.145480:0:23512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683630ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981234944:12345-0@lo:400:kworker.0 Request processed in 51us (1984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541448.145485:0:23512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788541448.145497:0:23512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788541448.145511:0:23512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708313100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981235200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541448.145539:0:23512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708313100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981235200:12345-0@lo:400:kworker.0 Request processed in 29us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541448.145544:0:23512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788541448.145564:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981234816 00000100:00100000:2.0:1788541448.145582:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981234816 00000100:00100000:2.0:1788541448.145613:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788541448.145619:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670690e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+24:3644:x1875420981234816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541448.145648:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670690e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+24:3644:x1875420981234816:12345-0@lo:400:kworker.0 Request processed in 29us (1949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541448.145653:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:1.0:1788541448.145800:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788541448.145805:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788541448.145827:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee13e9d8-48fa-4214-b460-99ccd69f1274:3644:1875420981234816:0@lo:400:kworker.0 00000100:00100000:1.0:1788541448.145839:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981234944:0@lo:400:kworker.0 00000100:00100000:0.0:1788541448.146624:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981235200:0@lo:400:kworker.0 00000100:00100000:3.0:1788541448.676704:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541448.676805:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955954944 00000100:00100000:0.0:1788541448.676816:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955954944 00000100:00100000:0.0:1788541448.676934:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 14 00000100:00100000:0.0:1788541448.676945:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f2cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99be596c-2540-43f5-83c8-4f74e1767f87+7:18173:x1875420955954944:12345-192.168.202.56@tcp:41:lfs.0 00000004:00000024:0.0:1788541448.676984:0:22772:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788541448.677087:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f2cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99be596c-2540-43f5-83c8-4f74e1767f87+7:18173:x1875420955954944:12345-192.168.202.56@tcp:41:lfs.0 Request processed in 144us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541448.677108:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 14 00000100:00080000:1.0:1788541448.677529:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788541448.683653:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541448.683753:0:25397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955955072 00000100:00100000:3.0:1788541448.683763:0:25397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955955072 00000100:00100000:3.0:1788541448.684035:0:25397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 15 00000100:00100000:3.0:1788541448.684048:0:25397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99be596c-2540-43f5-83c8-4f74e1767f87+6:18173:x1875420955955072:12345-192.168.202.56@tcp:41:lfs.0 00000004:00000024:3.0:1788541448.684086:0:25397:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788541448.684181:0:25397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99be596c-2540-43f5-83c8-4f74e1767f87+6:18173:x1875420955955072:12345-192.168.202.56@tcp:41:lfs.0 Request processed in 135us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541448.684188:0:25397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 15 00000100:00080000:1.0:1788541448.684384:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788541448.690761:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541448.690860:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955955200 00000100:00100000:0.0:1788541448.690893:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955955200 00000100:00100000:0.0:1788541448.691029:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 13 00000100:00100000:0.0:1788541448.691039:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f2cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:99be596c-2540-43f5-83c8-4f74e1767f87+6:18173:x1875420955955200:12345-192.168.202.56@tcp:13:lfs.0 00002000:00000024:0.0:1788541448.691064:0:24280:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788541448.691224:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f2cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:99be596c-2540-43f5-83c8-4f74e1767f87+6:18173:x1875420955955200:12345-192.168.202.56@tcp:13:lfs.0 Request processed in 185us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541448.691231:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 13 00000100:00080000:1.0:1788541448.691599:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788541448.693721:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541448.693814:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955955328 00000100:00100000:3.0:1788541448.693824:0:24281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955955328 00000100:00100000:3.0:1788541448.694109:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 14 00000100:00100000:3.0:1788541448.694121:0:24281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:99be596c-2540-43f5-83c8-4f74e1767f87+6:18173:x1875420955955328:12345-192.168.202.56@tcp:13:lfs.0 00002000:00000024:3.0:1788541448.694144:0:24281:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788541448.694228:0:24281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:99be596c-2540-43f5-83c8-4f74e1767f87+6:18173:x1875420955955328:12345-192.168.202.56@tcp:13:lfs.0 Request processed in 109us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541448.694235:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 14 00000100:00080000:1.0:1788541448.694473:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788541448.842181:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541448.842234:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541448.845830:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955955456 00000100:00100000:1.0:1788541448.845847:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955955456 00000100:00100000:1.0:1788541448.845954:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 132 00000100:00100000:1.0:1788541448.845964:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670690c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb464d9e-1538-4f36-92c9-4fbd9231889d+10:18205:x1875420955955456:12345-192.168.202.56@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788541448.845980:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541448.845998:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a683551a000/0x2aac941e5f4a95ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16473202a3317ee expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541448.846026:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a683551a000/0x2aac941e5f4a95ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3317ee expref: 11 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541448.846037:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a683551a000/0x2aac941e5f4a95ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3317ee expref: 11 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541448.846047:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551a000, rc 0) 00000100:00100000:1.0:1788541448.846115:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670690c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb464d9e-1538-4f36-92c9-4fbd9231889d+11:18205:x1875420955955456:12345-192.168.202.56@tcp:101:mount.lustre.0 Request processed in 152us (3889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541448.846122:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 132 00000100:00100000:2.0:1788541448.849730:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541448.849854:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955955584 00000100:00100000:0.0:1788541448.849970:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955955584 00000100:00100000:0.0:1788541448.854221:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 133 00000100:00100000:0.0:1788541448.854247:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670690c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb464d9e-1538-4f36-92c9-4fbd9231889d+11:18205:x1875420955955584:12345-192.168.202.56@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788541448.854440:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670690c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb464d9e-1538-4f36-92c9-4fbd9231889d+11:18205:x1875420955955584:12345-192.168.202.56@tcp:501:mount.lustre.0 Request processed in 205us (4718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541448.854448:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 133 00000100:00100000:3.0:1788541448.861472:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541448.861611:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955955712 00000100:00100000:2.0:1788541448.861622:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955955712 00000100:00100000:2.0:1788541448.861679:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 134 00000100:00100000:2.0:1788541448.861689:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670690d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb464d9e-1538-4f36-92c9-4fbd9231889d+11:18205:x1875420955955712:12345-192.168.202.56@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788541448.861842:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670690d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb464d9e-1538-4f36-92c9-4fbd9231889d+11:18205:x1875420955955712:12345-192.168.202.56@tcp:503:mount.lustre.0 Request processed in 154us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541448.861851:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 134 00000100:00100000:2.0:1788541448.882184:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541448.882278:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955955840 00000100:00100000:0.0:1788541448.882288:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955955840 00000100:00100000:0.0:1788541448.882357:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 135 00000100:00100000:0.0:1788541448.882368:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670690f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb464d9e-1538-4f36-92c9-4fbd9231889d+11:18212:x1875420955955840:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788541448.882533:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670690f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb464d9e-1538-4f36-92c9-4fbd9231889d+11:18212:x1875420955955840:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 166us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541448.882542:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 135 00000100:00100000:3.0:1788541448.898316:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541448.898467:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955955968 00000100:00100000:1.0:1788541448.898477:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955955968 00000100:00100000:1.0:1788541448.898536:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 136 00000100:00100000:1.0:1788541448.898547:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670690e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb464d9e-1538-4f36-92c9-4fbd9231889d+11:18212:x1875420955955968:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788541448.898702:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670690e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb464d9e-1538-4f36-92c9-4fbd9231889d+11:18212:x1875420955955968:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 156us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541448.898711:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 136 00000100:00100000:3.0:1788541448.903024:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541448.903091:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955956096 00000100:00100000:2.0:1788541448.903101:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955956096 00000100:00100000:2.0:1788541448.903161:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 137 00000100:00100000:2.0:1788541448.903171:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670690cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb464d9e-1538-4f36-92c9-4fbd9231889d+11:18212:x1875420955956096:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788541448.903340:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670690cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb464d9e-1538-4f36-92c9-4fbd9231889d+11:18212:x1875420955956096:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 170us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541448.903349:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 137 00000100:00100000:2.0:1788541448.913104:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541448.914264:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955956224 00000100:00100000:0.0:1788541448.914291:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955956224 00000100:00100000:0.0:1788541448.914562:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 138 00000100:00100000:0.0:1788541448.914574:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670690ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb464d9e-1538-4f36-92c9-4fbd9231889d+11:18205:x1875420955956224:12345-192.168.202.56@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788541448.914592:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541448.914610:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6800030400/0x2aac941e5f4a95d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16473202a33181f expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541448.914639:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6800030400/0x2aac941e5f4a95d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33181f expref: 12 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541448.914652:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6800030400/0x2aac941e5f4a95d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33181f expref: 12 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541448.914661:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6800030400, rc 0) 00000100:00100000:0.0:1788541448.914733:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670690ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb464d9e-1538-4f36-92c9-4fbd9231889d+12:18205:x1875420955956224:12345-192.168.202.56@tcp:101:mount.lustre.0 Request processed in 162us (1640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541448.914741:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 138 00000100:00100000:3.0:1788541448.917096:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541448.917352:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955956352 00000100:00100000:1.0:1788541448.917373:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955956352 00000100:00100000:1.0:1788541448.917426:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 139 00000100:00100000:1.0:1788541448.917436:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804595450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb464d9e-1538-4f36-92c9-4fbd9231889d+12:18205:x1875420955956352:12345-192.168.202.56@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788541448.917484:0:22766:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788541448.917514:0:22766:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788541448.917519:0:22766:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788541448.917522:0:22766:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788541448.917525:0:22766:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788541448.917528:0:22766:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1788541448.919371:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804595450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb464d9e-1538-4f36-92c9-4fbd9231889d+12:18205:x1875420955956352:12345-192.168.202.56@tcp:256:mount.lustre.0 Request processed in 1919us (2266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541448.919384:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 139 00000100:00100000:3.0:1788541448.922406:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541448.922509:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955956480 00000100:00100000:0.0:1788541448.922518:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955956480 00000100:00100000:0.0:1788541448.922569:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 140 00000100:00100000:0.0:1788541448.922577:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804597850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb464d9e-1538-4f36-92c9-4fbd9231889d+12:18205:x1875420955956480:12345-192.168.202.56@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788541448.922592:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541448.922607:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6800030e00/0x2aac941e5f4a95dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16473202a331826 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541448.922633:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6800030e00/0x2aac941e5f4a95dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331826 expref: 13 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541448.922643:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6800030e00/0x2aac941e5f4a95dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331826 expref: 13 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541448.922664:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6800030e00, rc 0) 00000100:00100000:0.0:1788541448.922708:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804597850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb464d9e-1538-4f36-92c9-4fbd9231889d+13:18205:x1875420955956480:12345-192.168.202.56@tcp:101:mount.lustre.0 Request processed in 132us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541448.922715:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 140 00000100:00100000:3.0:1788541448.924314:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541448.924480:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955956608 00000100:00100000:1.0:1788541448.924488:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955956608 00000100:00100000:1.0:1788541448.924576:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 141 00000100:00100000:1.0:1788541448.924585:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804597050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb464d9e-1538-4f36-92c9-4fbd9231889d+13:18205:x1875420955956608:12345-192.168.202.56@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788541448.924723:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804597050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb464d9e-1538-4f36-92c9-4fbd9231889d+13:18205:x1875420955956608:12345-192.168.202.56@tcp:501:mount.lustre.0 Request processed in 138us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541448.924730:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 141 00000100:00100000:3.0:1788541448.926189:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541448.926653:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955956736 00000100:00100000:0.0:1788541448.926662:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955956736 00000100:00100000:0.0:1788541448.926697:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 142 00000100:00100000:0.0:1788541448.926704:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804594c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb464d9e-1538-4f36-92c9-4fbd9231889d+13:18205:x1875420955956736:12345-192.168.202.56@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788541448.926828:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804594c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb464d9e-1538-4f36-92c9-4fbd9231889d+13:18205:x1875420955956736:12345-192.168.202.56@tcp:503:mount.lustre.0 Request processed in 124us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541448.926835:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 142 00000100:00100000:3.0:1788541448.928685:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541448.929180:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955956864 00000100:00100000:0.0:1788541448.929190:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955956864 00000100:00100000:0.0:1788541448.929234:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 143 00000100:00100000:0.0:1788541448.929242:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804596850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb464d9e-1538-4f36-92c9-4fbd9231889d+13:18217:x1875420955956864:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788541448.929633:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804596850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb464d9e-1538-4f36-92c9-4fbd9231889d+13:18217:x1875420955956864:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 385us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541448.929641:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 143 00000100:00100000:2.0:1788541448.931345:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541448.931489:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955956992 00000100:00100000:0.0:1788541448.931499:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955956992 00000100:00100000:0.0:1788541448.931548:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 144 00000100:00100000:0.0:1788541448.931558:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804596450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb464d9e-1538-4f36-92c9-4fbd9231889d+13:18217:x1875420955956992:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788541448.931730:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804596450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb464d9e-1538-4f36-92c9-4fbd9231889d+13:18217:x1875420955956992:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 172us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541448.931747:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 144 00000100:00100000:2.0:1788541448.942085:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541448.942173:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541448.953079:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955957120 00000100:00100000:0.0:1788541448.953096:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955957120 00000100:00100000:0.0:1788541448.953291:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955957376 00000100:00100000:0.0:1788541448.953296:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955957376 00000100:00100000:3.0:1788541448.953387:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:3.0:1788541448.953396:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1875420955957120:12345-192.168.202.56@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788541448.953427:0:22771:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6a2aaee5-6ecc-4707-b5d5-9dc192caa500@192.168.202.56@tcp t0 exp 0000000000000000 cur 729 last 0 00000020:00000080:3.0:1788541448.953476:0:22771:0:(genops.c:1385:class_connect()) connect: client 6a2aaee5-6ecc-4707-b5d5-9dc192caa500, cookie 0x2aac941e5f4a95e3 00000004:00100000:3.0:1788541448.953502:0:22771:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788541448.953594:0:22771:0:(import.c:65:import_set_state_nolock()) ffff9a6707a04800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788541448.953682:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+6:2393:x1875420955957120:12345-192.168.202.56@tcp:38:mount.lustre.0 Request processed in 285us (11608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541448.953690:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:3.0:1788541448.953710:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:3.0:1788541448.953715:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1875420955957376:12345-192.168.202.56@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788541448.953730:0:22771:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 6a2aaee5-6ecc-4707-b5d5-9dc192caa500@192.168.202.56@tcp t0 exp 0000000000000000 cur 729 last 0 00000020:00000080:3.0:1788541448.953751:0:22771:0:(genops.c:1385:class_connect()) connect: client 6a2aaee5-6ecc-4707-b5d5-9dc192caa500, cookie 0x2aac941e5f4a95ea 00000004:00100000:3.0:1788541448.953764:0:22771:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788541448.953806:0:22771:0:(import.c:65:import_set_state_nolock()) ffff9a6707a02000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788541448.953842:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+6:2393:x1875420955957376:12345-192.168.202.56@tcp:38:mount.lustre.0 Request processed in 125us (11668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541448.953849:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:3.0:1788541448.957528:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541448.957566:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541448.957595:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541448.957960:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955957504 00000100:00100000:2.0:1788541448.957969:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955957504 00000100:00100000:2.0:1788541448.958033:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955957248 00000100:00100000:2.0:1788541448.958037:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955957248 00000100:00100000:2.0:1788541448.958050:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955957632 00000100:00100000:2.0:1788541448.958053:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955957632 00000100:00080000:3.0:1788541448.958064:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788541448.958068:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788541448.958068:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 18 00000100:00100000:2.0:1788541448.958077:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+6:0:x1875420955957504:12345-192.168.202.56@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788541448.958105:0:22772:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788541448.958272:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+6:0:x1875420955957504:12345-192.168.202.56@tcp:41:mount.lustre.0 Request processed in 195us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541448.958279:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 18 00000100:00100000:2.0:1788541448.958297:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 19 00000100:00100000:2.0:1788541448.958303:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683558aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+7:0:x1875420955957248:12345-192.168.202.56@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788541448.958316:0:22772:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788541448.958342:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683558aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+7:0:x1875420955957248:12345-192.168.202.56@tcp:41:mount.lustre.0 Request processed in 39us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541448.958348:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 19 00000100:00100000:2.0:1788541448.958360:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 20 00000100:00100000:2.0:1788541448.958380:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683558a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+6:18205:x1875420955957632:12345-192.168.202.56@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788541448.958392:0:22772:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788541448.959048:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683558a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+6:18205:x1875420955957632:12345-192.168.202.56@tcp:41:mount.lustre.0 Request processed in 666us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541448.959056:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 20 00000100:00100000:2.0:1788541448.963311:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541448.964625:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955957760 00000100:00100000:0.0:1788541448.964636:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955957760 00000100:00100000:2.0:1788541448.964794:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00100000:2.0:1788541448.964802:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+6:18205:x1875420955957760:12345-192.168.202.56@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788541448.964892:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+6:18205:x1875420955957760:12345-192.168.202.56@tcp:40:mount.lustre.0 Request processed in 89us (1589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541448.964908:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00100000:3.0:1788541448.967443:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541448.967495:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541448.967532:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541448.967618:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955957888 00000100:00100000:2.0:1788541448.967627:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955957888 00000100:00100000:2.0:1788541448.967662:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955958016 00000100:00100000:2.0:1788541448.967664:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955958016 00000100:00100000:2.0:1788541448.967681:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 19 00000100:00100000:2.0:1788541448.967688:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683558bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2393:x1875420955957888:12345-192.168.202.56@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788541448.967721:0:24276:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6a2aaee5-6ecc-4707-b5d5-9dc192caa500@192.168.202.56@tcp t0 exp 0000000000000000 cur 729 last 0 00000020:00000080:2.0:1788541448.967751:0:24276:0:(genops.c:1385:class_connect()) connect: client 6a2aaee5-6ecc-4707-b5d5-9dc192caa500, cookie 0x2aac941e5f4a95f1 00002000:00100000:2.0:1788541448.967765:0:24276:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6a2aaee5-6ecc-4707-b5d5-9dc192caa500/ffff9a670667d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788541448.967775:0:24276:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788541448.967834:0:24276:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788541448.967861:0:24276:0:(import.c:65:import_set_state_nolock()) ffff9a670667a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788541448.967946:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683558bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+6:2393:x1875420955957888:12345-192.168.202.56@tcp:8:mount.lustre.0 Request processed in 258us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541448.967965:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 19 00000100:00100000:2.0:1788541448.967978:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 20 00000100:00100000:2.0:1788541448.967981:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683558a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2393:x1875420955958016:12345-192.168.202.56@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788541448.967992:0:24276:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6a2aaee5-6ecc-4707-b5d5-9dc192caa500@192.168.202.56@tcp t0 exp 0000000000000000 cur 729 last 0 00000020:00000080:2.0:1788541448.968003:0:24276:0:(genops.c:1385:class_connect()) connect: client 6a2aaee5-6ecc-4707-b5d5-9dc192caa500, cookie 0x2aac941e5f4a95f8 00002000:00100000:2.0:1788541448.968008:0:24276:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6a2aaee5-6ecc-4707-b5d5-9dc192caa500/ffff9a670667e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788541448.968014:0:24276:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788541448.968044:0:24276:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788541448.968058:0:24276:0:(import.c:65:import_set_state_nolock()) ffff9a6706679800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788541448.968078:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683558a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+6:2393:x1875420955958016:12345-192.168.202.56@tcp:8:mount.lustre.0 Request processed in 95us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541448.968082:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 20 00000100:00100000:0.0:1788541448.970440:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955958144 00000100:00100000:0.0:1788541448.970453:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955958144 00000100:00100000:1.0:1788541448.970633:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 4 00000100:00100000:1.0:1788541448.970653:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+6:18205:x1875420955958144:12345-192.168.202.56@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788541448.970736:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+6:18205:x1875420955958144:12345-192.168.202.56@tcp:900:mount.lustre.0 Request processed in 85us (3201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541448.970743:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 4 00000100:00100000:2.0:1788541448.973211:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541448.973286:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955958272 00000100:00100000:1.0:1788541448.973293:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955958272 00000100:00100000:1.0:1788541448.973354:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1 00000100:00100000:1.0:1788541448.973364:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+6:18205:x1875420955958272:12345-192.168.202.56@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788541448.973453:0:22775:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788541448.973530:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+6:18205:x1875420955958272:12345-192.168.202.56@tcp:33:mount.lustre.0 Request processed in 168us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541448.973535:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1 00000100:00100000:2.0:1788541449.093054:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541449.093228:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955958400 00000100:00100000:1.0:1788541449.093238:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955958400 00000100:00100000:3.0:1788541449.093333:0:25397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 22 00000100:00100000:3.0:1788541449.093346:0:25397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+6:18240:x1875420955958400:12345-192.168.202.56@tcp:101:mkdir.0 00010000:00010000:3.0:1788541449.093368:0:25397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541449.093394:0:25397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ade00/0x2aac941e5f4a95ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331857 expref: -99 pid: 25397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541449.093496:0:25397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a9606 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541449.093510:0:25397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a9606 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541449.093524:0:25397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a9606 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541449.093573:0:25397:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788541449.093578:0:25397:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788541449.093599:0:25397:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a9606 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541449.093627:0:25397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ade00/0x2aac941e5f4a95ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331857 expref: 8 pid: 25397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541449.093646:0:25397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a9606 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331857 expref: 7 pid: 25397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541449.093655:0:25397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6835327b00) 00010000:00010000:3.0:1788541449.093657:0:25397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788541449.093661:0:25397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075adc00, rc 0) 00000100:00100000:3.0:1788541449.093742:0:25397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+7:18240:x1875420955958400:12345-192.168.202.56@tcp:101:mkdir.0 Request processed in 398us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541449.093749:0:25397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 22 00010000:00010000:3.0:1788541449.866887:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541450.892811:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541451.217584:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708310000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981236096:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788541451.217656:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541451.217714:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981236096 00000100:00100000:0.0:1788541451.217722:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981236096 00000100:00100000:0.0:1788541451.217777:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788541451.217786:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708311180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981236096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788541451.217818:0:24280:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788541451.217860:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708311180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981236096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541451.217867:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1788541451.217903:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788541451.217937:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708310000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981236096:0@lo:13:osp-pre-0-1.0 00000001:02000400:0.0:1788541451.553049:0:25651:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788541451.723609:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683630c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981236224:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788541451.723696:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541451.723753:0:23512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981236224 00000100:00100000:1.0:1788541451.723761:0:23512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981236224 00000100:00100000:1.0:1788541451.723804:0:23512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788541451.723813:0:23512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683630d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981236224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788541451.723849:0:23512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788541451.723923:0:23512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683630d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981236224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541451.723930:0:23512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788541451.723976:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683630c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981236224:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788541451.724944:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788541451.724959:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683630c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981236352:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788541451.725019:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541451.725065:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981236352 00000100:00100000:1.0:1788541451.725071:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981236352 00000100:00100000:1.0:1788541451.725116:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788541451.725124:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683630fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981236352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788541451.725162:0:22776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788541451.725202:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683630fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981236352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541451.725209:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788541451.725246:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683630c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981236352:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788541451.915995:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788541452.238733:0:23504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6a2aaee5-6ecc-4707-b5d5-9dc192caa500 00000001:00100000:0.0:1788541452.238750:0:23504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 99be596c-2540-43f5-83c8-4f74e1767f87 00000001:00100000:1.0:1788541452.239242:0:22752:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6a2aaee5-6ecc-4707-b5d5-9dc192caa500 00000001:00100000:1.0:1788541452.239255:0:22752:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 99be596c-2540-43f5-83c8-4f74e1767f87 00000001:00100000:1.0:1788541452.241708:0:24273:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6a2aaee5-6ecc-4707-b5d5-9dc192caa500 00000001:00100000:1.0:1788541452.241720:0:24273:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 99be596c-2540-43f5-83c8-4f74e1767f87 00000001:00100000:3.0:1788541452.242324:0:25092:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6a2aaee5-6ecc-4707-b5d5-9dc192caa500 00000001:00100000:3.0:1788541452.242331:0:25092:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99be596c-2540-43f5-83c8-4f74e1767f87 00010000:00010000:0.0:1788541452.940394:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541453.258248:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788541453.258276:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708310000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981236480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788541453.258360:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541453.258642:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee13e9d8-48fa-4214-b460-99ccd69f1274:3641:1875420981236608:0@lo:400:kworker.0 00000100:00100000:2.0:1788541453.258678:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541453.258704:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981237120:0@lo:400:kworker.0 00000100:00100000:2.0:1788541453.258727:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541453.258745:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981237632:0@lo:400:kworker.0 00000100:00100000:2.0:1788541453.258768:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541453.258801:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788541453.258808:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981236736:0@lo:400:kworker.0 00000100:00100000:2.0:1788541453.258831:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541453.258849:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981237248:0@lo:400:kworker.0 00000100:00100000:0.0:1788541453.259186:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981236480 00000100:00100000:0.0:1788541453.259195:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981236480 00000100:00100000:0.0:1788541453.259257:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788541453.259266:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981236480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788541453.259295:0:24280:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788541453.259351:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981236480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541453.259358:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788541453.259378:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788541453.259444:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541453.259476:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981237760:0@lo:400:kworker.0 00000100:00100000:2.0:1788541453.259501:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541453.259532:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981236608 00000100:00100000:2.0:1788541453.259537:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981236608 00000100:00100000:2.0:1788541453.259565:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788541453.259571:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804596050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+24:3641:x1875420981236608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541453.259602:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804596050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+24:3641:x1875420981236608:12345-0@lo:400:kworker.0 Request processed in 31us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541453.259608:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788541453.259635:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981237120 00000100:00100000:2.0:1788541453.259639:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981237120 00000100:00100000:2.0:1788541453.259661:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981236736 00000100:00100000:2.0:1788541453.259663:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981236736 00000100:00100000:2.0:1788541453.259674:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788541453.259679:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670917c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981237120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541453.259708:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670917c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981237120:12345-0@lo:400:kworker.0 Request processed in 29us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541453.259714:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788541453.259726:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788541453.259732:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670917ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981236736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541453.259761:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670917ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981236736:12345-0@lo:400:kworker.0 Request processed in 29us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541453.259776:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788541453.259796:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981237632 00000100:00100000:2.0:1788541453.259799:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981237632 00000100:00100000:2.0:1788541453.259829:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981237760 00000100:00100000:2.0:1788541453.259832:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981237760 00000100:00100000:2.0:1788541453.259865:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788541453.261010:0:24795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981237248 00000100:00100000:0.0:1788541453.261018:0:24795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981237248 00000100:00100000:0.0:1788541453.261175:0:24795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788541453.261185:0:24795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68362a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981237248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541453.261254:0:24795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68362a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981237248:12345-0@lo:400:kworker.0 Request processed in 72us (1810us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541453.261261:0:24795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788541453.261457:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420981236992:0@lo:400:kworker.0 00000100:00100000:1.0:1788541453.261499:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541453.261517:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875420981237504:0@lo:400:kworker.0 00000100:00100000:1.0:1788541453.261534:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541453.261545:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875420981238016:0@lo:400:kworker.0 00000100:00100000:1.0:1788541453.261562:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541453.261576:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788541453.261582:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981236864:0@lo:400:kworker.0 00000100:00100000:1.0:1788541453.261601:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541453.261617:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981237376:0@lo:400:kworker.0 00000100:00100000:1.0:1788541453.261635:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541453.261649:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875420981237888:0@lo:400:kworker.0 00000100:00100000:1.0:1788541453.261667:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541453.261741:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981236864 00000100:00100000:1.0:1788541453.261757:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981236864 00000100:00100000:1.0:1788541453.261784:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981237376 00000100:00100000:1.0:1788541453.261787:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981237376 00000100:00100000:1.0:1788541453.261809:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788541453.261815:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683630e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981236864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541453.261851:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683630e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981236864:12345-0@lo:400:kworker.0 Request processed in 36us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541453.261857:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788541453.262150:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670917ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981237632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541453.262190:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670917ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981237632:12345-0@lo:400:kworker.0 Request processed in 2302us (3421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541453.262198:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788541453.262213:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981236992 00000100:00100000:2.0:1788541453.262217:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981236992 00000100:00100000:2.0:1788541453.262230:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981237504 00000100:00100000:2.0:1788541453.262233:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981237504 00000100:00100000:2.0:1788541453.262243:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981238016 00000100:00100000:2.0:1788541453.262246:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981238016 00000100:00100000:2.0:1788541453.262258:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981237888 00000100:00100000:2.0:1788541453.262261:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981237888 00000100:00100000:2.0:1788541453.262278:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788541453.262284:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68362a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981237760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541453.262399:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788541453.262407:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683630df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981237376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541453.262452:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683630df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981237376:12345-0@lo:400:kworker.0 Request processed in 46us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541453.262458:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788541453.262513:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981236864:0@lo:400:kworker.0 00000100:00100000:1.0:1788541453.262526:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981237376:0@lo:400:kworker.0 00000100:00100000:2.0:1788541453.262750:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68362a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981237760:12345-0@lo:400:kworker.0 Request processed in 465us (3247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541453.262756:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788541453.262770:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788541453.262778:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683630c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420981236992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541453.262820:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683630c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420981236992:12345-0@lo:400:kworker.0 Request processed in 44us (1321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541453.262826:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788541453.262845:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788541453.262850:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683630f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875420981237504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541453.263147:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420981236992:0@lo:400:kworker.0 00000100:00100000:2.0:1788541453.263429:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683630f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875420981237504:12345-0@lo:400:kworker.0 Request processed in 568us (1882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541453.263438:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788541453.263455:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788541453.263462:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683630ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875420981238016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541453.263495:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683630ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875420981238016:12345-0@lo:400:kworker.0 Request processed in 34us (1932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541453.263501:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788541453.263512:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788541453.263519:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683630f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875420981237888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541453.263565:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683630f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875420981237888:12345-0@lo:400:kworker.0 Request processed in 47us (1897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541453.263571:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788541453.263620:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683630dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981238272:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788541453.263652:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541453.263728:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875420981237888:0@lo:400:kworker.0 00000100:00100000:1.0:1788541453.263740:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875420981237504:0@lo:400:kworker.0 00010000:00080000:1.0:1788541453.263753:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670917d180 x1875420981238016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541453.263764:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875420981238016:0@lo:400:kworker.0 00000100:00100000:2.0:1788541453.263827:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788541453.263834:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6835589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981238144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788541453.263863:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788541453.270280:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788541453.270290:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788541453.270294:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788541453.270297:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788541453.270346:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708310000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981236480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788541453.270390:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981236736:0@lo:400:kworker.0 00000100:00100000:2.0:1788541453.270416:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981237248:0@lo:400:kworker.0 00010000:00080000:2.0:1788541453.270448:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670917ca80 x1875420981237760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541453.270458:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981237760:0@lo:400:kworker.0 00000100:00100000:2.0:1788541453.270469:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee13e9d8-48fa-4214-b460-99ccd69f1274:3641:1875420981236608:0@lo:400:kworker.0 00000100:00100000:2.0:1788541453.270481:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981237120:0@lo:400:kworker.0 00000100:00100000:2.0:1788541453.270492:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981237632:0@lo:400:kworker.0 00000100:00100000:0.0:1788541453.273782:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981238272 00000100:00100000:0.0:1788541453.273795:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981238272 00000100:00100000:0.0:1788541453.273852:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981238144 00000100:00100000:0.0:1788541453.273855:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981238144 00000100:00100000:0.0:1788541453.273908:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788541453.273919:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68362a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981238272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788541453.273953:0:24280:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788541453.274239:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68362a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981238272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 321us (10584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541453.274248:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788541453.274269:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788541453.274277:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68362a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981238144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788541453.274288:0:24280:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788541453.274334:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68362a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981238144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (10469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541453.274340:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788541453.274742:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6835589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981238144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541453.274760:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683630dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981238272:0@lo:13:osp-pre-1-1.0 00000040:00080000:0.0:1788541453.323736:0:22807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788541453.966356:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541454.125651:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541454.125695:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541454.125716:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541454.125741:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541454.125756:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541454.125777:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541454.125794:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541454.125812:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541454.125832:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541454.125859:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955959040 00000100:00100000:2.0:1788541454.125885:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955959040 00000100:00100000:2.0:1788541454.125949:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955959552 00000100:00100000:2.0:1788541454.125953:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955959552 00000100:00100000:2.0:1788541454.125967:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955958912 00000100:00100000:2.0:1788541454.125970:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955958912 00000100:00100000:2.0:1788541454.125984:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955959424 00000100:00100000:2.0:1788541454.125987:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955959424 00000100:00100000:2.0:1788541454.126002:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:2.0:1788541454.126011:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68362a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99be596c-2540-43f5-83c8-4f74e1767f87+5:2395:x1875420955959040:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541454.126087:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68362a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99be596c-2540-43f5-83c8-4f74e1767f87+5:2395:x1875420955959040:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 76us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541454.126094:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:2.0:1788541454.126111:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 8 00000100:00100000:2.0:1788541454.126117:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68362a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+5:2395:x1875420955959552:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541454.126136:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68362a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+5:2395:x1875420955959552:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 20us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541454.126142:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 8 00000100:00100000:2.0:1788541454.126151:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00100000:2.0:1788541454.126156:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68362a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99be596c-2540-43f5-83c8-4f74e1767f87+5:2395:x1875420955958912:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541454.126174:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68362a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99be596c-2540-43f5-83c8-4f74e1767f87+5:2395:x1875420955958912:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 18us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541454.126180:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00100000:2.0:1788541454.126189:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:2.0:1788541454.126194:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68362a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+5:2395:x1875420955959424:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541454.126212:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68362a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+5:2395:x1875420955959424:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 18us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541454.126217:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:2.0:1788541454.126235:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955958784 00000100:00100000:2.0:1788541454.126238:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955958784 00000100:00100000:2.0:1788541454.126257:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955959296 00000100:00100000:2.0:1788541454.126260:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955959296 00000100:00100000:2.0:1788541454.126272:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955958656 00000100:00100000:2.0:1788541454.126274:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955958656 00000100:00100000:2.0:1788541454.126283:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955959168 00000100:00100000:2.0:1788541454.126291:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955959168 00000100:00100000:2.0:1788541454.126308:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 50 00000100:00100000:2.0:1788541454.126314:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68362a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99be596c-2540-43f5-83c8-4f74e1767f87+5:2395:x1875420955958784:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541454.126342:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68362a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99be596c-2540-43f5-83c8-4f74e1767f87+5:2395:x1875420955958784:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 28us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541454.126348:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 50 00000100:00100000:2.0:1788541454.126359:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 51 00000100:00100000:2.0:1788541454.126365:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68362a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+5:2395:x1875420955959296:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541454.126385:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68362a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+5:2395:x1875420955959296:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 21us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541454.126391:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 51 00000100:00100000:2.0:1788541454.126404:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 52 00000100:00100000:2.0:1788541454.126410:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68362a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99be596c-2540-43f5-83c8-4f74e1767f87+6:2395:x1875420955958656:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541454.126444:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68362a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99be596c-2540-43f5-83c8-4f74e1767f87+6:2395:x1875420955958656:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 35us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541454.126450:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 52 00000100:00100000:2.0:1788541454.126462:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 53 00000100:00100000:2.0:1788541454.126467:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68362a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+6:2395:x1875420955959168:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541454.126489:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68362a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+6:2395:x1875420955959168:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 22us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541454.126495:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 53 00000100:00080000:2.0:1788541454.126526:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788541454.126529:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788541454.126531:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788541454.126533:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788541454.126606:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955958528 00000100:00100000:1.0:1788541454.126612:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955958528 00000100:00100000:1.0:1788541454.126646:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 146 00000100:00100000:1.0:1788541454.126660:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804597c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb464d9e-1538-4f36-92c9-4fbd9231889d+13:2395:x1875420955958528:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541454.126704:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804597c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb464d9e-1538-4f36-92c9-4fbd9231889d+13:2395:x1875420955958528:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 45us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541454.126711:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 146 00000020:00000080:0.0:1788541454.631255:0:25799:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe3e5a8810 20000000:00000080:0.0:1788541454.631273:0:25799:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a68362a3400 uarg=0000000000000000 20000000:01000000:0.0:1788541454.631315:0:25799:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788541454.631321:0:25799:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788541454.631325:0:25799:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788541454.636370:0:25800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1788541454.636730:0:25799:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788541454.651153:0:25799:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788541454.651190:0:25799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a683551b400/0x2aac941e5f4a960d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541454.651212:0:25799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a926a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a9263 expref: 23 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541454.651221:0:25799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6842048800/0x2aac941e5f4a9278 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a9271 expref: 23 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541454.651228:0:25799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a68043cd000/0x2aac941e5f4a92b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a92b0 expref: 23 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541454.651234:0:25799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a9351 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a934a expref: 23 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541454.651244:0:25799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6800030200/0x2aac941e5f4a959d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3317b6 expref: 12 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541454.651252:0:25799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6800030e00/0x2aac941e5f4a95dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331826 expref: 12 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541454.651259:0:25799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a683551b400/0x2aac941e5f4a960d lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541454.651470:0:25799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6800030e00/0x2aac941e5f4a95dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331826 expref: 12 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541454.651487:0:25799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6800030e00/0x2aac941e5f4a95dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331826 expref: 12 pid: 22765 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541454.651504:0:25799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683630dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25799:1875420981238400:192.168.202.56@tcp:104: 00010000:00010000:1.0:1788541454.651760:0:25799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6800030200/0x2aac941e5f4a959d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3317b6 expref: 12 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541454.651770:0:25799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6800030200/0x2aac941e5f4a959d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3317b6 expref: 12 pid: 22766 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541454.651779:0:25799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683630c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25799:1875420981238528:192.168.202.56@tcp:104: 00010000:00010000:1.0:1788541454.651818:0:25799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a9351 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a934a expref: 23 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541454.651827:0:25799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a9351 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a934a expref: 23 pid: 22764 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541454.651837:0:25799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25799:1875420981238656:0@lo:104: 00000100:00100000:1.0:1788541454.652182:0:25799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541454.652236:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981238656 00000100:00100000:2.0:1788541454.652246:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981238656 00000100:00100000:2.0:1788541454.652313:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788541454.652324:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670917f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee13e9d8-48fa-4214-b460-99ccd69f1274+3:25799:x1875420981238656:12345-0@lo:104: 00010000:00010000:2.0:1788541454.652340:0:22755:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a934a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a9351 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541454.656334:0:25799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a68043cd000/0x2aac941e5f4a92b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a92b0 expref: 23 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541454.656354:0:25799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a68043cd000/0x2aac941e5f4a92b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a92b0 expref: 23 pid: 22764 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541454.656370:0:25799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6835589f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25799:1875420981238784:0@lo:104: 00000100:00100000:3.0:1788541454.656446:0:25799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788541454.656496:0:25799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6842048800/0x2aac941e5f4a9278 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a9271 expref: 23 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541454.656504:0:25799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6842048800/0x2aac941e5f4a9278 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a9271 expref: 23 pid: 22764 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541454.656512:0:25799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6835589180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25799:1875420981238912:0@lo:104: 00000100:00100000:3.0:1788541454.656536:0:25799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788541454.656552:0:25799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a926a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a9263 expref: 23 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541454.656559:0:25799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a926a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a9263 expref: 23 pid: 22766 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541454.656566:0:25799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6835589c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25799:1875420981239040:0@lo:104: 00000100:00100000:3.0:1788541454.656586:0:25799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541454.656621:0:25799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6808953540 going to sleep for 11 seconds 00000100:00100000:1.0:1788541454.656739:0:22756:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1788541454.656749:0:22756:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1788541454.658045:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981238784 00000100:00100000:3.0:1788541454.658054:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981238784 00000100:00100000:3.0:1788541454.658099:0:22756:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788541454.658106:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981238912 00000100:00100000:3.0:1788541454.658109:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981238912 00000100:00100000:3.0:1788541454.658120:0:22756:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788541454.658124:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981239040 00000100:00100000:3.0:1788541454.658126:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981239040 00000100:00100000:1.0:1788541454.658337:0:25801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788541454.658349:0:25801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835588700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ee13e9d8-48fa-4214-b460-99ccd69f1274+6:25799:x1875420981238784:12345-0@lo:104: 00010000:00010000:1.0:1788541454.658368:0:25801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a682e75ec00/0x2aac941e5f4a92b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a92b7 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541454.658484:0:25801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788541454.658491:0:25801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835588700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ee13e9d8-48fa-4214-b460-99ccd69f1274+6:25799:x1875420981238784:12345-0@lo:104: Request processed in 144us (2044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541454.658498:0:25801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1788541454.658518:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541454.658525:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a682e75ec00/0x2aac941e5f4a92b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a92b7 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541454.658532:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75ec00 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:1.0:1788541454.658536:0:22760:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75ec00/0x2aac941e5f4a92b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a92b7 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541454.658546:0:22760:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a682e75ec00/0x2aac941e5f4a92b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a92b7 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788541454.658554:0:22760:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75ec00/0x2aac941e5f4a92b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a92b7 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788541454.658559:0:22760:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788541454.658605:0:22760:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a682e75ec00/0x2aac941e5f4a92b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a92b7 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541454.658611:0:22760:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788541454.658639:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a682e75ec00/0x2aac941e5f4a92b0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a92b7 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541454.658646:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a682e75ec00/0x2aac941e5f4a92b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a92b7 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541454.658669:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541454.658672:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541454.658673:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541454.658682:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788541454.658695:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee13e9d8-48fa-4214-b460-99ccd69f1274:3644:1875420981239168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788541454.658731:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541454.658770:0:25801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788541454.658778:0:25801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683558b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ee13e9d8-48fa-4214-b460-99ccd69f1274+5:25799:x1875420981238912:12345-0@lo:104: 00010000:00010000:1.0:1788541454.658787:0:25801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a682e75f000/0x2aac941e5f4a9271 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a9278 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541454.658820:0:25801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788541454.658825:0:25801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683558b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ee13e9d8-48fa-4214-b460-99ccd69f1274+5:25799:x1875420981238912:12345-0@lo:104: Request processed in 49us (2289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541454.658832:0:25801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788541454.658845:0:25801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788541454.658852:0:25801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835588a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ee13e9d8-48fa-4214-b460-99ccd69f1274+4:25799:x1875420981239040:12345-0@lo:104: 00010000:00010000:1.0:1788541454.658860:0:25801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a68043cc600/0x2aac941e5f4a9263 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a926a expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541454.658937:0:25801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788541454.658943:0:25801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835588a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ee13e9d8-48fa-4214-b460-99ccd69f1274+4:25799:x1875420981239040:12345-0@lo:104: Request processed in 92us (2357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541454.658949:0:25801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788541454.659186:0:25799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6835589f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25799:1875420981238784:0@lo:104: 00000100:00100000:3.0:1788541454.659197:0:25799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6835589180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25799:1875420981238912:0@lo:104: 00000100:00100000:3.0:1788541454.659204:0:25799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6835589c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25799:1875420981239040:0@lo:104: 00000100:00100000:0.0:1788541454.659760:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981239168 00000100:00100000:0.0:1788541454.659768:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981239168 00010000:00010000:0.0:1788541454.659795:0:22759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a68043cd000/0x2aac941e5f4a92b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a92b0 expref: 24 pid: 22764 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541454.659897:0:25799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683630dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25799:1875420981238400:192.168.202.56@tcp:104: 00000100:00100000:0.0:1788541454.660029:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788541454.660038:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670917f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee13e9d8-48fa-4214-b460-99ccd69f1274+24:3644:x1875420981239168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788541454.660050:0:22759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541454.660056:0:22759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a68043cd000/0x2aac941e5f4a92b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a92b0 expref: 24 pid: 22764 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541454.660066:0:22759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a68043cd000/0x2aac941e5f4a92b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a92b0 expref: 24 pid: 22764 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541454.660082:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68043cd000/0x2aac941e5f4a92b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a92b0 expref: 24 pid: 22764 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541454.660095:0:22759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541454.660135:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670917f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee13e9d8-48fa-4214-b460-99ccd69f1274+23:3644:x1875420981239168:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (1403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541454.660152:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788541454.660213:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee13e9d8-48fa-4214-b460-99ccd69f1274:3644:1875420981239168:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788541454.660353:0:22755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788541454.660360:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670917f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee13e9d8-48fa-4214-b460-99ccd69f1274+3:25799:x1875420981238656:12345-0@lo:104: Request processed in 8038us (8180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541454.660369:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1788541454.660388:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788541454.660393:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a682e75f000/0x2aac941e5f4a9271 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a9278 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541454.660400:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75f000 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:2.0:1788541454.660404:0:22760:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75f000/0x2aac941e5f4a9271 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a9278 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541454.660425:0:22760:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a682e75f000/0x2aac941e5f4a9271 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a9278 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788541454.660431:0:22760:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75f000/0x2aac941e5f4a9271 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a9278 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541454.660437:0:22760:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788541454.660468:0:22760:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a682e75f000/0x2aac941e5f4a9271 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a9278 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541454.660475:0:22760:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788541454.660499:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a682e75f000/0x2aac941e5f4a9271 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a9278 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541454.660506:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a682e75f000/0x2aac941e5f4a9271 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a9278 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541454.660517:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788541454.660521:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a68043cc600/0x2aac941e5f4a9263 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a926a expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541454.660527:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68043cc600 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:2.0:1788541454.660530:0:22760:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a68043cc600/0x2aac941e5f4a9263 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a926a expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541454.660536:0:22760:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a68043cc600/0x2aac941e5f4a9263 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a926a expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788541454.660542:0:22760:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a68043cc600/0x2aac941e5f4a9263 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a926a expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541454.660547:0:22760:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788541454.660561:0:22760:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a68043cc600/0x2aac941e5f4a9263 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a926a expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541454.660567:0:22760:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788541454.660583:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a68043cc600/0x2aac941e5f4a9263 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a926a expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541454.660589:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a68043cc600/0x2aac941e5f4a9263 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a926a expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541454.660622:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541454.660625:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a934a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a9351 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541454.660631:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75fc00 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:2.0:1788541454.660634:0:22760:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a934a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a9351 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541454.660641:0:22760:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a934a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a9351 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788541454.660648:0:22760:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a934a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a9351 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541454.660653:0:22760:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788541454.660667:0:22760:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a934a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a9351 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541454.660673:0:22760:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788541454.660680:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a934a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a9351 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541454.660686:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a934a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a9351 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541454.660697:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541454.660699:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541454.660701:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541454.660708:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788541454.660726:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68362a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee13e9d8-48fa-4214-b460-99ccd69f1274:3643:1875420981239296:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788541454.660760:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541454.660819:0:25799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25799:1875420981238656:0@lo:104: 00000100:00100000:2.0:1788541454.661528:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68362a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee13e9d8-48fa-4214-b460-99ccd69f1274:3641:1875420981239424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788541454.661561:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541454.661752:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981239296 00000100:00100000:1.0:1788541454.661758:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981239296 00010000:00010000:1.0:1788541454.661797:0:22758:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6842048800/0x2aac941e5f4a9278 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a9271 expref: 23 pid: 22764 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541454.661818:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788541454.661827:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68362a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee13e9d8-48fa-4214-b460-99ccd69f1274+23:3643:x1875420981239296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788541454.661839:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541454.661844:0:22758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6842048800/0x2aac941e5f4a9278 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a9271 expref: 23 pid: 22764 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541454.661853:0:22758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6842048800/0x2aac941e5f4a9278 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a9271 expref: 23 pid: 22764 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541454.661886:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6842048800/0x2aac941e5f4a9278 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a9271 expref: 23 pid: 22764 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541454.661901:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541454.662026:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68362a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee13e9d8-48fa-4214-b460-99ccd69f1274+22:3643:x1875420981239296:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (1264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541454.662034:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788541454.662249:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541454.662256:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541454.662766:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788541454.662776:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68362a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee13e9d8-48fa-4214-b460-99ccd69f1274:3641:1875420981239552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788541454.662815:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541454.662891:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68362a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee13e9d8-48fa-4214-b460-99ccd69f1274:3643:1875420981239296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788541454.663043:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981239424 00000100:00100000:0.0:1788541454.663050:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981239424 00010000:00010000:0.0:1788541454.663077:0:22759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a926a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a9263 expref: 22 pid: 22766 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541454.663093:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981239552 00000100:00100000:0.0:1788541454.663096:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981239552 00010000:00010000:0.0:1788541454.663107:0:22759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a9351 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a934a expref: 23 pid: 22764 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541454.663120:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788541454.663128:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68362a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee13e9d8-48fa-4214-b460-99ccd69f1274+23:3641:x1875420981239424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788541454.663139:0:22759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541454.663144:0:22759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a926a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a9263 expref: 23 pid: 22766 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541454.663152:0:22759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a926a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a9263 expref: 23 pid: 22766 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541454.663166:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a926a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a9263 expref: 23 pid: 22766 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541454.663179:0:22759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541454.663222:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68362a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee13e9d8-48fa-4214-b460-99ccd69f1274+22:3641:x1875420981239424:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (1659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541454.663235:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788541454.663261:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788541454.663355:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68362a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee13e9d8-48fa-4214-b460-99ccd69f1274+21:3641:x1875420981239552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788541454.663366:0:22759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541454.663370:0:22759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a9351 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a934a expref: 21 pid: 22764 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541454.663378:0:22759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a9351 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a934a expref: 21 pid: 22764 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541454.663387:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a9351 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a934a expref: 21 pid: 22764 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541454.663396:0:22759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541454.663432:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68362a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee13e9d8-48fa-4214-b460-99ccd69f1274+20:3641:x1875420981239552:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541454.663438:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788541454.663685:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68362a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee13e9d8-48fa-4214-b460-99ccd69f1274:3641:1875420981239552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788541454.663696:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68362a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee13e9d8-48fa-4214-b460-99ccd69f1274:3641:1875420981239424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788541454.665155:0:25799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683630c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25799:1875420981238528:192.168.202.56@tcp:104: 00010000:00010000:3.0:1788541454.665200:0:25799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a683551b400/0x2aac941e5f4a960d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541454.670090:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541454.670128:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541454.670258:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955959680 00000100:00100000:0.0:1788541454.670277:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955959680 00010000:00010000:0.0:1788541454.670321:0:22759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6800030e00/0x2aac941e5f4a95dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331826 expref: 13 pid: 22765 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541454.670357:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955959808 00000100:00100000:0.0:1788541454.670360:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955959808 00010000:00010000:0.0:1788541454.670369:0:22759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6800030200/0x2aac941e5f4a959d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3317b6 expref: 14 pid: 22766 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541454.670382:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 13 00000100:00100000:0.0:1788541454.670389:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb464d9e-1538-4f36-92c9-4fbd9231889d+14:2396:x1875420955959680:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541454.670402:0:22759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541454.670433:0:22759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6800030e00/0x2aac941e5f4a95dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331826 expref: 14 pid: 22765 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541454.670447:0:22759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6800030e00/0x2aac941e5f4a95dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331826 expref: 14 pid: 22765 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541454.670465:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6800030e00/0x2aac941e5f4a95dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331826 expref: 14 pid: 22765 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541454.670482:0:22759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541454.670533:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb464d9e-1538-4f36-92c9-4fbd9231889d+13:2396:x1875420955959680:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 144us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541454.670541:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 13 00000100:00100000:0.0:1788541454.670591:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 14 00000100:00100000:0.0:1788541454.670608:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835589c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb464d9e-1538-4f36-92c9-4fbd9231889d+12:2397:x1875420955959808:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541454.670617:0:22759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541454.670622:0:22759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6800030200/0x2aac941e5f4a959d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3317b6 expref: 12 pid: 22766 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541454.670631:0:22759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6800030200/0x2aac941e5f4a959d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3317b6 expref: 12 pid: 22766 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541454.670641:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6800030200/0x2aac941e5f4a959d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3317b6 expref: 12 pid: 22766 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541454.670653:0:22759:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a683551b400/0x2aac941e5f4a960d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541454.670667:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a683551b400/0x2aac941e5f4a960d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541454.670691:0:22759:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a683551b400/0x2aac941e5f4a960d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541454.670698:0:22759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a683551b400/0x2aac941e5f4a960d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541454.670705:0:22759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a683551b400/0x2aac941e5f4a960d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541454.670713:0:22759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a683551b400/0x2aac941e5f4a960d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541454.670719:0:22759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b400 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541454.670724:0:22759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a683551b400/0x2aac941e5f4a960d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541454.670732:0:22759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a683551b400/0x2aac941e5f4a960d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541454.670747:0:22759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a683551b400/0x2aac941e5f4a960d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541454.670757:0:22759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541454.670775:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835589c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb464d9e-1538-4f36-92c9-4fbd9231889d+11:2397:x1875420955959808:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 168us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541454.670782:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 14 00010000:00010000:3.0:1788541454.671176:0:25799:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a683551b400/0x2aac941e5f4a960d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541454.671185:0:25799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a683551b400/0x2aac941e5f4a960d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541454.671192:0:25799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a683551b400/0x2aac941e5f4a960d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541454.991991:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788541455.945981:0:22768:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788541455.945990:0:22768:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a68112db800 from 13 10000000:01000000:3.0:1788541455.945996:0:22768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788541455.946051:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075aca00/0x2aac941e5f4a9614 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541455.946071:0:22768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a67075aca00/0x2aac941e5f4a9614 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541455.946082:0:22768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a67075aca00/0x2aac941e5f4a9614 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541455.946109:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6835589180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981239680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788541455.946183:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541455.946233:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6808989b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788541455.946312:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981239680 00000100:00100000:2.0:1788541455.946320:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981239680 00000100:00100000:2.0:1788541455.946381:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788541455.946390:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804597450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+20:22768:x1875420981239680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788541455.946413:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541455.946427:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6806807c00/0x2aac941e5f4a961b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a9614 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541455.946450:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6806807c00/0x2aac941e5f4a961b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a9614 expref: 21 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541455.946460:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6806807c00/0x2aac941e5f4a961b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a9614 expref: 21 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541455.946481:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6806807c00, rc 0) 00000100:00100000:2.0:1788541455.946544:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804597450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+21:22768:x1875420981239680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541455.946551:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788541455.946739:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6835589180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981239680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788541455.946753:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a67075aca00/0x2aac941e5f4a9614 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a961b expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541455.946762:0:22768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a67075aca00/0x2aac941e5f4a9614 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a961b expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541455.946821:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6835589180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981239808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788541455.946846:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541455.946895:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6808989b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788541455.946954:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981239808 00000100:00100000:1.0:1788541455.946958:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981239808 00000100:00100000:1.0:1788541455.946993:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788541455.947001:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804594850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+21:22768:x1875420981239808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788541455.947119:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804594850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+21:22768:x1875420981239808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541455.947126:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788541455.947237:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6835589180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981239808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788541455.947264:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6835589180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981239936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788541455.947307:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541455.947328:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6808989b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788541455.947383:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981239936 00000100:00100000:0.0:1788541455.947387:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981239936 00000100:00100000:0.0:1788541455.947428:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788541455.947436:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804594050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+21:22768:x1875420981239936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788541455.947535:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804594050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+21:22768:x1875420981239936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541455.947543:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788541455.947675:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6835589180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981239936:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788541455.948555:0:25813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788541455.948756:0:22768:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788541455.948774:0:22768:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788541455.948783:0:22768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075aca00/0x2aac941e5f4a9614 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a961b expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541455.948792:0:22768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a67075aca00/0x2aac941e5f4a9614 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a961b expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541455.948802:0:22768:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788541455.948804:0:22768:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a67078de000 from 13 10000000:01000000:0.0:1788541455.948806:0:22768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788541455.948832:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6800030200/0x2aac941e5f4a9622 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541455.948840:0:22768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a6800030200/0x2aac941e5f4a9622 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541455.948849:0:22768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a6800030200/0x2aac941e5f4a9622 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541455.948864:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708312a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981240064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788541455.948956:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541455.948994:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68394b50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788541455.949084:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981240064 00000100:00100000:2.0:1788541455.949091:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981240064 00000100:00100000:2.0:1788541455.949132:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788541455.949140:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804594450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+21:22768:x1875420981240064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788541455.949149:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541455.949161:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6806806200/0x2aac941e5f4a9629 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a9622 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541455.949181:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6806806200/0x2aac941e5f4a9629 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a9622 expref: 22 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541455.949190:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6806806200/0x2aac941e5f4a9629 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a9622 expref: 22 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541455.949198:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6806806200, rc 0) 00000100:00100000:2.0:1788541455.949245:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804594450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+22:22768:x1875420981240064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541455.949251:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788541455.949348:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708312a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981240064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788541455.949362:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a6800030200/0x2aac941e5f4a9622 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9629 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541455.949380:0:22768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a6800030200/0x2aac941e5f4a9622 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a9629 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541455.949443:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981240192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788541455.949481:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541455.949503:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6808953c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788541455.949601:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981240192 00000100:00100000:2.0:1788541455.949605:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981240192 00000100:00100000:2.0:1788541455.949636:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788541455.949642:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804595850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+22:22768:x1875420981240192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788541455.949743:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804595850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+22:22768:x1875420981240192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541455.949751:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788541455.949980:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981240192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788541455.950011:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981240320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788541455.950048:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541455.950077:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6808953c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788541455.950135:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981240320 00000100:00100000:2.0:1788541455.950140:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981240320 00000100:00100000:2.0:1788541455.950169:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788541455.950177:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804595050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+22:22768:x1875420981240320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788541455.950259:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804595050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+22:22768:x1875420981240320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541455.950265:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788541455.950374:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981240320:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788541455.955598:0:25814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788541455.955835:0:22768:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788541455.955858:0:22768:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788541455.955890:0:22768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6800030200/0x2aac941e5f4a9622 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9629 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541455.955902:0:22768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6800030200/0x2aac941e5f4a9622 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9629 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541455.955913:0:22768:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788541455.955916:0:22768:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a683533d000 from 13 10000000:01000000:3.0:1788541455.955918:0:22768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788541455.955952:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a9630 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541455.955960:0:22768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a9630 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541455.955970:0:22768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a9630 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541455.955994:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6835589180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981240448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788541455.956057:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541455.956094:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6808989780 going to sleep for 11 seconds 00000100:00100000:1.0:1788541455.956306:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981240448 00000100:00100000:1.0:1788541455.956313:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981240448 00000100:00100000:1.0:1788541455.956360:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788541455.956368:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804596c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+22:22768:x1875420981240448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788541455.956380:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541455.956393:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a683551bc00/0x2aac941e5f4a9637 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a9630 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541455.956424:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a683551bc00/0x2aac941e5f4a9637 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a9630 expref: 23 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541455.956434:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a683551bc00/0x2aac941e5f4a9637 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a9630 expref: 23 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541455.956454:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551bc00, rc 0) 00000100:00100000:1.0:1788541455.956509:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804596c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+23:22768:x1875420981240448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541455.956516:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788541455.956633:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6835589180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981240448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788541455.956647:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a9630 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9637 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541455.956662:0:22768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a9630 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a9637 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541455.956714:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6835589180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981240576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788541455.956737:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541455.956758:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6808989780 going to sleep for 11 seconds 00000100:00100000:0.0:1788541455.956803:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981240576 00000100:00100000:0.0:1788541455.956807:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981240576 00000100:00100000:0.0:1788541455.956834:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788541455.956840:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6804595c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+23:22768:x1875420981240576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788541455.956966:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6804595c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+23:22768:x1875420981240576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541455.956974:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788541455.957059:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6835589180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981240576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788541455.957082:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6835589180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981240704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788541455.957114:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541455.957129:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6808989780 going to sleep for 11 seconds 00000100:00100000:2.0:1788541455.957176:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981240704 00000100:00100000:2.0:1788541455.957180:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981240704 00000100:00100000:2.0:1788541455.957199:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788541455.957204:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+23:22768:x1875420981240704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788541455.957278:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+23:22768:x1875420981240704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541455.957285:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788541455.957350:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6835589180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981240704:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788541455.958222:0:25815:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788541455.958444:0:22768:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788541455.958473:0:22768:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788541455.958481:0:22768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a9630 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9637 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541455.958490:0:22768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a9630 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9637 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541455.958499:0:22768:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788541455.958502:0:22768:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a682e797000 from 13 10000000:01000000:2.0:1788541455.958505:0:22768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788541455.958529:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6806806a00/0x2aac941e5f4a963e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541455.958537:0:22768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a6806806a00/0x2aac941e5f4a963e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541455.958555:0:22768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a6806806a00/0x2aac941e5f4a963e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541455.958574:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68362a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981240832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788541455.958617:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541455.958653:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707964480 going to sleep for 11 seconds 00000100:00100000:1.0:1788541455.958748:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981240832 00000100:00100000:1.0:1788541455.958755:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981240832 00000100:00100000:1.0:1788541455.958793:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788541455.958801:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+23:22768:x1875420981240832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788541455.958811:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541455.958822:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a683551b600/0x2aac941e5f4a9645 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a963e expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541455.958839:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a683551b600/0x2aac941e5f4a9645 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a963e expref: 24 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541455.958850:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a683551b600/0x2aac941e5f4a9645 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a963e expref: 24 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541455.958858:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551b600, rc 0) 00000100:00100000:1.0:1788541455.958921:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+24:22768:x1875420981240832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541455.958928:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788541455.959038:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68362a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981240832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788541455.959051:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a6806806a00/0x2aac941e5f4a963e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9645 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541455.959060:0:22768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a6806806a00/0x2aac941e5f4a963e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a9645 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541455.959105:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68362a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981240960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788541455.959127:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541455.959153:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707964480 going to sleep for 11 seconds 00000100:00100000:1.0:1788541455.959542:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981240960 00000100:00100000:1.0:1788541455.959547:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981240960 00000100:00100000:1.0:1788541455.959579:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788541455.959586:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+24:22768:x1875420981240960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788541455.959989:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee13e9d8-48fa-4214-b460-99ccd69f1274+24:22768:x1875420981240960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 402us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541455.960006:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788541455.964779:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68362a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981240960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788541455.964845:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6835589180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981241088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788541455.965016:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541455.965103:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6808989b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788541455.965291:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981241088 00000100:00100000:0.0:1788541455.965298:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981241088 00000100:00100000:0.0:1788541455.965383:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788541455.965392:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+24:22768:x1875420981241088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788541455.965623:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee13e9d8-48fa-4214-b460-99ccd69f1274+24:22768:x1875420981241088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 232us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541455.965632:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788541455.965747:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6835589180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee13e9d8-48fa-4214-b460-99ccd69f1274:22768:1875420981241088:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788541455.967100:0:25816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788541455.967329:0:22768:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788541455.967360:0:22768:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788541455.967371:0:22768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6806806a00/0x2aac941e5f4a963e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9645 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541455.967383:0:22768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6806806a00/0x2aac941e5f4a963e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a9645 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.010114:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541456.012206:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541456.012321:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955959936 00000100:00100000:0.0:1788541456.012331:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955959936 00000100:00100000:0.0:1788541456.012421:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 23 00000100:00100000:0.0:1788541456.012437:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68362a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99be596c-2540-43f5-83c8-4f74e1767f87+6:18707:x1875420955959936:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788541456.012603:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541456.012625:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030e00/0x2aac941e5f4a964c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33185e expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.012690:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a9653 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.012705:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a9653 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.012717:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a9653 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.012750:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a965a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.012759:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a965a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.012766:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a965a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.012848:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031000/0x2aac941e5f4a9661 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.012857:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031000/0x2aac941e5f4a9661 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.012865:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031000/0x2aac941e5f4a9661 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788541456.013016:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1788541456.013097:0:22771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788541456.013101:0:22771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788541456.013207:0:22771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031000/0x2aac941e5f4a9661 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.013220:0:22771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a9653 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.013227:0:22771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a9653 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.013234:0:22771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a9653 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.013250:0:22771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6800031600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541456.013255:0:22771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a9653 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.013262:0:22771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a9653 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.013275:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6835327b00) 00010000:00010000:0.0:1788541456.013278:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541456.013282:0:22771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a9653 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.013288:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a9653 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.013304:0:22771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a965a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.013310:0:22771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a965a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.013315:0:22771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a965a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.013320:0:22771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6800031e00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541456.013323:0:22771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a965a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.013329:0:22771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a965a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.013345:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a6835327200) 00010000:00010000:0.0:1788541456.013347:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541456.013351:0:22771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a965a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.013356:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a965a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.013557:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030e00/0x2aac941e5f4a964c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33185e expref: 8 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.013573:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031000/0x2aac941e5f4a9661 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33185e expref: 7 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.013580:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a6835327c00) 00010000:00010000:0.0:1788541456.013582:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788541456.013584:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6800031000, rc 0) 00000100:00100000:0.0:1788541456.013700:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68362a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99be596c-2540-43f5-83c8-4f74e1767f87+7:18707:x1875420955959936:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1268us (1502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541456.013709:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 23 00000100:00100000:2.0:1788541456.032560:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541456.033050:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955960064 00000100:00100000:1.0:1788541456.033062:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955960064 00000100:00100000:1.0:1788541456.033125:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 5 00000100:00100000:1.0:1788541456.033137:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68362a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:99be596c-2540-43f5-83c8-4f74e1767f87+7:18707:x1875420955960064:12345-192.168.202.56@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788541456.033230:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68362a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:99be596c-2540-43f5-83c8-4f74e1767f87+7:18707:x1875420955960064:12345-192.168.202.56@tcp:900:lhsmtool_posix.0 Request processed in 95us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541456.033238:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 5 00000100:00100000:2.0:1788541456.041174:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541456.041693:0:25397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955960320 00000100:00100000:0.0:1788541456.041704:0:25397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955960320 00000100:00100000:0.0:1788541456.041760:0:25397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 24 00000100:00100000:0.0:1788541456.041770:0:25397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68362a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99be596c-2540-43f5-83c8-4f74e1767f87+7:18707:x1875420955960320:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788541456.041790:0:25397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541456.041809:0:25397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030e00/0x2aac941e5f4a9668 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331865 expref: -99 pid: 25397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.042435:0:25397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a966f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.042451:0:25397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a966f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.042475:0:25397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a966f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.042490:0:25397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a9676 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.042497:0:25397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a9676 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.042503:0:25397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a9676 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.042609:0:25397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031c00/0x2aac941e5f4a967d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.042618:0:25397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031c00/0x2aac941e5f4a967d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.042625:0:25397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031c00/0x2aac941e5f4a967d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541456.042636:0:25397:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788541456.042795:0:25397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a966f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.042811:0:25397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a966f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.043555:0:25397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a966f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.043562:0:25397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6800031e00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541456.043567:0:25397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a966f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.043575:0:25397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a966f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.043590:0:25397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a6835327c00) 00010000:00010000:0.0:1788541456.043592:0:25397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541456.043597:0:25397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a966f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.043604:0:25397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a966f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.043619:0:25397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a9676 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.043626:0:25397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a9676 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.043632:0:25397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a9676 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.043637:0:25397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6800031600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541456.043649:0:25397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a9676 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.043655:0:25397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a9676 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.043662:0:25397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a6835327200) 00010000:00010000:0.0:1788541456.043664:0:25397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541456.043667:0:25397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a9676 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.043672:0:25397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a9676 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541456.046436:0:25397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030e00/0x2aac941e5f4a9668 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331865 expref: 10 pid: 25397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541456.046465:0:25397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031c00/0x2aac941e5f4a967d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331865 expref: 9 pid: 25397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541456.046594:0:25397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6835327400) 00010000:00010000:1.0:1788541456.046598:0:25397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541456.046601:0:25397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6800031c00, rc 0) 00000100:00100000:1.0:1788541456.046678:0:25397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68362a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99be596c-2540-43f5-83c8-4f74e1767f87+9:18707:x1875420955960320:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 4907us (5512us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788541456.046688:0:25397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 24 00000100:00100000:2.0:1788541456.059184:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541456.059253:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955960448 00000100:00100000:3.0:1788541456.059262:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955960448 00000100:00100000:3.0:1788541456.059434:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 25 00000100:00100000:3.0:1788541456.059445:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68362a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99be596c-2540-43f5-83c8-4f74e1767f87+9:18707:x1875420955960448:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788541456.059554:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68362a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99be596c-2540-43f5-83c8-4f74e1767f87+9:18707:x1875420955960448:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 Request processed in 110us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541456.059563:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 25 00000100:00100000:0.0:1788541456.065042:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541456.065113:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955960576 00000100:00100000:2.0:1788541456.065125:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955960576 00000100:00100000:2.0:1788541456.065193:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 26 00000100:00100000:2.0:1788541456.065205:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99be596c-2540-43f5-83c8-4f74e1767f87+5:18707:x1875420955960576:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1788541456.065306:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1788541456.066969:0:22772:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1723us 00000100:00100000:2.0:1788541456.075936:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541456.076018:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955960704 00000100:00100000:0.0:1788541456.076026:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955960704 00000100:00100000:0.0:1788541456.076071:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 27 00000100:00100000:0.0:1788541456.076081:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68362a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99be596c-2540-43f5-83c8-4f74e1767f87+9:18713:x1875420955960704:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1788541456.076101:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541456.076120:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172a00/0x2aac941e5f4a968b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33186c expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.076174:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045600/0x2aac941e5f4a9692 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.076186:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045600/0x2aac941e5f4a9692 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.076194:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045600/0x2aac941e5f4a9692 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.076267:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044800/0x2aac941e5f4a9699 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.076273:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044800/0x2aac941e5f4a9699 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.076277:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044800/0x2aac941e5f4a9699 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.076315:0:22771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045600/0x2aac941e5f4a9692 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.076319:0:22771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045600/0x2aac941e5f4a9692 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.076324:0:22771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045600/0x2aac941e5f4a9692 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.076330:0:22771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6812045600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541456.076334:0:22771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045600/0x2aac941e5f4a9692 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.076343:0:22771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045600/0x2aac941e5f4a9692 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.076354:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6835327b00) 00010000:00010000:0.0:1788541456.076358:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541456.076362:0:22771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045600/0x2aac941e5f4a9692 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.076369:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045600/0x2aac941e5f4a9692 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.076388:0:22771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044800/0x2aac941e5f4a9699 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.076402:0:22771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044800/0x2aac941e5f4a9699 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.076408:0:22771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044800/0x2aac941e5f4a9699 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.076414:0:22771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6812044800 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541456.076417:0:22771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044800/0x2aac941e5f4a9699 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.076423:0:22771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044800/0x2aac941e5f4a9699 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.076431:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a6835327200) 00010000:00010000:0.0:1788541456.076434:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541456.076437:0:22771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044800/0x2aac941e5f4a9699 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.076443:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044800/0x2aac941e5f4a9699 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.076483:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172a00/0x2aac941e5f4a968b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33186c expref: 10 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.076491:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6835327b00) 00010000:00010000:0.0:1788541456.076493:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541456.076500:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172a00/0x2aac941e5f4a968b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33186c expref: 10 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.076508:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842172a00, rc 0) 00000100:00100000:0.0:1788541456.076549:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68362a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99be596c-2540-43f5-83c8-4f74e1767f87+9:18713:x1875420955960704:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 471us (624us total) trans 0 rc 301/301 00000100:00100000:0.0:1788541456.076554:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 27 00000100:00100000:0.0:1788541456.080358:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541456.080481:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955960832 00000100:00100000:2.0:1788541456.080489:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955960832 00000100:00100000:2.0:1788541456.080533:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 0 00000100:00100000:2.0:1788541456.080540:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708311880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:99be596c-2540-43f5-83c8-4f74e1767f87+9:18713:x1875420955960832:12345-192.168.202.56@tcp:700:lfs.0 00000100:00100000:2.0:1788541456.080605:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708311880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:99be596c-2540-43f5-83c8-4f74e1767f87+9:18713:x1875420955960832:12345-192.168.202.56@tcp:700:lfs.0 Request processed in 64us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541456.080612:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 0 00000100:00100000:2.0:1788541456.088577:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541456.088646:0:25397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955961088 00000100:00100000:0.0:1788541456.088656:0:25397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955961088 00000100:00100000:0.0:1788541456.088721:0:25397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 28 00000100:00100000:0.0:1788541456.088733:0:25397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68362a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99be596c-2540-43f5-83c8-4f74e1767f87+9:18713:x1875420955961088:12345-192.168.202.56@tcp:36:lfs.0 00010000:00010000:0.0:1788541456.088796:0:25397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541456.088825:0:25397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030a00/0x2aac941e5f4a95c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3317e7 expref: 9 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.088844:0:25397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6835327b00) 00010000:00010000:0.0:1788541456.088850:0:25397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788541456.088932:0:25397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044e00/0x2aac941e5f4a96a0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.088958:0:25397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a9606 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331857 expref: 5 pid: 25397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.088967:0:25397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044e00/0x2aac941e5f4a96a0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.089007:0:25397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a9606 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331857 expref: 5 pid: 25397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.089041:0:25397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a9606 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331857 expref: 5 pid: 25397 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541456.089058:0:25397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708313b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25397:1875420981241216:192.168.202.56@tcp:104: 00000100:00100000:0.0:1788541456.089135:0:25397:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68083dba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788541456.095172:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99be596c-2540-43f5-83c8-4f74e1767f87+5:18707:x1875420955960576:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 Request processed in 29957us (30195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541456.095189:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 26 00000100:00100000:2.0:1788541456.100146:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541456.100217:0:25397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708313b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25397:1875420981241216:192.168.202.56@tcp:104: 00010000:00010000:0.0:1788541456.100248:0:25397:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044e00/0x2aac941e5f4a96a0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541456.100514:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955961216 00000100:00100000:1.0:1788541456.100521:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955961216 00010000:00010000:1.0:1788541456.102849:0:22759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a9606 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331857 expref: 6 pid: 25397 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541456.102933:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 15 00000100:00100000:1.0:1788541456.103024:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+6:2397:x1875420955961216:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788541456.103041:0:22759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541456.103048:0:22759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a9606 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331857 expref: 6 pid: 25397 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541456.103061:0:22759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a9606 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331857 expref: 6 pid: 25397 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541456.103087:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a9606 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331857 expref: 6 pid: 25397 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541456.103104:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6835327b00) 00010000:00010000:1.0:1788541456.103109:0:22759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044e00/0x2aac941e5f4a96a0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541456.103118:0:22759:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044e00/0x2aac941e5f4a96a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541456.103126:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044e00/0x2aac941e5f4a96a0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541456.103290:0:22759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541456.103371:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+5:2397:x1875420955961216:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 349us (3232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541456.103379:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 15 00010000:00010000:2.0:1788541456.107034:0:25397:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044e00/0x2aac941e5f4a96a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.107052:0:25397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044e00/0x2aac941e5f4a96a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.107087:0:25397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806400/0x2aac941e5f4a96a7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.107102:0:25397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806400/0x2aac941e5f4a96a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.107115:0:25397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806400/0x2aac941e5f4a96a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788541456.109357:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788541456.111855:0:25397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807000/0x2aac941e5f4a96ae lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.113499:0:25397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807000/0x2aac941e5f4a96ae lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.113515:0:25397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807000/0x2aac941e5f4a96ae lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788541456.113545:0:25397:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000019e98103 reply state 0000000013b6ae7a transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807000/0x2aac941e5f4a96ae lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.113556:0:25397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807000/0x2aac941e5f4a96ae lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.113563:0:25397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a68350c4f00) 00010000:00010000:2.0:1788541456.113566:0:25397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788541456.113570:0:25397:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788541456.113576:0:25397:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788541456.113584:0:25397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044e00/0x2aac941e5f4a96a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.113591:0:25397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044e00/0x2aac941e5f4a96a0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.113599:0:25397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044e00/0x2aac941e5f4a96a0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.113605:0:25397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6812044e00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541456.113609:0:25397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044e00/0x2aac941e5f4a96a0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.113616:0:25397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044e00/0x2aac941e5f4a96a0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.113642:0:25397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6835327b00) 00010000:00010000:2.0:1788541456.113645:0:25397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541456.113648:0:25397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044e00/0x2aac941e5f4a96a0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.113655:0:25397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044e00/0x2aac941e5f4a96a0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788541456.113678:0:25397:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000019e98103 reply state 0000000013b6ae7a transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806400/0x2aac941e5f4a96a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.113686:0:25397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806400/0x2aac941e5f4a96a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.113691:0:25397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a68350c4200) 00010000:00010000:2.0:1788541456.113694:0:25397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788541456.113695:0:25397:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788541456.113902:0:25397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68362a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99be596c-2540-43f5-83c8-4f74e1767f87+10:18713:x1875420955961088:12345-192.168.202.56@tcp:36:lfs.0 Request processed in 25167us (25555us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788541456.113911:0:25397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 28 00000100:00100000:2.0:1788541456.209518:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541456.209938:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955961344 00000100:00100000:0.0:1788541456.209949:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955961344 00000100:00100000:0.0:1788541456.210016:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 29 00000100:00100000:0.0:1788541456.210027:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99be596c-2540-43f5-83c8-4f74e1767f87+10:18721:x1875420955961344:12345-192.168.202.56@tcp:101:lctl.0 00010000:00010000:0.0:1788541456.210052:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541456.210076:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045600/0x2aac941e5f4a96b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331873 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.210140:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045e00/0x2aac941e5f4a96bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.210155:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045e00/0x2aac941e5f4a96bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.210167:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045e00/0x2aac941e5f4a96bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541456.210240:0:22771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788541456.210245:0:22771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788541456.210282:0:22771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045e00/0x2aac941e5f4a96bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.210308:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045600/0x2aac941e5f4a96b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331873 expref: 12 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.210327:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045e00/0x2aac941e5f4a96bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331873 expref: 11 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.210335:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6835327200) 00010000:00010000:0.0:1788541456.210338:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788541456.210342:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6812045e00, rc 0) 00000100:00100000:0.0:1788541456.210723:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99be596c-2540-43f5-83c8-4f74e1767f87+11:18721:x1875420955961344:12345-192.168.202.56@tcp:101:lctl.0 Request processed in 697us (1214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541456.210733:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 29 00000100:00100000:0.0:1788541456.244857:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541456.245108:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955961472 00000100:00100000:2.0:1788541456.245119:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955961472 00000100:00100000:2.0:1788541456.245273:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 30 00000100:00100000:2.0:1788541456.245284:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708313b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+5:18722:x1875420955961472:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1788541456.245845:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541456.245905:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806e00/0x2aac941e5f4a96c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33187a expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.246007:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807e00/0x2aac941e5f4a96ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.246023:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807e00/0x2aac941e5f4a96ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.246034:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807e00/0x2aac941e5f4a96ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541456.246077:0:22772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788541456.246081:0:22772:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788541456.246102:0:22772:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807e00/0x2aac941e5f4a96ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.246142:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806e00/0x2aac941e5f4a96c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33187a expref: 7 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.246164:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807e00/0x2aac941e5f4a96ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33187a expref: 6 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.246173:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6835327200) 00010000:00010000:2.0:1788541456.246176:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788541456.246179:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6806807e00, rc 0) 00000100:00100000:2.0:1788541456.246668:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708313b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+6:18722:x1875420955961472:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1384us (1820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541456.246678:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 30 00000100:00100000:3.0:1788541456.249176:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541456.250404:0:25397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955961600 00000100:00100000:0.0:1788541456.250417:0:25397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955961600 00000100:00100000:0.0:1788541456.250582:0:25397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 31 00000100:00100000:0.0:1788541456.250593:0:25397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+6:18722:x1875420955961600:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1788541456.250614:0:25397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541456.250638:0:25397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045600/0x2aac941e5f4a96d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331881 expref: -99 pid: 25397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.250702:0:25397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044c00/0x2aac941e5f4a96d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.250732:0:25397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044c00/0x2aac941e5f4a96d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.250744:0:25397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044c00/0x2aac941e5f4a96d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.250756:0:25397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045200/0x2aac941e5f4a96df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.250763:0:25397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045200/0x2aac941e5f4a96df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.250770:0:25397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045200/0x2aac941e5f4a96df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.250852:0:25397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a96e6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.250861:0:25397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a96e6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.250888:0:25397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a96e6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541456.250932:0:25397:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788541456.250946:0:25397:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788541456.250967:0:25397:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a96e6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.250979:0:25397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044c00/0x2aac941e5f4a96d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.250996:0:25397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044c00/0x2aac941e5f4a96d8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.251003:0:25397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044c00/0x2aac941e5f4a96d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.251009:0:25397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6812044c00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541456.251015:0:25397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044c00/0x2aac941e5f4a96d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.251023:0:25397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044c00/0x2aac941e5f4a96d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.251036:0:25397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6835327200) 00010000:00010000:0.0:1788541456.251039:0:25397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541456.251044:0:25397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044c00/0x2aac941e5f4a96d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.251050:0:25397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044c00/0x2aac941e5f4a96d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.251064:0:25397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045200/0x2aac941e5f4a96df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.251071:0:25397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045200/0x2aac941e5f4a96df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.251076:0:25397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045200/0x2aac941e5f4a96df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.251082:0:25397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6812045200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541456.251090:0:25397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045200/0x2aac941e5f4a96df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.251097:0:25397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045200/0x2aac941e5f4a96df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.251105:0:25397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a68350c4200) 00010000:00010000:0.0:1788541456.251107:0:25397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541456.251110:0:25397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045200/0x2aac941e5f4a96df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.251116:0:25397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045200/0x2aac941e5f4a96df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.251155:0:25397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045600/0x2aac941e5f4a96d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331881 expref: 8 pid: 25397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.251170:0:25397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a96e6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331881 expref: 7 pid: 25397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.251177:0:25397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a68350c4f00) 00010000:00010000:0.0:1788541456.251179:0:25397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788541456.251181:0:25397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6812045400, rc 0) 00000100:00100000:0.0:1788541456.251255:0:25397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+7:18722:x1875420955961600:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 663us (2093us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541456.251263:0:25397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 31 00000100:00100000:2.0:1788541456.254414:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541456.254756:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955961728 00000100:00100000:3.0:1788541456.254766:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955961728 00000100:00100000:3.0:1788541456.254834:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 6 00000100:00100000:3.0:1788541456.254844:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6836adb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+5:18722:x1875420955961728:12345-192.168.202.56@tcp:900:lfs.0 00000100:00100000:3.0:1788541456.254955:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6836adb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+5:18722:x1875420955961728:12345-192.168.202.56@tcp:900:lfs.0 Request processed in 112us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541456.254964:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 6 00000100:00080000:0.0:1788541456.255735:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788541456.263324:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541456.263469:0:25397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955961984 00000100:00100000:2.0:1788541456.263493:0:25397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955961984 00000100:00100000:2.0:1788541456.263554:0:25397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 32 00000100:00100000:2.0:1788541456.263564:0:25397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708311f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+7:18722:x1875420955961984:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1788541456.263586:0:25397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541456.263606:0:25397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806e00/0x2aac941e5f4a96ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331888 expref: -99 pid: 25397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541456.263704:0:25397:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788541456.263805:0:25397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806e00/0x2aac941e5f4a96ed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331888 expref: 9 pid: 25397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.263819:0:25397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6835327200) 00010000:00010000:2.0:1788541456.263822:0:25397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788541456.263828:0:25397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806e00/0x2aac941e5f4a96ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331888 expref: 9 pid: 25397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.263842:0:25397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6806806e00, rc 0) 00000100:00100000:2.0:1788541456.263941:0:25397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708311f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+8:18722:x1875420955961984:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 379us (629us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1788541456.263948:0:25397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 32 00000100:00100000:3.0:1788541456.274601:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541456.274846:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955962240 00000100:00100000:0.0:1788541456.274856:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955962240 00000100:00100000:0.0:1788541456.274967:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 33 00000100:00100000:0.0:1788541456.274977:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+8:18722:x1875420955962240:12345-192.168.202.56@tcp:36:lfs.0 00010000:00010000:0.0:1788541456.275033:0:22771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541456.275061:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a96e6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331881 expref: 8 pid: 25397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.275079:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a68350c4f00) 00010000:00010000:0.0:1788541456.275084:0:22771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788541456.275107:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045600/0x2aac941e5f4a96fb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.275120:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045600/0x2aac941e5f4a96fb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.275283:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045600/0x2aac941e5f4a96fb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788541456.275558:0:22771:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099d3671e reply state 0000000084491630 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045600/0x2aac941e5f4a96fb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.275572:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045600/0x2aac941e5f4a96fb lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.275578:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a68350c4f00) 00010000:00010000:0.0:1788541456.275581:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1788541456.275584:0:22771:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788541456.275592:0:22771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788541456.276352:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+9:18722:x1875420955962240:12345-192.168.202.56@tcp:36:lfs.0 Request processed in 1371us (1755us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1788541456.276361:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 33 00000100:00100000:3.0:1788541456.288130:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541456.288235:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955962496 00000100:00100000:0.0:1788541456.288246:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955962496 00000100:00100000:0.0:1788541456.288302:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 2 00000100:00100000:0.0:1788541456.288313:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+9:18722:x1875420955962496:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:0.0:1788541456.288557:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+10:18722:x1875420955962496:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 244us (434us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1788541456.288565:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 2 00000100:00100000:2.0:1788541456.296836:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541456.296976:0:25397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955962752 00000100:00100000:0.0:1788541456.296986:0:25397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955962752 00000100:00100000:0.0:1788541456.297050:0:25397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 34 00000100:00100000:0.0:1788541456.297061:0:25397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6836ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+10:18722:x1875420955962752:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1788541456.297088:0:25397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541456.297110:0:25397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a9702 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33188f expref: -99 pid: 25397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.297202:0:25397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045200/0x2aac941e5f4a9709 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.297227:0:25397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045200/0x2aac941e5f4a9709 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.297240:0:25397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045200/0x2aac941e5f4a9709 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.297252:0:25397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044c00/0x2aac941e5f4a9710 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.297259:0:25397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044c00/0x2aac941e5f4a9710 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.297284:0:25397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044c00/0x2aac941e5f4a9710 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541456.297405:0:25397:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788541456.297503:0:25397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045200/0x2aac941e5f4a9709 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.297511:0:25397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045200/0x2aac941e5f4a9709 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.297518:0:25397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045200/0x2aac941e5f4a9709 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.297523:0:25397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6812045200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541456.297528:0:25397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045200/0x2aac941e5f4a9709 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.297536:0:25397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045200/0x2aac941e5f4a9709 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.297548:0:25397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6835327200) 00010000:00010000:0.0:1788541456.297551:0:25397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541456.297556:0:25397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045200/0x2aac941e5f4a9709 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.297562:0:25397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045200/0x2aac941e5f4a9709 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.297575:0:25397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044c00/0x2aac941e5f4a9710 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.297591:0:25397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044c00/0x2aac941e5f4a9710 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.297596:0:25397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044c00/0x2aac941e5f4a9710 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.297601:0:25397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6812044c00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541456.297604:0:25397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044c00/0x2aac941e5f4a9710 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.297611:0:25397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044c00/0x2aac941e5f4a9710 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.297619:0:25397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a68350c4200) 00010000:00010000:0.0:1788541456.297621:0:25397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541456.297624:0:25397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044c00/0x2aac941e5f4a9710 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.297629:0:25397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044c00/0x2aac941e5f4a9710 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.297661:0:25397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a9702 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33188f expref: 12 pid: 25397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.297671:0:25397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6835327200) 00010000:00010000:0.0:1788541456.297673:0:25397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788541456.297677:0:25397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a9702 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33188f expref: 12 pid: 25397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.297698:0:25397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6812045400, rc 0) 00000100:00100000:0.0:1788541456.297766:0:25397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6836ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+11:18722:x1875420955962752:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 706us (939us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1788541456.297775:0:25397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 34 00000100:00100000:3.0:1788541456.303725:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541456.303900:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955962880 00000100:00100000:2.0:1788541456.303919:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955962880 00000100:00100000:2.0:1788541456.303983:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 35 00000100:00100000:2.0:1788541456.303993:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+11:18722:x1875420955962880:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1788541456.304018:0:22773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541456.304039:0:22773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806800/0x2aac941e5f4a971e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331896 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.304172:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807600/0x2aac941e5f4a9725 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.304187:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807600/0x2aac941e5f4a9725 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.304198:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807600/0x2aac941e5f4a9725 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541456.304231:0:22773:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788541456.304235:0:22773:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788541456.304254:0:22773:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807600/0x2aac941e5f4a9725 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.304281:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806800/0x2aac941e5f4a971e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331896 expref: 13 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.304303:0:22773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807600/0x2aac941e5f4a9725 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331896 expref: 12 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.304312:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a68350c4f00) 00010000:00010000:2.0:1788541456.304314:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788541456.304318:0:22773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6806807600, rc 0) 00000100:00100000:2.0:1788541456.304400:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+12:18722:x1875420955962880:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 399us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541456.304408:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 35 00000100:00100000:3.0:1788541456.315621:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541456.315733:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955963008 00000100:00100000:0.0:1788541456.315742:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955963008 00000100:00100000:0.0:1788541456.315790:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 3 00000100:00100000:0.0:1788541456.315802:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683558b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+12:18722:x1875420955963008:12345-192.168.202.56@tcp:37:lfs.0 00000100:00100000:0.0:1788541456.320939:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683558b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+12:18722:x1875420955963008:12345-192.168.202.56@tcp:37:lfs.0 Request processed in 5127us (5313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541456.320953:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 3 00000100:00100000:3.0:1788541456.325168:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541456.325252:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955963264 00000100:00100000:1.0:1788541456.325281:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955963264 00000100:00100000:1.0:1788541456.325350:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 4 00000100:00100000:1.0:1788541456.325360:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839486450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+12:18722:x1875420955963264:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:1.0:1788541456.326091:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839486450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+13:18722:x1875420955963264:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 729us (928us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1788541456.326101:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 4 00000100:00100000:2.0:1788541456.331272:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708310380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981241344:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788541456.331348:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541456.331559:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981241344 00000100:00100000:0.0:1788541456.331567:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981241344 00000100:00100000:0.0:1788541456.331614:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788541456.331622:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6836ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981241344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788541456.331655:0:24280:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788541456.331691:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6836ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981241344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541456.331696:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1788541456.331837:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788541456.331867:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708310380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981241344:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788541456.382778:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541456.383429:0:25397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955963392 00000100:00100000:0.0:1788541456.383441:0:25397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955963392 00000100:00100000:0.0:1788541456.383517:0:25397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 36 00000100:00100000:0.0:1788541456.383528:0:25397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683558b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99be596c-2540-43f5-83c8-4f74e1767f87+11:18728:x1875420955963392:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:0.0:1788541456.383550:0:25397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541456.383636:0:25397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044c00/0x2aac941e5f4a972c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33189d expref: -99 pid: 25397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.383702:0:25397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045200/0x2aac941e5f4a9733 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.383719:0:25397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045200/0x2aac941e5f4a9733 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.383731:0:25397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045200/0x2aac941e5f4a9733 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.383742:0:25397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045c00/0x2aac941e5f4a973a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.383749:0:25397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045c00/0x2aac941e5f4a973a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.383756:0:25397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045c00/0x2aac941e5f4a973a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.383845:0:25397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044400/0x2aac941e5f4a9741 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.383855:0:25397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044400/0x2aac941e5f4a9741 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.383862:0:25397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044400/0x2aac941e5f4a9741 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541456.384638:0:25397:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788541456.384645:0:25397:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788541456.384689:0:25397:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044400/0x2aac941e5f4a9741 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.384718:0:25397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045200/0x2aac941e5f4a9733 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.384724:0:25397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045200/0x2aac941e5f4a9733 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.384731:0:25397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045200/0x2aac941e5f4a9733 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.384736:0:25397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6812045200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541456.384740:0:25397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045200/0x2aac941e5f4a9733 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.384748:0:25397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045200/0x2aac941e5f4a9733 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.384761:0:25397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6835327200) 00010000:00010000:3.0:1788541456.384765:0:25397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541456.384769:0:25397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045200/0x2aac941e5f4a9733 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.384774:0:25397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045200/0x2aac941e5f4a9733 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.384788:0:25397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045c00/0x2aac941e5f4a973a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.384793:0:25397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045c00/0x2aac941e5f4a973a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.384798:0:25397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045c00/0x2aac941e5f4a973a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.384807:0:25397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6812045c00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541456.384810:0:25397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045c00/0x2aac941e5f4a973a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.384815:0:25397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045c00/0x2aac941e5f4a973a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.384821:0:25397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a68350c4200) 00010000:00010000:3.0:1788541456.384823:0:25397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541456.384826:0:25397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045c00/0x2aac941e5f4a973a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.384831:0:25397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045c00/0x2aac941e5f4a973a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.384858:0:25397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044c00/0x2aac941e5f4a972c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33189d expref: 13 pid: 25397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.384914:0:25397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044400/0x2aac941e5f4a9741 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33189d expref: 12 pid: 25397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.384922:0:25397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a68350c4f00) 00010000:00010000:3.0:1788541456.384924:0:25397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788541456.384927:0:25397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6812044400, rc 0) 00000100:00100000:3.0:1788541456.385196:0:25397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683558b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99be596c-2540-43f5-83c8-4f74e1767f87+12:18728:x1875420955963392:12345-192.168.202.56@tcp:101:bash.0 Request processed in 1668us (2433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541456.385206:0:25397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 36 00000100:00100000:2.0:1788541456.390849:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541456.391360:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955963520 00000100:00100000:3.0:1788541456.391385:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955963520 00000100:00100000:3.0:1788541456.391449:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:3.0:1788541456.391518:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6836ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:99be596c-2540-43f5-83c8-4f74e1767f87+5:18728:x1875420955963520:12345-192.168.202.56@tcp:900:bash.0 00000100:00100000:3.0:1788541456.391600:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6836ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:99be596c-2540-43f5-83c8-4f74e1767f87+5:18728:x1875420955963520:12345-192.168.202.56@tcp:900:bash.0 Request processed in 143us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541456.391608:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:1.0:1788541456.394754:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000040:00080000:0.0:1788541456.396105:0:22807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788541456.396253:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955963776 00000100:00100000:2.0:1788541456.396264:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955963776 00000100:00100000:2.0:1788541456.396326:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 37 00000100:00100000:2.0:1788541456.396338:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670917d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99be596c-2540-43f5-83c8-4f74e1767f87+12:18728:x1875420955963776:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:2.0:1788541456.396358:0:22773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541456.396380:0:22773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806800/0x2aac941e5f4a9748 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3318a4 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.396507:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807200/0x2aac941e5f4a974f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.396523:0:22773:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807600/0x2aac941e5f4a9725 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331896 expref: 12 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.396531:0:22773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807200/0x2aac941e5f4a974f lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.396568:0:22773:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807600/0x2aac941e5f4a9725 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331896 expref: 12 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.396583:0:22773:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807600/0x2aac941e5f4a9725 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331896 expref: 12 pid: 22773 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541456.396598:0:22773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6836ada680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22773:1875420981241472:192.168.202.56@tcp:104: 00000100:00100000:2.0:1788541456.396704:0:22773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707873480 going to sleep for 11 seconds 00000100:00100000:2.0:1788541456.404765:0:22773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6836ada680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22773:1875420981241472:192.168.202.56@tcp:104: 00010000:00010000:2.0:1788541456.404797:0:22773:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807200/0x2aac941e5f4a974f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541456.409532:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541456.409634:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955963904 00000100:00100000:3.0:1788541456.409644:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955963904 00010000:00010000:3.0:1788541456.409683:0:22757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807600/0x2aac941e5f4a9725 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331896 expref: 13 pid: 22773 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541456.409727:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:3.0:1788541456.409737:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670917ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+13:2396:x1875420955963904:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541456.409753:0:22757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541456.409759:0:22757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807600/0x2aac941e5f4a9725 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331896 expref: 13 pid: 22773 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.409772:0:22757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807600/0x2aac941e5f4a9725 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331896 expref: 13 pid: 22773 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.409793:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807600/0x2aac941e5f4a9725 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331896 expref: 13 pid: 22773 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.409809:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a68350c4f00) 00010000:00010000:3.0:1788541456.409814:0:22757:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807200/0x2aac941e5f4a974f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.409824:0:22757:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807200/0x2aac941e5f4a974f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.409842:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807200/0x2aac941e5f4a974f lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.409981:0:22773:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807200/0x2aac941e5f4a974f lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.409990:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807200/0x2aac941e5f4a974f lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.410068:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806c00/0x2aac941e5f4a9756 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.410077:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806c00/0x2aac941e5f4a9756 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.410085:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806c00/0x2aac941e5f4a9756 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.410576:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806000/0x2aac941e5f4a975d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.410587:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806000/0x2aac941e5f4a975d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.410595:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806000/0x2aac941e5f4a975d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541456.410605:0:22773:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788541456.410630:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807200/0x2aac941e5f4a974f lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.410636:0:22773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807200/0x2aac941e5f4a974f lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.410651:0:22773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807200/0x2aac941e5f4a974f lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.410656:0:22773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6806807200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541456.410660:0:22773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807200/0x2aac941e5f4a974f lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.410669:0:22773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807200/0x2aac941e5f4a974f lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.410678:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a68350c4f00) 00010000:00010000:2.0:1788541456.410681:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541456.410684:0:22773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807200/0x2aac941e5f4a974f lrc: 3/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788541456.410692:0:22773:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d9af591 reply state 00000000df8e9ef7 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806c00/0x2aac941e5f4a9756 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.410701:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806c00/0x2aac941e5f4a9756 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.410706:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9a68350c4100) 00010000:00010000:2.0:1788541456.410708:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788541456.410710:0:22773:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788541456.410743:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806800/0x2aac941e5f4a9748 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318a4 expref: 15 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.410761:0:22773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806000/0x2aac941e5f4a975d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318a4 expref: 14 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.410778:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a68350c4b00) 00010000:00010000:2.0:1788541456.410780:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788541456.410783:0:22773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6806806000, rc 0) 00000100:00100000:2.0:1788541456.411027:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670917d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99be596c-2540-43f5-83c8-4f74e1767f87+15:18728:x1875420955963776:12345-192.168.202.56@tcp:101:bash.0 Request processed in 14691us (16282us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788541456.411035:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 37 00010000:00010000:3.0:1788541456.411414:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807200/0x2aac941e5f4a974f lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.411433:0:22757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541456.411466:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670917ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+12:2396:x1875420955963904:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 1729us (1943us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541456.411474:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:0.0:1788541456.434236:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541456.434428:0:25397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955964032 00000100:00100000:3.0:1788541456.434440:0:25397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955964032 00000100:00100000:3.0:1788541456.434576:0:25397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 38 00000100:00100000:3.0:1788541456.434587:0:25397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99be596c-2540-43f5-83c8-4f74e1767f87+15:18728:x1875420955964032:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:3.0:1788541456.434613:0:25397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541456.434633:0:25397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a976b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3318ab expref: -99 pid: 25397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.434698:0:25397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a9772 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.434713:0:25397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a9772 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.434725:0:25397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a9772 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541456.434777:0:25397:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788541456.434782:0:25397:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788541456.434818:0:25397:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a9772 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.434831:0:25397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a9772 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.434856:0:25397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a976b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318ab expref: 17 pid: 25397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.435059:0:25397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a9772 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318ab expref: 16 pid: 25397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.435070:0:25397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a68350c4b00) 00010000:00010000:3.0:1788541456.435073:0:25397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788541456.435077:0:25397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ada00, rc 0) 00000100:00100000:3.0:1788541456.435145:0:25397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99be596c-2540-43f5-83c8-4f74e1767f87+16:18728:x1875420955964032:12345-192.168.202.56@tcp:101:bash.0 Request processed in 559us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541456.435152:0:25397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 38 00000100:00100000:0.0:1788541456.439202:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541456.439614:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955964288 00000100:00100000:2.0:1788541456.439626:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955964288 00000100:00100000:2.0:1788541456.439730:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 5 00000100:00100000:2.0:1788541456.439741:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708310e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99be596c-2540-43f5-83c8-4f74e1767f87+16:18728:x1875420955964288:12345-192.168.202.56@tcp:35:bash.0 00000100:00100000:2.0:1788541456.440078:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708310e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99be596c-2540-43f5-83c8-4f74e1767f87+17:18728:x1875420955964288:12345-192.168.202.56@tcp:35:bash.0 Request processed in 337us (885us total) trans 12884901897 rc 0/0 00000100:00100000:2.0:1788541456.440086:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 5 00000100:00100000:1.0:1788541456.535094:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541456.535440:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955964544 00000100:00100000:0.0:1788541456.535451:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955964544 00000100:00100000:0.0:1788541456.535577:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 39 00000100:00100000:0.0:1788541456.535588:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670917df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99be596c-2540-43f5-83c8-4f74e1767f87+17:18738:x1875420955964544:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1788541456.535613:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541456.535635:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045c00/0x2aac941e5f4a9779 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3318b2 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541456.535745:0:22771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788541456.535844:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045c00/0x2aac941e5f4a9779 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318b2 expref: 19 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.535859:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6835327200) 00010000:00010000:0.0:1788541456.535863:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788541456.536102:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045c00/0x2aac941e5f4a9779 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318b2 expref: 19 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.536119:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6812045c00, rc 0) 00000100:00100000:3.0:1788541456.536408:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670917df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99be596c-2540-43f5-83c8-4f74e1767f87+18:18738:x1875420955964544:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 820us (1319us total) trans 12884901898 rc 301/301 00000100:00100000:3.0:1788541456.536417:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 39 00000100:00100000:0.0:1788541456.538365:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541456.538450:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955964800 00000100:00100000:2.0:1788541456.538459:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955964800 00000100:00100000:2.0:1788541456.538512:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 6 00000100:00100000:2.0:1788541456.538523:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708310a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99be596c-2540-43f5-83c8-4f74e1767f87+18:18738:x1875420955964800:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:2.0:1788541456.538732:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708310a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99be596c-2540-43f5-83c8-4f74e1767f87+19:18738:x1875420955964800:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 211us (373us total) trans 12884901899 rc 0/0 00000100:00100000:2.0:1788541456.538740:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 6 00000100:00100000:0.0:1788541456.545368:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541456.545522:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955964928 00000100:00100000:2.0:1788541456.545532:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955964928 00000100:00100000:2.0:1788541456.545586:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 159 00000100:00100000:2.0:1788541456.545596:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb464d9e-1538-4f36-92c9-4fbd9231889d+11:18087:x1875420955964928:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788541456.545626:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541456.545642:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6806806800/0x2aac941e5f4a9787 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16473202a3318b9 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.545681:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6806806800/0x2aac941e5f4a9787 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318b9 expref: 12 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.545693:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6806806800/0x2aac941e5f4a9787 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318b9 expref: 12 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.545703:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6806806800, rc 0) 00000100:00100000:2.0:1788541456.545755:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb464d9e-1538-4f36-92c9-4fbd9231889d+12:18087:x1875420955964928:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 Request processed in 161us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541456.545762:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 159 00000100:00100000:2.0:1788541456.557264:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541456.557345:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955965056 00000100:00100000:0.0:1788541456.557355:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955965056 00000100:00100000:0.0:1788541456.557422:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 160 00000100:00100000:0.0:1788541456.557432:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb464d9e-1538-4f36-92c9-4fbd9231889d+12:18087:x1875420955965056:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788541456.557583:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb464d9e-1538-4f36-92c9-4fbd9231889d+12:18087:x1875420955965056:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 Request processed in 153us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541456.557591:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 160 00000100:00100000:0.0:1788541456.563539:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541456.563635:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955965184 00000100:00100000:1.0:1788541456.563645:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955965184 00000100:00100000:1.0:1788541456.563701:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 161 00000100:00100000:1.0:1788541456.563711:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb464d9e-1538-4f36-92c9-4fbd9231889d+12:18087:x1875420955965184:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788541456.563854:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb464d9e-1538-4f36-92c9-4fbd9231889d+12:18087:x1875420955965184:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 Request processed in 144us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541456.563862:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 161 00000100:00100000:3.0:1788541456.582670:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541456.584482:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955965312 00000100:00100000:2.0:1788541456.584497:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955965312 00000100:00100000:2.0:1788541456.584562:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 162 00000100:00100000:2.0:1788541456.584573:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb464d9e-1538-4f36-92c9-4fbd9231889d+12:18087:x1875420955965312:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788541456.584589:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541456.584608:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6806807a00/0x2aac941e5f4a978e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16473202a3318c0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.584637:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6806807a00/0x2aac941e5f4a978e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318c0 expref: 13 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.584648:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6806807a00/0x2aac941e5f4a978e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318c0 expref: 13 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.584676:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6806807a00, rc 0) 00000100:00100000:2.0:1788541456.584800:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb464d9e-1538-4f36-92c9-4fbd9231889d+13:18087:x1875420955965312:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 Request processed in 228us (2139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541456.584808:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 162 00000100:00100000:2.0:1788541456.588030:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541456.590087:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541456.590273:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955965696 00000100:00100000:2.0:1788541456.590285:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955965696 00000100:00100000:2.0:1788541456.590866:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 163 00000100:00100000:2.0:1788541456.590924:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb464d9e-1538-4f36-92c9-4fbd9231889d+13:18087:x1875420955965696:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788541456.591076:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb464d9e-1538-4f36-92c9-4fbd9231889d+13:18087:x1875420955965696:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 Request processed in 155us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541456.591084:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 163 00000100:00100000:0.0:1788541456.591167:0:25397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955965568 00000100:00100000:0.0:1788541456.591173:0:25397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955965568 00000100:00100000:3.0:1788541456.591946:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 40 00000100:00100000:3.0:1788541456.591957:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6836ada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99be596c-2540-43f5-83c8-4f74e1767f87+19:18742:x1875420955965568:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1788541456.591975:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541456.591997:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac000/0x2aac941e5f4a9795 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3318c7 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.592117:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a979c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.592133:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a979c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.592146:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a979c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541456.592157:0:22772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788541456.592274:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac000/0x2aac941e5f4a9795 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318c7 expref: 22 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.592293:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a979c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318c7 expref: 21 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.594187:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a68350c4b00) 00010000:00010000:3.0:1788541456.594192:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788541456.594197:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ac400, rc 0) 00000100:00100000:3.0:1788541456.594498:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6836ada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99be596c-2540-43f5-83c8-4f74e1767f87+21:18742:x1875420955965568:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 2539us (6474us total) trans 12884901900 rc 0/0 00000100:00100000:3.0:1788541456.594507:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 40 00000100:00100000:3.0:1788541456.594597:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541456.597947:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541456.597982:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541456.598022:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955965952 00000100:00100000:3.0:1788541456.598031:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955965952 00000100:00100000:3.0:1788541456.598084:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 41 00000100:00100000:3.0:1788541456.598109:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99be596c-2540-43f5-83c8-4f74e1767f87+21:18742:x1875420955965952:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:3.0:1788541456.598177:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a97aa lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.598193:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a97aa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.598205:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a97aa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.598245:0:22771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a97aa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.598252:0:22771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a97aa lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.598259:0:22771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a97aa lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.598264:0:22771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ad400 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541456.598269:0:22771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a97aa lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.598275:0:22771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a97aa lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.598287:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a68350c4b00) 00010000:00010000:3.0:1788541456.598290:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788541456.598294:0:22771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a97aa lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.598958:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a97aa lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541456.599048:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99be596c-2540-43f5-83c8-4f74e1767f87+21:18742:x1875420955965952:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 940us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541456.599056:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 41 00000100:00100000:3.0:1788541456.601080:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541456.601138:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955966336 00000100:00100000:3.0:1788541456.601146:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955966336 00000100:00100000:3.0:1788541456.601196:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:3.0:1788541456.601207:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683558ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99be596c-2540-43f5-83c8-4f74e1767f87+21:18742:x1875420955966336:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:3.0:1788541456.601673:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683558ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99be596c-2540-43f5-83c8-4f74e1767f87+22:18742:x1875420955966336:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 466us (599us total) trans 12884901901 rc 0/0 00000100:00100000:3.0:1788541456.601680:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:1.0:1788541456.607994:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955965824 00000100:00100000:1.0:1788541456.608010:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955965824 00000100:00100000:1.0:1788541456.608041:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955966080 00000100:00100000:1.0:1788541456.608043:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955966080 00000100:00100000:1.0:1788541456.608118:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 0 00000100:00100000:1.0:1788541456.608128:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835589880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99be596c-2540-43f5-83c8-4f74e1767f87+22:2395:x1875420955966080:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788541456.608143:0:22759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541456.608169:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a979c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318c7 expref: 22 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541456.608190:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a68350c4b00) 00010000:00010000:1.0:1788541456.608209:0:22759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541456.608275:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835589880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99be596c-2540-43f5-83c8-4f74e1767f87+21:2395:x1875420955966080:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 148us (10292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541456.608283:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 0 00000100:00100000:1.0:1788541456.608439:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 164 00000100:00100000:1.0:1788541456.608446:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb464d9e-1538-4f36-92c9-4fbd9231889d+13:18087:x1875420955965824:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788541456.608546:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb464d9e-1538-4f36-92c9-4fbd9231889d+13:18087:x1875420955965824:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 Request processed in 99us (13949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541456.608553:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 164 00000040:00080000:0.0:1788541456.778850:0:23524:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788541456.828402:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541456.828491:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955966592 00000100:00100000:2.0:1788541456.828501:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955966592 00000100:00100000:2.0:1788541456.828566:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 42 00000100:00100000:2.0:1788541456.828578:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99be596c-2540-43f5-83c8-4f74e1767f87+21:18774:x1875420955966592:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:2.0:1788541456.828601:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541456.828623:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806600/0x2aac941e5f4a97b1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3318ce expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.828733:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807800/0x2aac941e5f4a97b8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.828749:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807800/0x2aac941e5f4a97b8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.828778:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807800/0x2aac941e5f4a97b8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541456.828789:0:22772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788541456.828942:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806600/0x2aac941e5f4a97b1 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318ce expref: 24 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.828961:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807800/0x2aac941e5f4a97b8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318ce expref: 23 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.828970:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a68350c4b00) 00010000:00010000:2.0:1788541456.828973:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788541456.828977:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6806807800, rc 0) 00000100:00100000:2.0:1788541456.829203:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99be596c-2540-43f5-83c8-4f74e1767f87+23:18774:x1875420955966592:12345-192.168.202.56@tcp:101:cat.0 Request processed in 625us (819us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1788541456.829211:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 42 00000100:00100000:1.0:1788541456.833242:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541456.834383:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955966848 00000100:00100000:3.0:1788541456.834406:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955966848 00000100:00100000:3.0:1788541456.834525:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 8 00000100:00100000:3.0:1788541456.834536:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670917e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99be596c-2540-43f5-83c8-4f74e1767f87+23:18774:x1875420955966848:12345-192.168.202.56@tcp:35:cat.0 00000100:00100000:3.0:1788541456.834844:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670917e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99be596c-2540-43f5-83c8-4f74e1767f87+24:18774:x1875420955966848:12345-192.168.202.56@tcp:35:cat.0 Request processed in 308us (1676us total) trans 12884901903 rc 0/0 00000100:00100000:3.0:1788541456.834852:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 8 00000100:00100000:1.0:1788541456.837444:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541456.842060:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788541456.842094:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670917c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981241600:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788541456.842185:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541456.842238:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981241600 00000100:00100000:1.0:1788541456.842257:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981241600 00000100:00100000:1.0:1788541456.842318:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788541456.842327:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670917dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981241600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788541456.842366:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788541456.842425:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670917dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981241600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541456.842431:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788541456.842477:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670917c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981241600:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788541456.842986:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708310380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981241728:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788541456.843025:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541456.843173:0:23512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981241728 00000100:00100000:0.0:1788541456.843179:0:23512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981241728 00000100:00100000:0.0:1788541456.843223:0:23512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788541456.843231:0:23512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6836ad8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981241728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788541456.843263:0:23512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788541456.843314:0:23512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6836ad8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981241728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541456.843320:0:23512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788541456.843531:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708310380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981241728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788541456.846259:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955966976 00000100:00100000:3.0:1788541456.846274:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955966976 00000100:00100000:3.0:1788541456.846368:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1 00000100:00100000:3.0:1788541456.846379:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670917fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99be596c-2540-43f5-83c8-4f74e1767f87+24:2395:x1875420955966976:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541456.846404:0:22757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541456.846444:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807800/0x2aac941e5f4a97b8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318ce expref: 24 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.846467:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a68350c4b00) 00010000:00010000:3.0:1788541456.846472:0:22757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541456.846607:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670917fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99be596c-2540-43f5-83c8-4f74e1767f87+23:2395:x1875420955966976:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 229us (9171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541456.846615:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1 00000100:00100000:1.0:1788541456.903559:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541456.903655:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955967232 00000100:00100000:3.0:1788541456.903664:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955967232 00000100:00100000:3.0:1788541456.903745:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 43 00000100:00100000:3.0:1788541456.903753:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670917c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99be596c-2540-43f5-83c8-4f74e1767f87+23:18780:x1875420955967232:12345-192.168.202.56@tcp:101:dd.0 00010000:00010000:3.0:1788541456.903775:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541456.903792:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a97c6 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3318d5 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.903920:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac000/0x2aac941e5f4a97cd lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.903932:0:22771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806000/0x2aac941e5f4a975d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318a4 expref: 24 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.903946:0:22771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a9772 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318ab expref: 24 pid: 25397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.903951:0:22771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac000/0x2aac941e5f4a97cd lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.903976:0:22771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a9772 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3318ab expref: 24 pid: 25397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.904005:0:22771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a9772 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3318ab expref: 24 pid: 25397 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541456.904017:0:22771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683558b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22771:1875420981241856:192.168.202.56@tcp:104: 00010000:00010000:3.0:1788541456.904111:0:22771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806000/0x2aac941e5f4a975d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3318a4 expref: 24 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.904119:0:22771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806000/0x2aac941e5f4a975d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3318a4 expref: 24 pid: 22773 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541456.904128:0:22771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683630c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22771:1875420981241984:192.168.202.56@tcp:104: 00000100:00100000:3.0:1788541456.904150:0:22771:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6808989cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788541456.905821:0:22771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683558b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22771:1875420981241856:192.168.202.56@tcp:104: 00000100:00100000:1.0:1788541456.910613:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541456.910659:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541456.910762:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955967360 00000100:00100000:2.0:1788541456.910772:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955967360 00010000:00010000:2.0:1788541456.910810:0:22758:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a9772 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3318ab expref: 25 pid: 25397 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541456.910847:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955967488 00000100:00100000:2.0:1788541456.910850:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955967488 00010000:00010000:2.0:1788541456.910898:0:22758:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806000/0x2aac941e5f4a975d lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3318a4 expref: 26 pid: 22773 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541456.910915:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:2.0:1788541456.910924:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670917f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99be596c-2540-43f5-83c8-4f74e1767f87+26:2396:x1875420955967360:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541456.910948:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541456.910954:0:22758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a9772 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3318ab expref: 26 pid: 25397 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.910967:0:22758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a9772 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3318ab expref: 26 pid: 25397 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.910989:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a9772 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3318ab expref: 26 pid: 25397 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.911005:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a68350c4b00) 00010000:00010000:2.0:1788541456.911011:0:22758:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac000/0x2aac941e5f4a97cd lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.911020:0:22758:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac000/0x2aac941e5f4a97cd lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.911027:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541456.911075:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670917f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99be596c-2540-43f5-83c8-4f74e1767f87+25:2396:x1875420955967360:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 152us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541456.911082:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:2.0:1788541456.911099:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 18 00000100:00100000:2.0:1788541456.911106:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99be596c-2540-43f5-83c8-4f74e1767f87+24:2396:x1875420955967488:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541456.911118:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541456.911123:0:22758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806000/0x2aac941e5f4a975d lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3318a4 expref: 24 pid: 22773 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.911133:0:22758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806000/0x2aac941e5f4a975d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3318a4 expref: 24 pid: 22773 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.911145:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a68350c4b00) 00010000:00010000:2.0:1788541456.911148:0:22758:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac000/0x2aac941e5f4a97cd lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.911156:0:22758:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac000/0x2aac941e5f4a97cd lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.911163:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac000/0x2aac941e5f4a97cd lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.911181:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541456.911199:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99be596c-2540-43f5-83c8-4f74e1767f87+24:2396:x1875420955967488:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 94us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541456.911219:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 18 00010000:00010000:3.0:1788541456.913075:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806000/0x2aac941e5f4a975d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3318a4 expref: 23 pid: 22773 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541456.913107:0:22771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683630c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22771:1875420981241984:192.168.202.56@tcp:104: 00010000:00010000:3.0:1788541456.913130:0:22771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac000/0x2aac941e5f4a97cd lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.913139:0:22771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac000/0x2aac941e5f4a97cd lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.913144:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac000/0x2aac941e5f4a97cd lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541456.913193:0:22771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788541456.913524:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a97c6 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318d5 expref: 24 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.913540:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac000/0x2aac941e5f4a97cd lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318d5 expref: 23 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.913549:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a68350c4b00) 00010000:00010000:3.0:1788541456.913551:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788541456.913555:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ac000, rc 0) 00000100:00100000:3.0:1788541456.913608:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670917c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99be596c-2540-43f5-83c8-4f74e1767f87+23:18780:x1875420955967232:12345-192.168.202.56@tcp:101:dd.0 Request processed in 9854us (10057us total) trans 12884901904 rc 0/0 00000100:00100000:3.0:1788541456.913616:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 43 00000100:00100000:1.0:1788541456.916847:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541456.917049:0:25397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955967616 00000100:00100000:0.0:1788541456.917060:0:25397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955967616 00000100:00100000:0.0:1788541456.917125:0:25397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 44 00000100:00100000:0.0:1788541456.917136:0:25397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670917d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99be596c-2540-43f5-83c8-4f74e1767f87+23:18780:x1875420955967616:12345-192.168.202.56@tcp:101:dd.0 00010000:00010000:0.0:1788541456.917160:0:25397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541456.917450:0:25397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044a00/0x2aac941e5f4a97db lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3318dc expref: -99 pid: 25397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.917486:0:25397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044e00/0x2aac941e5f4a97e2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.917502:0:25397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044e00/0x2aac941e5f4a97e2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.917513:0:25397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044e00/0x2aac941e5f4a97e2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.917632:0:25397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044a00/0x2aac941e5f4a97db lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318dc expref: 25 pid: 25397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.917658:0:25397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044e00/0x2aac941e5f4a97e2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318dc expref: 24 pid: 25397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.917667:0:25397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a68350c4b00) 00010000:00010000:0.0:1788541456.917670:0:25397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788541456.917674:0:25397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6812044e00, rc 0) 00000100:00100000:0.0:1788541456.917736:0:25397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670917d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99be596c-2540-43f5-83c8-4f74e1767f87+24:18780:x1875420955967616:12345-192.168.202.56@tcp:101:dd.0 Request processed in 602us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541456.917744:0:25397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 44 00000100:00100000:2.0:1788541456.923519:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541456.923623:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955967872 00000100:00100000:3.0:1788541456.923634:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955967872 00000100:00100000:3.0:1788541456.923721:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 45 00000100:00100000:3.0:1788541456.923732:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6836ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99be596c-2540-43f5-83c8-4f74e1767f87+24:18780:x1875420955967872:12345-192.168.202.56@tcp:36:dd.0 00010000:00010000:3.0:1788541456.923998:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a97e9 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.924015:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a97e9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.924027:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a97e9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788541456.924068:0:22773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:3.0:1788541456.924181:0:22773:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000046c5e55 reply state 00000000f757a184 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a97e9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.924194:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a97e9 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541456.924201:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a68350c4b00) 00010000:00010000:3.0:1788541456.924204:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788541456.924208:0:22773:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788541456.924304:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6836ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99be596c-2540-43f5-83c8-4f74e1767f87+27:18780:x1875420955967872:12345-192.168.202.56@tcp:36:dd.0 Request processed in 563us (786us total) trans 12884901906 rc 0/0 00000100:00100000:3.0:1788541456.924312:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 45 00000020:00080000:3.0:1788541456.924317:0:22773:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788541456.927244:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541456.929133:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955968000 00000100:00100000:2.0:1788541456.929150:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955968000 00000100:00100000:2.0:1788541456.929231:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 46 00000100:00100000:2.0:1788541456.929241:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670917ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99be596c-2540-43f5-83c8-4f74e1767f87+27:18780:x1875420955968000:12345-192.168.202.56@tcp:101:dd.0 00010000:00010000:2.0:1788541456.929267:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541456.929288:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807200/0x2aac941e5f4a97f0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3318e3 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.929372:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807200/0x2aac941e5f4a97f0 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318e3 expref: 28 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.929396:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807200/0x2aac941e5f4a97f0 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318e3 expref: 28 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.929415:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a68350c4b00) 00010000:00010000:2.0:1788541456.929418:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788541456.929422:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6806807200, rc 0) 00000100:00100000:2.0:1788541456.929484:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670917ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99be596c-2540-43f5-83c8-4f74e1767f87+28:18780:x1875420955968000:12345-192.168.202.56@tcp:101:dd.0 Request processed in 245us (2249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541456.929491:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 46 00000100:00100000:1.0:1788541456.958478:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541456.958568:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955968256 00000100:00100000:2.0:1788541456.958577:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955968256 00000100:00100000:2.0:1788541456.958637:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 2 00000100:00100000:2.0:1788541456.958647:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670917ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99be596c-2540-43f5-83c8-4f74e1767f87+28:18780:x1875420955968256:12345-192.168.202.56@tcp:103:dd.0 00010000:00010000:2.0:1788541456.958662:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541456.958684:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807200/0x2aac941e5f4a97f0 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318e3 expref: 28 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.958703:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a68350c4b00) 00010000:00010000:2.0:1788541456.958709:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541456.958755:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670917ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99be596c-2540-43f5-83c8-4f74e1767f87+27:18780:x1875420955968256:12345-192.168.202.56@tcp:103:dd.0 Request processed in 110us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541456.958762:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 2 00000100:00100000:1.0:1788541456.965343:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541456.965554:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955968384 00000100:00100000:0.0:1788541456.965566:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955968384 00000100:00100000:0.0:1788541456.965634:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 47 00000100:00100000:0.0:1788541456.965645:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670917fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99be596c-2540-43f5-83c8-4f74e1767f87+27:18780:x1875420955968384:12345-192.168.202.56@tcp:58:dd.0 00010000:00010000:0.0:1788541456.965749:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044a00/0x2aac941e5f4a97f7 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.965766:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044a00/0x2aac941e5f4a97f7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541456.965778:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044a00/0x2aac941e5f4a97f7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788541456.968539:0:22771:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788541456.968572:0:22771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1788541456.968716:0:22771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1788541456.968896:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670917fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99be596c-2540-43f5-83c8-4f74e1767f87+27:18780:x1875420955968384:12345-192.168.202.56@tcp:58:dd.0 Request processed in 3227us (3539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541456.968917:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 47 00000100:00100000:1.0:1788541456.978028:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541456.978203:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955968512 00000100:00100000:2.0:1788541456.978222:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955968512 00000100:00100000:2.0:1788541456.978283:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 48 00000100:00100000:2.0:1788541456.978293:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670917f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99be596c-2540-43f5-83c8-4f74e1767f87+27:18780:x1875420955968512:12345-192.168.202.56@tcp:101:dd.0 00010000:00010000:2.0:1788541456.978325:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541456.978346:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807200/0x2aac941e5f4a97fe lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3318ea expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.978413:0:22772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044a00/0x2aac941e5f4a97f7 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.978426:0:22772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807200/0x2aac941e5f4a97fe lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318ea expref: 28 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.978445:0:22772:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044a00/0x2aac941e5f4a97f7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.978458:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807200/0x2aac941e5f4a97fe lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318ea expref: 28 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.978470:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a68350c4b00) 00010000:00010000:2.0:1788541456.978473:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788541456.978477:0:22772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807200/0x2aac941e5f4a97fe lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318ea expref: 28 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541456.978485:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6806807200, rc 0) 00000100:00100000:2.0:1788541456.978539:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670917f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99be596c-2540-43f5-83c8-4f74e1767f87+28:18780:x1875420955968512:12345-192.168.202.56@tcp:101:dd.0 Request processed in 247us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541456.978546:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 48 00010000:00010000:0.0:1788541457.034041:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788541457.419000:0:22807:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788541457.419010:0:22807:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788541457.419034:0:22807:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788541457.419042:0:22807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788541457.419175:0:22807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708312a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22807:1875420981242112:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788541457.419269:0:22807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68076fb480 going to sleep for 11 seconds 00000100:00100000:1.0:1788541457.430636:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541457.430739:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955968640 00000100:00100000:3.0:1788541457.430756:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955968640 00000100:00100000:3.0:1788541457.430926:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 49 00000100:00100000:3.0:1788541457.430940:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99be596c-2540-43f5-83c8-4f74e1767f87+29:18781:x1875420955968640:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788541457.430998:0:22773:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788541457.431211:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99be596c-2540-43f5-83c8-4f74e1767f87+29:18781:x1875420955968640:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 273us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541457.431220:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 49 00000100:00100000:0.0:1788541457.431735:0:22807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708312a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22807:1875420981242112:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788541457.439847:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541457.440992:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955968768 00000100:00100000:2.0:1788541457.441007:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955968768 00000100:00100000:2.0:1788541457.441077:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 50 00000100:00100000:2.0:1788541457.441088:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99be596c-2540-43f5-83c8-4f74e1767f87+28:18781:x1875420955968768:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788541457.441180:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807600/0x2aac941e5f4a9805 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.441198:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807600/0x2aac941e5f4a9805 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.441213:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807600/0x2aac941e5f4a9805 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.441230:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806e00/0x2aac941e5f4a980c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.441238:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806e00/0x2aac941e5f4a980c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.441245:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806e00/0x2aac941e5f4a980c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.441270:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806000/0x2aac941e5f4a9813 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.441279:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806000/0x2aac941e5f4a9813 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.441286:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806000/0x2aac941e5f4a9813 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541457.441348:0:22772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788541457.441366:0:22772:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788541457.441392:0:22772:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806000/0x2aac941e5f4a9813 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.441405:0:22772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807600/0x2aac941e5f4a9805 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.441412:0:22772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807600/0x2aac941e5f4a9805 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.441419:0:22772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807600/0x2aac941e5f4a9805 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.441423:0:22772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6806807600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541457.441428:0:22772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807600/0x2aac941e5f4a9805 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.441435:0:22772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807600/0x2aac941e5f4a9805 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.441447:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6835327400) 00010000:00010000:2.0:1788541457.441450:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541457.441455:0:22772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807600/0x2aac941e5f4a9805 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.441461:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807600/0x2aac941e5f4a9805 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.441473:0:22772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806e00/0x2aac941e5f4a980c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.441479:0:22772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806e00/0x2aac941e5f4a980c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.441493:0:22772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806e00/0x2aac941e5f4a980c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.441498:0:22772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6806806e00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541457.441501:0:22772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806e00/0x2aac941e5f4a980c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.441507:0:22772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806e00/0x2aac941e5f4a980c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.441515:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9a68350c4300) 00010000:00010000:2.0:1788541457.441517:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541457.441520:0:22772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806e00/0x2aac941e5f4a980c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.441525:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806e00/0x2aac941e5f4a980c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.441541:0:22772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806000/0x2aac941e5f4a9813 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.441547:0:22772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806000/0x2aac941e5f4a9813 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.441553:0:22772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806000/0x2aac941e5f4a9813 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.441558:0:22772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6806806000 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541457.441561:0:22772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806000/0x2aac941e5f4a9813 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.441579:0:22772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806000/0x2aac941e5f4a9813 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.441589:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a68350c4b00) 00010000:00010000:2.0:1788541457.441591:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541457.441594:0:22772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806000/0x2aac941e5f4a9813 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.441600:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806000/0x2aac941e5f4a9813 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541457.441697:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99be596c-2540-43f5-83c8-4f74e1767f87+28:18781:x1875420955968768:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 Request processed in 610us (1861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541457.441705:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 50 00000100:00100000:1.0:1788541457.445712:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541457.446284:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955969024 00000100:00100000:0.0:1788541457.446299:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955969024 00000100:00100000:0.0:1788541457.447349:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 51 00000100:00100000:0.0:1788541457.447368:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99be596c-2540-43f5-83c8-4f74e1767f87+28:18781:x1875420955969024:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788541457.447478:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541457.447509:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044800/0x2aac941e5f4a981a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3318f1 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.447652:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045000/0x2aac941e5f4a9821 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.447670:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045000/0x2aac941e5f4a9821 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.447683:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045000/0x2aac941e5f4a9821 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541457.447698:0:22771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788541457.447858:0:22771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045000/0x2aac941e5f4a9821 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.447866:0:22771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045000/0x2aac941e5f4a9821 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.449201:0:22771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045000/0x2aac941e5f4a9821 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.449208:0:22771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6812045000 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541457.449214:0:22771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045000/0x2aac941e5f4a9821 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.449224:0:22771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045000/0x2aac941e5f4a9821 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.449245:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a68350c4b00) 00010000:00010000:0.0:1788541457.449249:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788541457.449256:0:22771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045000/0x2aac941e5f4a9821 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.449262:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045000/0x2aac941e5f4a9821 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.449332:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044800/0x2aac941e5f4a981a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318f1 expref: 30 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.449344:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6835327400) 00010000:00010000:0.0:1788541457.449346:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788541457.449350:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044800/0x2aac941e5f4a981a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318f1 expref: 30 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.449394:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6812044800, rc 0) 00000100:00100000:0.0:1788541457.449489:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99be596c-2540-43f5-83c8-4f74e1767f87+29:18781:x1875420955969024:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 2128us (3792us total) trans 12884901907 rc 301/301 00000100:00100000:0.0:1788541457.449499:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 51 00000100:00100000:1.0:1788541457.458365:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541457.458449:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955969152 00000100:00100000:2.0:1788541457.458540:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955969152 00000100:00100000:2.0:1788541457.458693:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 52 00000100:00100000:2.0:1788541457.458707:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6836328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99be596c-2540-43f5-83c8-4f74e1767f87+29:18781:x1875420955969152:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788541457.458765:0:22772:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788541457.458978:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6836328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99be596c-2540-43f5-83c8-4f74e1767f87+29:18781:x1875420955969152:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 273us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541457.458989:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 52 00000100:00100000:2.0:1788541457.469784:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541457.470546:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955969408 00000100:00100000:3.0:1788541457.470561:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955969408 00000100:00100000:3.0:1788541457.470714:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 53 00000100:00100000:3.0:1788541457.470727:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6836adb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99be596c-2540-43f5-83c8-4f74e1767f87+29:18781:x1875420955969408:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788541457.471321:0:22773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541457.471355:0:22773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a982f lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3318f8 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788541457.473569:0:22773:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x23:0x0], count =31 00000004:00080000:3.0:1788541457.473582:0:22773:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x23:0x0]+31 in llog 00000004:00080000:3.0:1788541457.473607:0:22773:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:3.0:1788541457.474549:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a9836 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541457.474574:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a9836 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541457.474589:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a9836 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541457.474688:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a982f lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318f8 expref: 32 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541457.474713:0:22773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a9836 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318f8 expref: 31 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541457.474723:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a683531b300) 00010000:00010000:3.0:1788541457.474726:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788541457.474730:0:22773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ad800, rc 0) 00000100:00100000:3.0:1788541457.475468:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6836adb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99be596c-2540-43f5-83c8-4f74e1767f87+31:18781:x1875420955969408:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 4732us (5701us total) trans 12884901908 rc 0/0 00000100:00100000:3.0:1788541457.475480:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 53 00000100:00100000:1.0:1788541457.483594:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541457.490330:0:25397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955969664 00000100:00100000:3.0:1788541457.490354:0:25397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955969664 00000100:00100000:2.0:1788541457.499274:0:25397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 54 00000100:00100000:2.0:1788541457.499299:0:25397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683632a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99be596c-2540-43f5-83c8-4f74e1767f87+31:18781:x1875420955969664:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788541457.499400:0:25397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541457.499459:0:25397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a9836 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318f8 expref: 31 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.499487:0:25397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a683531b300) 00010000:00010000:2.0:1788541457.499502:0:25397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788541457.499534:0:25397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806000/0x2aac941e5f4a9844 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.499551:0:25397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806000/0x2aac941e5f4a9844 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.499564:0:25397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806000/0x2aac941e5f4a9844 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.499582:0:25397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806e00/0x2aac941e5f4a984b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xbf8c9dc3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.499590:0:25397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806e00/0x2aac941e5f4a984b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xbf8c9dc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.499597:0:25397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806e00/0x2aac941e5f4a984b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xbf8c9dc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.499658:0:25397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806000/0x2aac941e5f4a9844 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.499666:0:25397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806000/0x2aac941e5f4a9844 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.499673:0:25397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806000/0x2aac941e5f4a9844 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.499679:0:25397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6806806000 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541457.499692:0:25397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806000/0x2aac941e5f4a9844 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.499702:0:25397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806000/0x2aac941e5f4a9844 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.499712:0:25397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a68350c4f00) 00010000:00010000:2.0:1788541457.499715:0:25397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541457.499720:0:25397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806000/0x2aac941e5f4a9844 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.499727:0:25397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806000/0x2aac941e5f4a9844 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.499739:0:25397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806e00/0x2aac941e5f4a984b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xbf8c9dc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.499745:0:25397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806e00/0x2aac941e5f4a984b lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xbf8c9dc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.499751:0:25397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806e00/0x2aac941e5f4a984b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xbf8c9dc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.499756:0:25397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6806806e00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541457.499772:0:25397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806e00/0x2aac941e5f4a984b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xbf8c9dc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.499778:0:25397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806e00/0x2aac941e5f4a984b lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xbf8c9dc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.499787:0:25397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xbf8c9dc3 (ffff9a68350c4300) 00010000:00010000:2.0:1788541457.499790:0:25397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541457.499802:0:25397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806e00/0x2aac941e5f4a984b lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xbf8c9dc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.499808:0:25397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806e00/0x2aac941e5f4a984b lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xbf8c9dc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541457.499982:0:25397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683632a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99be596c-2540-43f5-83c8-4f74e1767f87+30:18781:x1875420955969664:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 691us (16403us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788541457.499991:0:25397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 54 00000100:00100000:1.0:1788541457.506687:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541457.506806:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955969792 00000100:00100000:0.0:1788541457.506821:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955969792 00000100:00100000:0.0:1788541457.506948:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 55 00000100:00100000:0.0:1788541457.506961:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6836328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99be596c-2540-43f5-83c8-4f74e1767f87+30:18781:x1875420955969792:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788541457.506991:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541457.507025:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045000/0x2aac941e5f4a9852 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3318ff expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.507074:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044200/0x2aac941e5f4a9859 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.507093:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044200/0x2aac941e5f4a9859 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.507109:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044200/0x2aac941e5f4a9859 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.507269:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045000/0x2aac941e5f4a9852 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318ff expref: 32 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.507291:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044200/0x2aac941e5f4a9859 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318ff expref: 31 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.507314:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a6835327700) 00010000:00010000:0.0:1788541457.507317:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788541457.507322:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6812044200, rc 0) 00000100:00100000:0.0:1788541457.507403:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6836328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99be596c-2540-43f5-83c8-4f74e1767f87+31:18781:x1875420955969792:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 445us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541457.507412:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 55 00000100:00100000:0.0:1788541457.514595:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541457.514705:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955970048 00000100:00100000:3.0:1788541457.514720:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955970048 00000100:00100000:3.0:1788541457.514988:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 56 00000100:00100000:3.0:1788541457.515003:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708312a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99be596c-2540-43f5-83c8-4f74e1767f87+31:18781:x1875420955970048:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788541457.515121:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a9860 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541457.515143:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a9860 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541457.515160:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a9860 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788541457.515429:0:22772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:3.0:1788541457.515442:0:22772:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 738433570206ns, next at 739433567000ns, rc = 0 00000004:00010000:3.0:1788541457.515510:0:22772:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c210d0a reply state 00000000304d09a8 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a9860 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541457.515526:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a9860 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541457.515536:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a6835327700) 00010000:00010000:3.0:1788541457.515539:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788541457.515545:0:22772:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788541457.515691:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708312a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99be596c-2540-43f5-83c8-4f74e1767f87+33:18781:x1875420955970048:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 691us (1111us total) trans 12884901909 rc 0/0 00000100:00100000:3.0:1788541457.515700:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 56 00000100:00100000:1.0:1788541457.518828:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541457.520080:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955970176 00000100:00100000:0.0:1788541457.520098:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955970176 00000100:00100000:0.0:1788541457.520192:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 57 00000100:00100000:0.0:1788541457.520213:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6836328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99be596c-2540-43f5-83c8-4f74e1767f87+33:18781:x1875420955970176:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788541457.520247:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541457.520277:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045000/0x2aac941e5f4a9867 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331906 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.520357:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045000/0x2aac941e5f4a9867 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331906 expref: 34 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.520376:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045000/0x2aac941e5f4a9867 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331906 expref: 34 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.520411:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a6835327700) 00010000:00010000:0.0:1788541457.520414:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788541457.520420:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6812045000, rc 0) 00000100:00100000:0.0:1788541457.520520:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6836328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99be596c-2540-43f5-83c8-4f74e1767f87+34:18781:x1875420955970176:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 317us (1718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541457.520546:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 57 00000100:00100000:1.0:1788541457.524276:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541457.524378:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955970304 00000100:00100000:2.0:1788541457.524404:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955970304 00000100:00080000:0.0:1788541457.524555:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788541457.524603:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00100000:2.0:1788541457.524616:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683632b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99be596c-2540-43f5-83c8-4f74e1767f87+5:2394:x1875420955970304:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788541457.525032:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683632b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99be596c-2540-43f5-83c8-4f74e1767f87+6:2394:x1875420955970304:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 416us (769us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1788541457.525041:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00100000:2.0:1788541457.533766:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541457.533965:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955970560 00000100:00100000:0.0:1788541457.533982:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955970560 00000100:00100000:0.0:1788541457.534059:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00100000:0.0:1788541457.534073:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6836ad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99be596c-2540-43f5-83c8-4f74e1767f87+34:18781:x1875420955970560:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788541457.534369:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6836ad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99be596c-2540-43f5-83c8-4f74e1767f87+35:18781:x1875420955970560:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 298us (619us total) trans 12884901910 rc 0/0 00000100:00100000:0.0:1788541457.534379:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00100000:3.0:1788541457.539517:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541457.539696:0:25397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955970816 00000100:00100000:2.0:1788541457.539710:0:25397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955970816 00000100:00100000:2.0:1788541457.540076:0:25397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 58 00000100:00100000:2.0:1788541457.540093:0:25397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683630c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99be596c-2540-43f5-83c8-4f74e1767f87+35:18781:x1875420955970816:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788541457.540256:0:25397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683630c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99be596c-2540-43f5-83c8-4f74e1767f87+35:18781:x1875420955970816:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 167us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541457.544733:0:25397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 58 00000100:00100000:1.0:1788541457.545280:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541457.546523:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955970944 00000100:00100000:0.0:1788541457.546540:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955970944 00000100:00100000:0.0:1788541457.546668:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 59 00000100:00100000:0.0:1788541457.546681:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6836329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99be596c-2540-43f5-83c8-4f74e1767f87+35:18781:x1875420955970944:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788541457.546712:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541457.546744:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045c00/0x2aac941e5f4a986e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33190d expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.546891:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a9875 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.546921:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a9875 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.546935:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a9875 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541457.546995:0:22771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788541457.547040:0:22771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a9875 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.547077:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045c00/0x2aac941e5f4a986e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33190d expref: 37 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.547098:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a9875 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33190d expref: 36 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.547108:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a6835327700) 00010000:00010000:0.0:1788541457.547111:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788541457.547116:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6812045400, rc 0) 00000100:00100000:0.0:1788541457.547351:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6836329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99be596c-2540-43f5-83c8-4f74e1767f87+36:18781:x1875420955970944:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 671us (2072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541457.547359:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 59 00000100:00100000:0.0:1788541457.555609:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541457.557132:0:25171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955971072 00000100:00100000:2.0:1788541457.557149:0:25171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955971072 00000100:00100000:2.0:1788541457.557282:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 22 00000100:00100000:2.0:1788541457.557296:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708310000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:99be596c-2540-43f5-83c8-4f74e1767f87+6:2397:x1875420955971072:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788541457.557344:0:25171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541457.557374:0:25171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041f6fdbe/0x2aac941e5f4a987c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331914 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788541457.557441:0:25171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9afa11, blocks: 0x0 00010000:00010000:2.0:1788541457.557468:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=738s v=(0 0) 00010000:00010000:2.0:1788541457.557473:0:25171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541457.557485:0:25171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041f6fdbe/0x2aac941e5f4a987c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331914 expref: 7 pid: 25171 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.557510:0:25171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000041f6fdbe/0x2aac941e5f4a987c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331914 expref: 7 pid: 25171 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.557527:0:25171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6806807600, rc 0) 00000100:00100000:2.0:1788541457.557626:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708310000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:99be596c-2540-43f5-83c8-4f74e1767f87+7:2397:x1875420955971072:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 333us (2031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541457.557634:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 22 00000100:00100000:1.0:1788541457.560929:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541457.561018:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955971328 00000100:00100000:3.0:1788541457.561031:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955971328 00000100:00100000:3.0:1788541457.561078:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 60 00000100:00100000:3.0:1788541457.561085:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6836328700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99be596c-2540-43f5-83c8-4f74e1767f87+36:18781:x1875420955971328:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788541457.561198:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6836328700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99be596c-2540-43f5-83c8-4f74e1767f87+36:18781:x1875420955971328:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 112us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541457.561218:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 60 00000100:00100000:3.0:1788541457.574552:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541457.574684:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955971456 00000100:00100000:0.0:1788541457.574695:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955971456 00000100:00100000:0.0:1788541457.574768:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 61 00000100:00100000:0.0:1788541457.574779:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683630dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99be596c-2540-43f5-83c8-4f74e1767f87+36:18781:x1875420955971456:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788541457.578542:0:22752:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:3.0:1788541457.578560:0:22752:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1788541457.578607:0:22752:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:3.0:1788541457.578765:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683630dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99be596c-2540-43f5-83c8-4f74e1767f87+19:18781:x1875420955971456:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 Request processed in 3984us (4221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541457.578775:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 61 00010000:00010000:2.0:1788541457.579045:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045600/0x2aac941e5f4a96fb lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.579066:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045600/0x2aac941e5f4a96fb lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.579075:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045600/0x2aac941e5f4a96fb lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.579082:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6812045600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541457.579105:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045600/0x2aac941e5f4a96fb lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.579116:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045600/0x2aac941e5f4a96fb lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.579139:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a68350c4f00) 00010000:00010000:2.0:1788541457.579143:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788541457.579149:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045600/0x2aac941e5f4a96fb lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.579156:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045600/0x2aac941e5f4a96fb lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541457.580237:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683632aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981242240:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788541457.580337:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541457.583395:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:0.0:1788541457.583502:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806400/0x2aac941e5f4a96a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.583514:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806400/0x2aac941e5f4a96a7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.583521:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806400/0x2aac941e5f4a96a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.583538:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6806806400 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541457.583544:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806400/0x2aac941e5f4a96a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.583552:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806400/0x2aac941e5f4a96a7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.583570:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a68350c4200) 00010000:00010000:0.0:1788541457.583573:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541457.583579:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806400/0x2aac941e5f4a96a7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.583586:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806400/0x2aac941e5f4a96a7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.583609:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807000/0x2aac941e5f4a96ae lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.583615:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807000/0x2aac941e5f4a96ae lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.583620:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807000/0x2aac941e5f4a96ae lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.583624:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6806807000 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541457.583627:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807000/0x2aac941e5f4a96ae lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.583632:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807000/0x2aac941e5f4a96ae lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.583662:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a68350c4f00) 00010000:00010000:0.0:1788541457.583665:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541457.583669:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807000/0x2aac941e5f4a96ae lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.583677:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807000/0x2aac941e5f4a96ae lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.583695:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806c00/0x2aac941e5f4a9756 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.583702:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806c00/0x2aac941e5f4a9756 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.583708:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806c00/0x2aac941e5f4a9756 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.583715:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6806806c00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541457.583718:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806c00/0x2aac941e5f4a9756 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.583724:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806c00/0x2aac941e5f4a9756 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.583731:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9a68350c4100) 00010000:00010000:0.0:1788541457.583733:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541457.583743:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806c00/0x2aac941e5f4a9756 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.583749:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806806c00/0x2aac941e5f4a9756 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.583776:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a97e9 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.583782:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a97e9 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.583787:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a97e9 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.583792:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ad400 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541457.583795:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a97e9 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.583801:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a97e9 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.583810:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a68350c4b00) 00010000:00010000:0.0:1788541457.583812:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541457.583815:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a97e9 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.583821:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a97e9 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.583832:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a9860 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.583838:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a9860 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.583843:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a9860 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.583854:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ad000 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541457.583857:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a9860 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.583862:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a9860 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.583891:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a6835327700) 00010000:00010000:0.0:1788541457.583893:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788541457.583896:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a9860 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.583902:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a9860 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541457.586228:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981242240 00000100:00100000:1.0:1788541457.586268:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981242240 00000100:00100000:1.0:1788541457.586460:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955971584 00000100:00100000:1.0:1788541457.586466:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955971584 00000100:00100000:1.0:1788541457.586499:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788541457.586511:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6836ad8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981242240:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788541457.586711:0:24276:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788541457.586715:0:24276:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788541457.586718:0:24276:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788541457.586720:0:24276:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788541457 -> 1788541457 00002000:00010000:1.0:1788541457.586723:0:24276:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788541457.586829:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6836ad8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1875420981242240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 319us (6494us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1788541457.586859:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788541457.586906:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 24 00000100:00100000:1.0:1788541457.586914:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99be596c-2540-43f5-83c8-4f74e1767f87+7:2397:x1875420955971584:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 00000004:00080000:2.0:1788541457.587159:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a683632aa00/2, rc 0, transno 12884901892 00000100:00100000:2.0:1788541457.587168:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683632aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981242240:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788541457.587391:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99be596c-2540-43f5-83c8-4f74e1767f87+7:2397:x1875420955971584:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 Request processed in 468us (4006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541457.587399:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 24 00000100:00080000:0.0:1788541457.587828:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788541457.601164:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541457.601304:0:25397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955971840 00000100:00100000:0.0:1788541457.601318:0:25397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955971840 00000100:00100000:0.0:1788541457.601398:0:25397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 62 00000100:00100000:0.0:1788541457.601413:0:25397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6836328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99be596c-2540-43f5-83c8-4f74e1767f87+15:18781:x1875420955971840:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788541457.601527:0:25397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541457.601563:0:25397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a9875 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33190d expref: 15 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.601589:0:25397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a6835327700) 00010000:00010000:0.0:1788541457.601595:0:25397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788541457.601636:0:25397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045200/0x2aac941e5f4a9883 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.601665:0:25397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045200/0x2aac941e5f4a9883 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.601678:0:25397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045200/0x2aac941e5f4a9883 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788541457.602760:0:25397:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000588bfcde reply state 00000000f8bd19b0 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045200/0x2aac941e5f4a9883 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.602795:0:25397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045200/0x2aac941e5f4a9883 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.602805:0:25397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a6835327700) 00010000:00010000:0.0:1788541457.602808:0:25397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788541457.602811:0:25397:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788541457.602985:0:25397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6836328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99be596c-2540-43f5-83c8-4f74e1767f87+16:18781:x1875420955971840:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 1573us (1831us total) trans 12884901911 rc 0/0 00000100:00100000:0.0:1788541457.602994:0:25397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 62 00000100:00100000:2.0:1788541457.608189:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541457.608472:0:25171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955971968 00000100:00100000:1.0:1788541457.608486:0:25171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955971968 00000100:00100000:1.0:1788541457.608562:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 25 00000100:00100000:1.0:1788541457.608574:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6836adaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:99be596c-2540-43f5-83c8-4f74e1767f87+7:2396:x1875420955971968:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788541457.608780:0:25171:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788541457.608784:0:25171:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788541456 00002000:00010000:1.0:1788541457.608787:0:25171:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788541456 00002000:00010000:1.0:1788541457.608789:0:25171:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788541457 -> 1788541456 00002000:00010000:1.0:1788541457.608791:0:25171:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788541457.609019:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6836adaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:99be596c-2540-43f5-83c8-4f74e1767f87+8:2396:x1875420955971968:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 445us (843us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1788541457.609028:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 25 00000100:00100000:3.0:1788541457.616550:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541457.616857:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955972096 00000100:00100000:1.0:1788541457.617016:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955972096 00000100:00100000:1.0:1788541457.617130:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 26 00000100:00100000:1.0:1788541457.617140:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99be596c-2540-43f5-83c8-4f74e1767f87+8:2396:x1875420955972096:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788541457.617194:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006ec00a0b/0x2aac941e5f4a988a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.617229:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541457.617234:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541457.617239:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ec00a0b/0x2aac941e5f4a988a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.617254:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ec00a0b/0x2aac941e5f4a988a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.617299:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006ec00a0b/0x2aac941e5f4a988a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.617308:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ec00a0b/0x2aac941e5f4a988a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.617315:0:24276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ec00a0b/0x2aac941e5f4a988a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.617320:0:24276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551ac00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:1.0:1788541457.617324:0:24276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ec00a0b/0x2aac941e5f4a988a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.617331:0:24276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ec00a0b/0x2aac941e5f4a988a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.617345:0:24276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ec00a0b/0x2aac941e5f4a988a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.617357:0:24276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ec00a0b/0x2aac941e5f4a988a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541457.617555:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99be596c-2540-43f5-83c8-4f74e1767f87+8:2396:x1875420955972096:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 414us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541457.617565:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 26 00000100:00100000:3.0:1788541457.624450:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541457.624620:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955972352 00000100:00100000:1.0:1788541457.624636:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955972352 00000100:00100000:1.0:1788541457.624731:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 63 00000100:00100000:1.0:1788541457.624745:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99be596c-2540-43f5-83c8-4f74e1767f87+16:18781:x1875420955972352:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788541457.624927:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a9891 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.624950:0:22771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044e00/0x2aac941e5f4a97e2 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318dc expref: 16 pid: 25397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.624963:0:22771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a9891 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.625018:0:22771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044e00/0x2aac941e5f4a97e2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3318dc expref: 16 pid: 25397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.625036:0:22771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044e00/0x2aac941e5f4a97e2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3318dc expref: 16 pid: 25397 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541457.625054:0:22771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6836329880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22771:1875420981242368:192.168.202.56@tcp:104: 00000100:00100000:1.0:1788541457.625200:0:22771:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6808953540 going to sleep for 11 seconds 00000100:00100000:1.0:1788541457.638695:0:22771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6836329880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22771:1875420981242368:192.168.202.56@tcp:104: 00010000:00010000:1.0:1788541457.638738:0:22771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a9891 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541457.646342:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541457.646814:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955972480 00000100:00100000:1.0:1788541457.646827:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955972480 00010000:00010000:1.0:1788541457.646945:0:22759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044e00/0x2aac941e5f4a97e2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3318dc expref: 17 pid: 25397 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541457.647000:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 19 00000100:00100000:1.0:1788541457.647014:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99be596c-2540-43f5-83c8-4f74e1767f87+17:2397:x1875420955972480:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788541457.647035:0:22759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541457.647043:0:22759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044e00/0x2aac941e5f4a97e2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3318dc expref: 17 pid: 25397 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.647060:0:22759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044e00/0x2aac941e5f4a97e2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3318dc expref: 17 pid: 25397 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.647090:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044e00/0x2aac941e5f4a97e2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3318dc expref: 17 pid: 25397 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.647113:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a68350c4b00) 00010000:00010000:1.0:1788541457.647120:0:22759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807200/0x2aac941e5f4a97fe lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318ea expref: 16 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.647132:0:22759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a9891 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.647161:0:22759:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a9891 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.647170:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a9891 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.647204:0:22759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541457.647292:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99be596c-2540-43f5-83c8-4f74e1767f87+16:2397:x1875420955972480:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 281us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541457.647299:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 19 00010000:00010000:0.0:1788541457.648205:0:22771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a9891 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.648220:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a9891 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.648512:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a9898 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.648527:0:22771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045000/0x2aac941e5f4a9867 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331906 expref: 16 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.648547:0:22771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a9898 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.648859:0:22771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045000/0x2aac941e5f4a9867 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331906 expref: 16 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.649391:0:22771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045000/0x2aac941e5f4a9867 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331906 expref: 16 pid: 22771 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541457.649419:0:22771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708313800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22771:1875420981242496:192.168.202.56@tcp:104: 00000100:00100000:0.0:1788541457.649534:0:22771:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6803281d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788541457.654080:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541457.654245:0:22771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708313800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22771:1875420981242496:192.168.202.56@tcp:104: 00010000:00010000:0.0:1788541457.654291:0:22771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a9898 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541457.654456:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955972608 00000100:00100000:1.0:1788541457.654466:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955972608 00010000:00010000:1.0:1788541457.654518:0:22757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045000/0x2aac941e5f4a9867 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331906 expref: 17 pid: 22771 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541457.654736:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 20 00000100:00100000:1.0:1788541457.654748:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99be596c-2540-43f5-83c8-4f74e1767f87+17:2396:x1875420955972608:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788541457.654770:0:22757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541457.654790:0:22757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045000/0x2aac941e5f4a9867 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331906 expref: 17 pid: 22771 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.654813:0:22757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045000/0x2aac941e5f4a9867 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331906 expref: 17 pid: 22771 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.654843:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045000/0x2aac941e5f4a9867 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331906 expref: 17 pid: 22771 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.654924:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a6835327700) 00010000:00010000:1.0:1788541457.654930:0:22757:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a9898 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.654942:0:22757:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a9898 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.654951:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a9898 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.654976:0:22757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541457.655059:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99be596c-2540-43f5-83c8-4f74e1767f87+16:2396:x1875420955972608:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 313us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541457.655068:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 20 00010000:00010000:0.0:1788541457.655340:0:22771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a9898 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.655349:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a9898 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788541457.655513:0:22771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:0.0:1788541457.655684:0:22771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:0.0:1788541457.655728:0:22771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:0.0:1788541457.655830:0:22771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708313800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22771:1875420981242624:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788541457.655958:0:22771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541457.655993:0:22771:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6803281240 going to sleep for 11 seconds 00000100:00100000:2.0:1788541457.663007:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981242624 00000100:00100000:2.0:1788541457.663031:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981242624 00000100:00100000:2.0:1788541457.663137:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788541457.663151:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708310380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22771:x1875420981242624:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788541457.663366:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708310380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22771:x1875420981242624:12345-0@lo:1000:mdt00_000.0 Request processed in 217us (7407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541457.663374:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788541457.663711:0:22771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708313800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22771:1875420981242624:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788541457.664019:0:22771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:3.0:1788541457.664125:0:22771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22771:1875420981242752:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788541457.664188:0:22771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541457.664238:0:22771:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6808989540 going to sleep for 11 seconds 00000100:00100000:2.0:1788541457.664671:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981242752 00000100:00100000:2.0:1788541457.664681:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981242752 00000100:00100000:2.0:1788541457.664742:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788541457.664769:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22771:x1875420981242752:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788541457.665166:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22771:x1875420981242752:12345-0@lo:1000:mdt00_000.0 Request processed in 397us (976us total) trans 12884901894 rc 0/0 00000100:00100000:2.0:1788541457.665175:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788541457.668698:0:22771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22771:1875420981242752:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788541457.668793:0:22771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a9898 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.668811:0:22771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a9898 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.668820:0:22771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a9898 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.668825:0:22771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6812045400 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541457.668831:0:22771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a9898 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.668840:0:22771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a9898 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.668860:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a6835327700) 00010000:00010000:0.0:1788541457.668863:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788541457.669164:0:22771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a9898 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.669174:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a9898 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.669290:0:22771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044a00/0x2aac941e5f4a97f7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.669298:0:22771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044a00/0x2aac941e5f4a97f7 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.669304:0:22771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044a00/0x2aac941e5f4a97f7 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.669335:0:22771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6812044a00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541457.669338:0:22771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044a00/0x2aac941e5f4a97f7 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.669345:0:22771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044a00/0x2aac941e5f4a97f7 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.669354:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a68350c4b00) 00010000:00010000:0.0:1788541457.669356:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788541457.669364:0:22771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807200/0x2aac941e5f4a97fe lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318ea expref: 19 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.669378:0:22771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807200/0x2aac941e5f4a97fe lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318ea expref: 19 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.669400:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807200/0x2aac941e5f4a97fe lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318ea expref: 19 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.669507:0:22771:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6806807200/0x2aac941e5f4a97fe lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3318ea expref: 19 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541457.669525:0:22771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708313800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22771:1875420981242880:192.168.202.56@tcp:105: 00000100:00100000:0.0:1788541457.669952:0:22771:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6813a3f780 going to sleep for 11 seconds 00000100:00100000:3.0:1788541457.676557:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541457.677349:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955972736 00000100:00100000:1.0:1788541457.677363:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955972736 00000100:00100000:1.0:1788541457.677446:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:1.0:1788541457.677456:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839485c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99be596c-2540-43f5-83c8-4f74e1767f87+20:18780:x1875420955972736:12345-192.168.202.56@tcp:49:dd.0 00000100:00100000:1.0:1788541457.677623:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839485c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99be596c-2540-43f5-83c8-4f74e1767f87+20:18780:x1875420955972736:12345-192.168.202.56@tcp:49:dd.0 Request processed in 167us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541457.677631:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:2.0:1788541457.681318:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541457.681468:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955972864 00000100:00100000:3.0:1788541457.681478:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955972864 00000100:00100000:3.0:1788541457.681582:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 64 00000100:00100000:3.0:1788541457.681595:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6836ad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99be596c-2540-43f5-83c8-4f74e1767f87+20:18780:x1875420955972864:12345-192.168.202.56@tcp:101:dd.0 00010000:00010000:3.0:1788541457.681615:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541457.681650:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac200/0x2aac941e5f4a989f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33191b expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541457.681686:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a98a6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541457.681700:0:22772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a9891 lrc: 2/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541457.681708:0:22772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a98a6 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541457.681727:0:22772:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a9891 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541457.681737:0:22772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a98a6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541457.684195:0:22771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708313800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22771:1875420981242880:192.168.202.56@tcp:105: 00010000:00010000:0.0:1788541457.684232:0:22771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044a00/0x2aac941e5f4a97f7 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.684264:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044a00/0x2aac941e5f4a97f7 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.684298:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a98ad lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.684313:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a98ad lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.684325:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a98ad lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.684335:0:22771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a98ad lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.684341:0:22771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a98ad lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.684347:0:22771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a98ad lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.684353:0:22771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6812045400 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541457.684357:0:22771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a98ad lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.684364:0:22771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a98ad lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.684376:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a68350c4b00) 00010000:00010000:0.0:1788541457.684387:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541457.684391:0:22771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a98ad lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.684405:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812045400/0x2aac941e5f4a98ad lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.684415:0:22771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a9891 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.684421:0:22771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a9891 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.684427:0:22771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a9891 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.684432:0:22771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551a600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541457.684435:0:22771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a9891 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.684441:0:22771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a9891 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.684449:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a68350c4b00) 00010000:00010000:0.0:1788541457.684451:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788541457.684454:0:22771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a98a6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.684462:0:22771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a98a6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.684467:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a98a6 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.684496:0:22771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a9891 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.684509:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a9891 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541457.684662:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99be596c-2540-43f5-83c8-4f74e1767f87+21:18781:x1875420955972352:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 59919us (60230us total) trans 12884901916 rc 0/0 00000100:00100000:0.0:1788541457.684672:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 63 00000020:00080000:0.0:1788541457.684677:0:22771:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00010000:00010000:3.0:1788541457.684852:0:22772:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a98a6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541457.684860:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a98a6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541457.685008:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac200/0x2aac941e5f4a989f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33191b expref: 21 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541457.685024:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a98a6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33191b expref: 20 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541457.685032:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a68350c4b00) 00010000:00010000:3.0:1788541457.685040:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788541457.685043:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ace00, rc 0) 00000100:00100000:3.0:1788541457.685072:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6836ad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99be596c-2540-43f5-83c8-4f74e1767f87+20:18780:x1875420955972864:12345-192.168.202.56@tcp:101:dd.0 Request processed in 3480us (3873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541457.685079:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 64 00000040:00080000:2.0:1788541457.685229:0:22807:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788541457.685234:0:22807:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788541457.685250:0:22807:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1788541457.685256:0:22807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788541457.693508:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541457.693604:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955973120 00000100:00100000:0.0:1788541457.693614:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955973120 00000100:00100000:0.0:1788541457.693670:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 11 00000100:00100000:0.0:1788541457.693680:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6836ad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99be596c-2540-43f5-83c8-4f74e1767f87+20:18781:x1875420955973120:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788541457.694522:0:22774:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788541457.694555:0:22774:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:0.0:1788541457.694727:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044000/0x2aac941e5f4a98b4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.694746:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044000/0x2aac941e5f4a98b4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.694759:0:22774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044000/0x2aac941e5f4a98b4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.694768:0:22774:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044000/0x2aac941e5f4a98b4 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.694774:0:22774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044000/0x2aac941e5f4a98b4 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.694782:0:22774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044000/0x2aac941e5f4a98b4 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.695090:0:22774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788541457.695198:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6836ad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99be596c-2540-43f5-83c8-4f74e1767f87+22:18781:x1875420955973120:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 1518us (1700us total) trans 12884901918 rc 0/0 00000100:00100000:0.0:1788541457.695214:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 11 00000020:00080000:0.0:1788541457.695218:0:22774:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788541457.699757:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541457.699774:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044000/0x2aac941e5f4a98b4 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.699786:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6812044000 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541457.699791:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044000/0x2aac941e5f4a98b4 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.699813:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044000/0x2aac941e5f4a98b4 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.699832:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a6835327700) 00010000:00010000:2.0:1788541457.699835:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788541457.699840:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044000/0x2aac941e5f4a98b4 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.699846:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6812044000/0x2aac941e5f4a98b4 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.699864:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541457.700107:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541457.700109:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541457.714656:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541457.714769:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955973248 00000100:00100000:0.0:1788541457.714780:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955973248 00000100:00100000:0.0:1788541457.714862:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 0 00000100:00100000:0.0:1788541457.714909:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6836adbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:99be596c-2540-43f5-83c8-4f74e1767f87+8:2397:x1875420955973248:12345-192.168.202.56@tcp:4:dd.0 00010000:00010000:0.0:1788541457.715044:0:24282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010e4f94b/0x2aac941e5f4a98bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.715066:0:24282:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000041f6fdbe/0x2aac941e5f4a987c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331914 expref: 8 pid: 25171 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.715075:0:24282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541457.715080:0:24282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541457.715085:0:24282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010e4f94b/0x2aac941e5f4a98bb lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.715121:0:24282:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000041f6fdbe/0x2aac941e5f4a987c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331914 expref: 8 pid: 25171 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.715136:0:24282:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000041f6fdbe/0x2aac941e5f4a987c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331914 expref: 8 pid: 25171 timeout: 838 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541457.715170:0:24282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708313800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:24282:1875420981243008:192.168.202.56@tcp:104: 00000100:00100000:0.0:1788541457.715304:0:24282:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6813a3f780 going to sleep for 11 seconds 00000100:00100000:3.0:1788541457.722752:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541457.726474:0:24284:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788541457.726554:0:24284:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1788541457.726806:0:24284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955973376 00000100:00100000:3.0:1788541457.726817:0:24284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955973376 00000100:00100000:1.0:1788541457.727354:0:25818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1 00000100:00100000:1.0:1788541457.727366:0:25818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:99be596c-2540-43f5-83c8-4f74e1767f87+9:2396:x1875420955973376:12345-192.168.202.56@tcp:4:dd.0 00010000:00010000:1.0:1788541457.727412:0:25818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ec00a0b/0x2aac941e5f4a98c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.727443:0:25818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541457.727448:0:25818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541457.727454:0:25818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ec00a0b/0x2aac941e5f4a98c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.727465:0:25818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006ec00a0b/0x2aac941e5f4a98c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541457.727937:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541457.728056:0:24282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708313800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:24282:1875420981243008:192.168.202.56@tcp:104: 00010000:00010000:0.0:1788541457.728079:0:24282:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000010e4f94b/0x2aac941e5f4a98bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541457.728149:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955973504 00000100:00100000:1.0:1788541457.728156:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955973504 00010000:00010000:1.0:1788541457.728181:0:22758:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000041f6fdbe/0x2aac941e5f4a987c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331914 expref: 10 pid: 25171 timeout: 838 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541457.728205:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00100000:1.0:1788541457.728212:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99be596c-2540-43f5-83c8-4f74e1767f87+10:2397:x1875420955973504:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788541457.728223:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541457.728244:0:22758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000041f6fdbe/0x2aac941e5f4a987c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331914 expref: 10 pid: 25171 timeout: 838 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.728259:0:22758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000041f6fdbe/0x2aac941e5f4a987c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331914 expref: 10 pid: 25171 timeout: 838 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.728279:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041f6fdbe/0x2aac941e5f4a987c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331914 expref: 10 pid: 25171 timeout: 838 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.728308:0:22758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541457.728312:0:22758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541457.728317:0:22758:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000010e4f94b/0x2aac941e5f4a98bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.728325:0:22758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010e4f94b/0x2aac941e5f4a98bb lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.728333:0:22758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541457.728336:0:22758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541457.728339:0:22758:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006ec00a0b/0x2aac941e5f4a98c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.728346:0:22758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ec00a0b/0x2aac941e5f4a98c2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.728376:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541457.728435:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99be596c-2540-43f5-83c8-4f74e1767f87+9:2397:x1875420955973504:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 221us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541457.728442:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 21 00010000:00010000:0.0:1788541457.729006:0:24282:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000010e4f94b/0x2aac941e5f4a98bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.729018:0:24282:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010e4f94b/0x2aac941e5f4a98bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.729917:0:25818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006ec00a0b/0x2aac941e5f4a98c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541457.729929:0:25818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ec00a0b/0x2aac941e5f4a98c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788541457.797341:0:25092:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00000001:00080000:3.0:1788541457.797360:0:25092:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00002000:00010000:2.0:1788541457.797530:0:25818:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:2.0:1788541457.797535:0:25818:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 1788541456 -> 1788541457 00002000:00010000:2.0:1788541457.797538:0:25818:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788541456 -> 1788541457 00002000:00010000:2.0:1788541457.797540:0:25818:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:2.0:1788541457.797561:0:25818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ec00a0b/0x2aac941e5f4a98c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.797575:0:25818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ec00a0b/0x2aac941e5f4a98c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.797584:0:25818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ec00a0b/0x2aac941e5f4a98c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.797591:0:25818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551ac00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541457.797597:0:25818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ec00a0b/0x2aac941e5f4a98c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.797607:0:25818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ec00a0b/0x2aac941e5f4a98c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.797629:0:25818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ec00a0b/0x2aac941e5f4a98c2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541457.797639:0:25818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ec00a0b/0x2aac941e5f4a98c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541457.798105:0:25818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:99be596c-2540-43f5-83c8-4f74e1767f87+7:2396:x1875420955973376:12345-192.168.202.56@tcp:4:dd.0 Request processed in 70735us (75356us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788541457.798121:0:25818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1 00000040:00080000:0.0:1788541457.802576:0:23524:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:1.0:1788541457.843057:0:25092:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901896 is committed 00002000:00010000:0.0:1788541457.843253:0:24282:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:0.0:1788541457.843275:0:24282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010e4f94b/0x2aac941e5f4a98bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.843288:0:24282:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010e4f94b/0x2aac941e5f4a98bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.843298:0:24282:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010e4f94b/0x2aac941e5f4a98bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.843304:0:24282:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6812045400 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541457.843319:0:24282:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010e4f94b/0x2aac941e5f4a98bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.843328:0:24282:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010e4f94b/0x2aac941e5f4a98bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.843347:0:24282:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010e4f94b/0x2aac941e5f4a98bb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541457.843355:0:24282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010e4f94b/0x2aac941e5f4a98bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541457.843475:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6836adbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:99be596c-2540-43f5-83c8-4f74e1767f87+5:2397:x1875420955973248:12345-192.168.202.56@tcp:4:dd.0 Request processed in 128599us (128824us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1788541457.843486:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 0 00010000:00010000:0.0:1788541458.058162:0:25109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541458.378430:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6836329880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981243264:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788541458.378506:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541458.378627:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981243136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788541458.380047:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981243776:0@lo:400:kworker.0 00000100:00100000:0.0:1788541458.380093:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541458.380109:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981244288:0@lo:400:kworker.0 00000100:00100000:0.0:1788541458.380128:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541458.380145:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682c22b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875420981244800:0@lo:400:kworker.0 00000100:00100000:0.0:1788541458.380165:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541458.380182:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788541458.380187:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981243648:0@lo:400:kworker.0 00000100:00100000:0.0:1788541458.380222:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541458.380239:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981244160:0@lo:400:kworker.0 00000100:00100000:0.0:1788541458.380258:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541458.380276:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682c229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875420981244672:0@lo:400:kworker.0 00000100:00100000:0.0:1788541458.380296:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541458.380341:0:23512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981243648 00000100:00100000:0.0:1788541458.380348:0:23512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981243648 00000100:00100000:0.0:1788541458.380398:0:23512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981244160 00000100:00100000:0.0:1788541458.380401:0:23512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981244160 00000100:00100000:0.0:1788541458.380417:0:23512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788541458.380425:0:23512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981243648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541458.380482:0:23512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981243648:12345-0@lo:400:kworker.0 Request processed in 57us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541458.380489:0:23512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788541458.380506:0:23512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788541458.380511:0:23512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981244160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541458.380538:0:23512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981244160:12345-0@lo:400:kworker.0 Request processed in 26us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541458.380543:0:23512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788541458.380562:0:25397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981244800 00000100:00100000:0.0:1788541458.380565:0:25397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981244800 00000100:00100000:0.0:1788541458.380594:0:25397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981244672 00000100:00100000:0.0:1788541458.380597:0:25397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981244672 00000100:00100000:0.0:1788541458.380612:0:25397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788541458.380618:0:25397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875420981244800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541458.380647:0:25397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875420981244800:12345-0@lo:400:kworker.0 Request processed in 29us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541458.380662:0:25397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788541458.380673:0:25397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788541458.380678:0:25397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875420981244672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541458.380702:0:25397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875420981244672:12345-0@lo:400:kworker.0 Request processed in 24us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541458.380707:0:25397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1788541458.380722:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788541458.380726:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788541458.380757:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981243648:0@lo:400:kworker.0 00000100:00100000:0.0:1788541458.380767:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981244160:0@lo:400:kworker.0 00000100:00100000:0.0:1788541458.380777:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682c229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875420981244672:0@lo:400:kworker.0 00010000:00080000:0.0:1788541458.380790:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a682c22b100 x1875420981244800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541458.382061:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981243392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788541458.382123:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541458.382194:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981243776 00000100:00100000:3.0:1788541458.382201:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981243776 00000100:00100000:3.0:1788541458.382263:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981244288 00000100:00100000:3.0:1788541458.382267:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981244288 00000100:00100000:3.0:1788541458.382290:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788541458.382298:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708310e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981243776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541458.382362:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708310e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981243776:12345-0@lo:400:kworker.0 Request processed in 65us (2268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541458.382369:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788541458.382396:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788541458.382404:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708310a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981244288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541458.382433:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708310a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981244288:12345-0@lo:400:kworker.0 Request processed in 31us (2304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541458.382439:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788541458.382461:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541458.382506:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee13e9d8-48fa-4214-b460-99ccd69f1274:3642:1875420981243520:0@lo:400:kworker.0 00000100:00100000:3.0:1788541458.382537:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541458.382591:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420981244032:0@lo:400:kworker.0 00000100:00100000:3.0:1788541458.382618:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541458.382636:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682c22a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875420981244544:0@lo:400:kworker.0 00000100:00100000:3.0:1788541458.382656:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541458.382673:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682c229180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875420981245056:0@lo:400:kworker.0 00000100:00100000:3.0:1788541458.382692:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541458.382722:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981244032 00000100:00100000:3.0:1788541458.382726:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981244032 00000100:00100000:3.0:1788541458.382744:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981244544 00000100:00100000:3.0:1788541458.382748:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981244544 00000100:00100000:3.0:1788541458.382758:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981245056 00000100:00100000:3.0:1788541458.382761:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981245056 00000100:00080000:3.0:1788541458.382776:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788541458.382790:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788541458.382906:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682c22b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875420981244800:0@lo:400:kworker.0 00000100:00100000:0.0:1788541458.382961:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981243776:0@lo:400:kworker.0 00000100:00100000:0.0:1788541458.382972:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981244288:0@lo:400:kworker.0 00000100:00100000:0.0:1788541458.382992:0:25397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788541458.383000:0:25397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682c22a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875420981244544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541458.383047:0:25397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682c22a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875420981244544:12345-0@lo:400:kworker.0 Request processed in 49us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541458.383053:0:25397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788541458.383066:0:25397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788541458.383078:0:25397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682c228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875420981245056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541458.383105:0:25397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682c228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875420981245056:12345-0@lo:400:kworker.0 Request processed in 28us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541458.383110:0:25397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788541458.383149:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981243520 00000100:00100000:0.0:1788541458.383152:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981243520 00000100:00100000:0.0:1788541458.383179:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788541458.383185:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+24:3642:x1875420981243520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541458.383214:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee13e9d8-48fa-4214-b460-99ccd69f1274+24:3642:x1875420981243520:12345-0@lo:400:kworker.0 Request processed in 30us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541458.383220:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788541458.383281:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee13e9d8-48fa-4214-b460-99ccd69f1274:3642:1875420981243520:0@lo:400:kworker.0 00000100:00100000:0.0:1788541458.383291:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682c22a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875420981244544:0@lo:400:kworker.0 00010000:00080000:0.0:1788541458.383301:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a682c229180 x1875420981245056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541458.383309:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682c229180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875420981245056:0@lo:400:kworker.0 00000100:00100000:3.0:1788541458.385013:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682c228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420981244032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541458.385104:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682c228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420981244032:12345-0@lo:400:kworker.0 Request processed in 2308us (2485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541458.385113:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788541458.385987:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420981244032:0@lo:400:kworker.0 00000100:00100000:2.0:1788541458.386326:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981243904:0@lo:400:kworker.0 00000100:00100000:2.0:1788541458.386382:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541458.386407:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682c22ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981244416:0@lo:400:kworker.0 00000100:00100000:2.0:1788541458.386430:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541458.386446:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a682c229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875420981244928:0@lo:400:kworker.0 00000100:00100000:2.0:1788541458.386471:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541458.386500:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981243904 00000100:00100000:2.0:1788541458.386508:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981243904 00000100:00100000:2.0:1788541458.386543:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981244416 00000100:00100000:2.0:1788541458.386546:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981244416 00000100:00100000:2.0:1788541458.386573:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788541458.386580:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806aa2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981243904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541458.386620:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806aa2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981243904:12345-0@lo:400:kworker.0 Request processed in 40us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541458.386626:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788541458.386746:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788541458.386752:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6836adad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981244416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541458.386814:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6836adad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981244416:12345-0@lo:400:kworker.0 Request processed in 61us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541458.386821:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788541458.386850:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:2.0:1788541458.386856:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a683632aa00, transno 12884901892 00000004:00080000:2.0:1788541458.386867:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:2.0:1788541458.386899:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981243904:0@lo:400:kworker.0 00000100:00100000:2.0:1788541458.386912:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682c22ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981244416:0@lo:400:kworker.0 00000100:00080000:3.0:1788541458.389751:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788541458.389803:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541458.389979:0:25397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981244928 00000100:00100000:2.0:1788541458.389989:0:25397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981244928 00000100:00100000:2.0:1788541458.390055:0:25397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788541458.390065:0:25397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6836ada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875420981244928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541458.390154:0:25397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6836ada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875420981244928:12345-0@lo:400:kworker.0 Request processed in 91us (3682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541458.390162:0:25397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788541458.390212:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a682c229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875420981244928:0@lo:400:kworker.0 00000100:00080000:2.0:1788541458.390245:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788541458.390556:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981243264 00000100:00100000:1.0:1788541458.390562:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981243264 00000100:00100000:1.0:1788541458.390589:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981243392 00000100:00100000:1.0:1788541458.390592:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981243392 00000100:00100000:1.0:1788541458.390608:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788541458.390615:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708313800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981243264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788541458.390631:0:24280:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3676622848 00000100:00100000:1.0:1788541458.390674:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708313800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981243264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (12168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541458.390680:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788541458.390693:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788541458.390700:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6836adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981243392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788541458.390715:0:24280:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788541458.390746:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6836adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981243392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (8622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541458.390751:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788541458.390973:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981243392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788541458.391012:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6836329880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981243264:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788541458.391222:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981243136 00000100:00100000:0.0:1788541458.391227:0:24281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981243136 00000100:00100000:1.0:1788541458.391273:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788541458.391281:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682c228e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981243136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788541458.391293:0:24280:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3676622848 00000100:00100000:1.0:1788541458.391419:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682c228e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981243136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (1637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541458.391425:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788541458.391494:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981243136:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788541459.082081:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541459.233151:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541459.233194:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541459.233229:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541459.233266:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541459.233294:0:24795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955974144 00000100:00100000:3.0:1788541459.233302:0:24795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955974144 00000100:00100000:3.0:1788541459.233478:0:24795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 15 00000100:00100000:3.0:1788541459.233495:0:24795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682c229500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99be596c-2540-43f5-83c8-4f74e1767f87+5:2397:x1875420955974144:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541459.233605:0:24795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682c229500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99be596c-2540-43f5-83c8-4f74e1767f87+5:2397:x1875420955974144:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 111us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541459.233613:0:24795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 15 00000100:00100000:3.0:1788541459.233636:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955973888 00000100:00100000:3.0:1788541459.233640:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955973888 00000100:00100000:3.0:1788541459.233667:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955974400 00000100:00100000:3.0:1788541459.233670:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955974400 00000100:00100000:3.0:1788541459.233689:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 60 00000100:00100000:3.0:1788541459.233696:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682c22b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99be596c-2540-43f5-83c8-4f74e1767f87+5:2397:x1875420955973888:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541459.233724:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682c22b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99be596c-2540-43f5-83c8-4f74e1767f87+5:2397:x1875420955973888:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 28us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541459.233732:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 60 00000100:00100000:3.0:1788541459.233743:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 61 00000100:00100000:3.0:1788541459.233749:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682c228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+5:2397:x1875420955974400:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541459.233770:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682c228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+5:2397:x1875420955974400:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 22us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541459.233777:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 61 00000100:00080000:3.0:1788541459.233793:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788541459.233798:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788541459.233822:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541459.233904:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541459.233932:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541459.233990:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541459.234005:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541459.234026:0:25397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955973760 00000100:00100000:3.0:1788541459.234036:0:25397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955973760 00000100:00100000:3.0:1788541459.234059:0:25397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955974272 00000100:00100000:3.0:1788541459.234062:0:25397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955974272 00000100:00100000:3.0:1788541459.234074:0:25397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 62 00000100:00100000:3.0:1788541459.234080:0:25397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682c228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99be596c-2540-43f5-83c8-4f74e1767f87+22:2397:x1875420955973760:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541459.234160:0:25397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682c228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99be596c-2540-43f5-83c8-4f74e1767f87+22:2397:x1875420955973760:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 78us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541459.234167:0:25397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 62 00000100:00100000:3.0:1788541459.234180:0:25397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 63 00000100:00100000:3.0:1788541459.234185:0:25397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682c22bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+6:2397:x1875420955974272:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541459.234210:0:25397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682c22bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+6:2397:x1875420955974272:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541459.234215:0:25397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 63 00000100:00100000:3.0:1788541459.234232:0:25171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955974656 00000100:00100000:3.0:1788541459.234236:0:25171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955974656 00000100:00100000:3.0:1788541459.234255:0:25171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955974016 00000100:00100000:3.0:1788541459.234258:0:25171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955974016 00000100:00100000:3.0:1788541459.234267:0:25171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955974528 00000100:00100000:3.0:1788541459.234269:0:25171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955974528 00000100:00100000:3.0:1788541459.234282:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:3.0:1788541459.234288:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682c22aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+5:2397:x1875420955974656:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541459.234310:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682c22aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+5:2397:x1875420955974656:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 22us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541459.234316:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:3.0:1788541459.234326:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:3.0:1788541459.234331:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682c229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:99be596c-2540-43f5-83c8-4f74e1767f87+5:2397:x1875420955974016:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541459.234378:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682c229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:99be596c-2540-43f5-83c8-4f74e1767f87+5:2397:x1875420955974016:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 36us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541459.234385:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:3.0:1788541459.234397:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 18 00000100:00100000:3.0:1788541459.234403:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682c22b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+5:2397:x1875420955974528:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541459.234425:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682c22b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a2aaee5-6ecc-4707-b5d5-9dc192caa500+5:2397:x1875420955974528:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 22us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541459.234432:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 18 00000100:00080000:3.0:1788541459.234452:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788541459.234456:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788541459.234458:0:22767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788541459.234646:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955973632 00000100:00100000:0.0:1788541459.234650:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955973632 00000100:00100000:0.0:1788541459.234678:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 166 00000100:00100000:0.0:1788541459.234685:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839b20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb464d9e-1538-4f36-92c9-4fbd9231889d+13:2397:x1875420955973632:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541459.234722:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839b20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb464d9e-1538-4f36-92c9-4fbd9231889d+13:2397:x1875420955973632:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 37us (1579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541459.234735:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 166 00000001:02000400:2.0:1788541459.295528:0:25855:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1788541460.108263:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 14086 lines, 14086 kept, 0 dropped, 0 bad.