00000100:00100000:3.0F:1789579171.959333:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579171.959421:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0F:1789579171.959924:0:18628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261445504 00000100:00100000:2.0:1789579171.959941:0:18628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261445504 00002000:00100000:2.0:1789579171.960013:0:18628:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff939304172680 x1876509261445504/t0(0) o4->fb59b6f8-2a36-456b-b988-f5328ecc7957@192.168.203.37@tcp:417/0 lens 504/0 e 0 to 0 dl 1789579182 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1789579171.960024:0:18628:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff939304172680 with x1876509261445504 ext(0->8) 00002000:00010000:2.0:1789579171.960031:0:18628:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff939304172680 00000100:00100000:2.0:1789579171.960064:0:18628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 0 00000100:00100000:2.0:1789579171.960075:0:18628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+8:2394:x1876509261445504:12345-192.168.203.37@tcp:4:bash.0 00000100:00100000:2.0:1789579171.960610:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261445632 00000100:00100000:2.0:1789579171.960617:0:19481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261445632 00000100:00100000:2.0:1789579171.960647:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 29 00000100:00100000:2.0:1789579171.960655:0:19481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb59b6f8-2a36-456b-b988-f5328ecc7957+11:2394:x1876509261445632:12345-192.168.203.37@tcp:16:kworker.0 00000100:00080000:0.0F:1789579171.961457:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789579171.962101:0:18628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+11:2394:x1876509261445504:12345-192.168.203.37@tcp:4:bash.0 Request processed in 1919us (2671us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789579171.962124:0:18628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 0 00002000:00100000:2.0:1789579171.962135:0:18628:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff939304172680 x1876509261445504/t8589934599(0) o4->fb59b6f8-2a36-456b-b988-f5328ecc7957@192.168.203.37@tcp:417/0 lens 504/448 e 0 to 0 dl 1789579182 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1789579171.962144:0:18628:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff939304172680 with x1876509261445504 ext(0->8) 00002000:00010000:2.0:1789579171.962159:0:18628:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff939304172680 00000001:00080000:2.0:1789579171.968249:0:19437:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:2.0:1789579171.968270:0:19437:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000100:00100000:3.0:1789579171.968506:0:19481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:2394:x1876509261445632:12345-192.168.203.37@tcp:16:kworker.0 Request processed in 7845us (9079us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579171.968519:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 29 00000100:00100000:0.0:1789579172.195645:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939408ead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277241856:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789579172.195715:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0F:1789579172.195788:0:19911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277241856 00000100:00100000:1.0:1789579172.195803:0:19911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277241856 00000100:00100000:1.0:1789579172.195854:0:19911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789579172.195871:0:19911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277241856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789579172.195890:0:19911:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789579172.209528:0:19911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277241856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 13654us (13803us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579172.209547:0:19911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789579172.209857:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939408ead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277241856:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789579172.772524:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579172.995991:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579172.996044:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579172.996085:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579172.996273:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261445760 00000100:00100000:0.0:1789579172.996283:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261445760 00000100:00100000:0.0:1789579172.996339:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 170 00000100:00100000:0.0:1789579172.996382:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f7f6d69-9306-485c-8954-48c3fbe6cf31+13:2394:x1876509261445760:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789579172.996449:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f7f6d69-9306-485c-8954-48c3fbe6cf31+13:2394:x1876509261445760:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 102us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579172.996468:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 170 00000100:00100000:1.0:1789579173.003017:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261446016 00000100:00100000:1.0:1789579173.003032:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261446016 00000100:00100000:0.0:1789579173.003154:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261445888 00000100:00100000:0.0:1789579173.003159:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261445888 00000100:00100000:0.0:1789579173.003204:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 82 00000100:00100000:0.0:1789579173.003219:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+5:2394:x1876509261446016:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789579173.003226:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 83 00000100:00100000:2.0:1789579173.003246:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+25:2394:x1876509261445888:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789579173.003312:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+5:2394:x1876509261446016:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 97us (7266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579173.003320:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 82 00000100:00100000:2.0:1789579173.003344:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+25:2394:x1876509261445888:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 107us (7258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579173.003383:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 83 00000100:00080000:1.0:1789579173.003808:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789579173.003813:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789579173.005370:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579173.006005:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579173.006045:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579173.006291:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261446528 00000100:00100000:1.0:1789579173.006298:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261446528 00000100:00080000:2.0:1789579173.006345:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789579173.006367:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261446400 00000100:00100000:1.0:1789579173.006371:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261446400 00000100:00080000:2.0:1789579173.006408:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789579173.006414:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 84 00000100:00100000:1.0:1789579173.006423:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+5:2395:x1876509261446528:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789579173.006440:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 85 00000100:00100000:2.0:1789579173.006448:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+6:2395:x1876509261446400:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789579173.006566:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+6:2395:x1876509261446400:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 117us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579173.006566:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+5:2395:x1876509261446528:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 143us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579173.006574:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 84 00000100:00100000:2.0:1789579173.006577:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 85 00000100:00100000:3.0:1789579173.006662:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261446272 00000100:00100000:3.0:1789579173.006667:0:18624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261446272 00000100:00100000:3.0:1789579173.006714:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 31 00000100:00100000:3.0:1789579173.006722:0:18624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:2395:x1876509261446272:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789579173.006759:0:18624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:2395:x1876509261446272:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 38us (1416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579173.006766:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 31 00000100:00080000:2.0:1789579173.006819:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789579173.015134:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579173.015230:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579173.016431:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579173.017386:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261446144 00000100:00100000:1.0:1789579173.017398:0:18623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261446144 00000100:00100000:1.0:1789579173.017873:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261446656 00000100:00100000:1.0:1789579173.017878:0:18623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261446656 00000100:00100000:1.0:1789579173.017908:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 30 00000100:00100000:1.0:1789579173.017917:0:18623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+5:2391:x1876509261446144:12345-192.168.203.37@tcp:9:kworker.0 00000020:00000080:1.0:1789579173.017948:0:18623:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f22324 00000100:00080000:1.0:1789579173.017975:0:18623:0:(import.c:65:import_set_state_nolock()) ffff9393048c5000 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1789579173.018110:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:1.0:1789579173.018275:0:18623:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1789579173.018642:0:18623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+2:2391:x1876509261446144:12345-192.168.203.37@tcp:9:kworker.0 Request processed in 724us (3516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579173.018651:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 30 00000100:00100000:1.0:1789579173.018668:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 31 00000100:00100000:1.0:1789579173.018675:0:18623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+5:2391:x1876509261446656:12345-192.168.203.37@tcp:9:kworker.0 00000020:00000080:1.0:1789579173.018688:0:18623:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f22363 00000100:00080000:1.0:1789579173.018693:0:18623:0:(import.c:65:import_set_state_nolock()) ffff939403951000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789579173.018906:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261446784 00000100:00100000:2.0:1789579173.018911:0:18622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261446784 00000100:00100000:2.0:1789579173.018943:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 32 00000100:00100000:2.0:1789579173.018950:0:18622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+5:2391:x1876509261446784:12345-192.168.203.37@tcp:9:kworker.0 00000020:00000080:2.0:1789579173.018963:0:18622:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f2236a 00000100:00080000:2.0:1789579173.018972:0:18622:0:(import.c:65:import_set_state_nolock()) ffff939436c54000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789579173.019569:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789579173.019591:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:1.0:1789579173.019668:0:18623:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00010000:00010000:0.0:1789579173.019970:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579173.020131:0:18623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+2:2391:x1876509261446656:12345-192.168.203.37@tcp:9:kworker.0 Request processed in 1452us (4896us total) trans 0 rc 0/0 00000001:00000004:2.0:1789579173.020311:0:18622:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00010000:00010000:0.0:1789579173.020440:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579173.020739:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 31 00000100:00100000:2.0:1789579173.022234:0:18622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+2:2391:x1876509261446784:12345-192.168.203.37@tcp:9:kworker.0 Request processed in 3278us (5801us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579173.022246:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 32 00000001:00080000:0.0:1789579173.735105:0:17098:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934634 is committed 00000020:00080000:0.0:1789579173.735136:0:17098:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff939408a976c0 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:0.0:1789579173.735142:0:17098:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff939420494500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9394091390c0 00000020:00080000:0.0:1789579173.735145:0:17098:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff939420494800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff939302089000 00000020:00080000:0.0:1789579173.735171:0:17157:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:0.0:1789579173.735305:0:17157:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1789579173.739588:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a600/0xd90373d592f2266c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579173.739637:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a600/0xd90373d592f2266c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579173.739647:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a600/0xd90373d592f2266c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579173.739654:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939435d7a600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579173.739660:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a600/0xd90373d592f2266c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579173.739668:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a600/0xd90373d592f2266c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579173.739694:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93940905b700) 00010000:00010000:2.0:1789579173.739698:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789579173.739704:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a600/0xd90373d592f2266c lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579173.739710:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a600/0xd90373d592f2266c lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579173.744395:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277241984:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789579173.744481:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789579173.744510:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277242112:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789579173.744511:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579173.744607:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579173.756537:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277241984 00000100:00100000:1.0:1789579173.756560:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277241984 00000100:00100000:1.0:1789579173.756641:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277242112 00000100:00100000:1.0:1789579173.756645:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277242112 00000100:00100000:1.0:1789579173.756673:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789579173.756683:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277241984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789579173.756731:0:17124:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789579173.756856:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277241984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 174us (12352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579173.756864:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789579173.756884:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789579173.756891:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277242112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789579173.756924:0:17124:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1789579173.756964:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277242112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (12359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579173.756972:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789579173.757052:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277241984:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789579173.757100:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277242112:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789579173.809268:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579174.820664:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579174.994092:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579174.994131:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261446912 00000100:00100000:3.0:1789579174.994140:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261446912 00000100:00100000:3.0:1789579174.994197:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 74 00000100:00100000:3.0:1789579174.994208:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304171880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+12:15548:x1876509261446912:12345-192.168.203.37@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789579174.994308:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304171880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+12:15548:x1876509261446912:12345-192.168.203.37@tcp:60:lhsmtool_posix.0 Request processed in 102us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579174.994316:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 74 00000100:00100000:3.0:1789579175.006425:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579175.007274:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261447040 00000100:00100000:0.0:1789579175.007284:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261447040 00000100:00080000:3.0:1789579175.007575:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789579175.007748:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 75 00000100:00100000:0.0:1789579175.007762:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+5:15548:x1876509261447040:12345-192.168.203.37@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789579175.007876:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+5:15548:x1876509261447040:12345-192.168.203.37@tcp:60:lhsmtool_posix.0 Request processed in 117us (1461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579175.007901:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 75 00000100:00100000:3.0:1789579175.014068:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579175.014098:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261447296 00000100:00100000:3.0:1789579175.014115:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261447296 00000100:00100000:3.0:1789579175.014167:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:3.0:1789579175.014177:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939407159050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+12:15548:x1876509261447296:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789579175.014404:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939407159050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+13:15548:x1876509261447296:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 Request processed in 228us (341us total) trans 8589934635 rc 0/0 00000100:00100000:3.0:1789579175.014412:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00080000:3.0:1789579175.014477:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789579175.844997:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579176.292491:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:044b3bf9-43fa-4501-b924-7b81ca047525:3615:1876509277242368:0@lo:400:kworker.0 00000100:00100000:3.0:1789579176.292583:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579176.292647:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304812300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277242880:0@lo:400:kworker.0 00000100:00100000:3.0:1789579176.292674:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579176.292693:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277243392:0@lo:400:kworker.0 00000100:00100000:3.0:1789579176.292724:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579176.292742:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277243904:0@lo:400:kworker.0 00000100:00100000:3.0:1789579176.292765:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579176.292794:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1789579176.292801:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304172d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277242496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789579176.292823:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579176.293144:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277242624:0@lo:400:kworker.0 00000100:00100000:0.0:1789579176.293178:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579176.293197:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277243136:0@lo:400:kworker.0 00000100:00100000:0.0:1789579176.293215:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579176.293227:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876509277243648:0@lo:400:kworker.0 00000100:00100000:0.0:1789579176.293244:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579176.293262:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1789579176.293268:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277242240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789579176.293285:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304812d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277243008:0@lo:400:kworker.0 00000100:00100000:0.0:1789579176.293293:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579176.293312:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277242752:0@lo:400:kworker.0 00000100:00100000:3.0:1789579176.293323:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579176.293339:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579176.293371:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876509277243520:0@lo:400:kworker.0 00000100:00100000:0.0:1789579176.293383:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277243264:0@lo:400:kworker.0 00000100:00100000:3.0:1789579176.293399:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579176.293424:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876509277244032:0@lo:400:kworker.0 00000100:00100000:0.0:1789579176.293442:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579176.293467:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277243776:0@lo:400:kworker.0 00000100:00100000:3.0:1789579176.293470:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579176.293499:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579176.293517:0:19143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277242880 00000100:00100000:3.0:1789579176.293525:0:19143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277242880 00000100:00100000:0.0:1789579176.293540:0:18626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277242496 00000100:00100000:0.0:1789579176.293546:0:18626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277242496 00000100:00100000:3.0:1789579176.293576:0:19143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277243392 00000100:00100000:3.0:1789579176.293580:0:19143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277243392 00000100:00100000:3.0:1789579176.293596:0:19143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277242752 00000100:00100000:3.0:1789579176.293599:0:19143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277242752 00000100:00100000:3.0:1789579176.293610:0:19143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277243264 00000100:00100000:3.0:1789579176.293612:0:19143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277243264 00000100:00100000:3.0:1789579176.293626:0:19143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789579176.293634:0:19143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304173480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3615:x1876509277242880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579176.293685:0:19143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304173480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3615:x1876509277242880:12345-0@lo:400:kworker.0 Request processed in 51us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579176.293692:0:19143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789579176.293723:0:19143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789579176.293730:0:19143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277243392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579176.293758:0:19143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277243392:12345-0@lo:400:kworker.0 Request processed in 29us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579176.293764:0:19143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789579176.293776:0:19143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789579176.293782:0:19143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277242752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579176.293816:0:19143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277242752:12345-0@lo:400:kworker.0 Request processed in 34us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579176.293822:0:19143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789579176.293832:0:19143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789579176.293839:0:19143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277243264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579176.294382:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277242368 00000100:00100000:2.0:1789579176.294388:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277242368 00000100:00100000:2.0:1789579176.294420:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789579176.294439:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+24:3615:x1876509277242368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579176.294478:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+24:3615:x1876509277242368:12345-0@lo:400:kworker.0 Request processed in 52us (1896us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579176.294484:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789579176.294511:0:18627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277242240 00000100:00100000:2.0:1789579176.294522:0:18627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277242240 00000100:00100000:2.0:1789579176.294541:0:18627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789579176.294546:0:18627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277242496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789579176.294567:0:18627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789579176.294596:0:18627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277242496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (1772us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579176.294602:0:18627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789579176.294615:0:18627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789579176.294620:0:18627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277242240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789579176.294633:0:18627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789579176.294659:0:18627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277242240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579176.294665:0:18627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789579176.294697:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277243904 00000100:00100000:0.0:1789579176.294703:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277243904 00000100:00100000:2.0:1789579176.294729:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277243648 00000100:00100000:2.0:1789579176.294734:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277243648 00000100:00100000:2.0:1789579176.294754:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277243008 00000100:00100000:2.0:1789579176.294757:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277243008 00000100:00100000:2.0:1789579176.294766:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277243520 00000100:00100000:2.0:1789579176.294768:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277243520 00000100:00100000:2.0:1789579176.294778:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277244032 00000100:00100000:2.0:1789579176.294780:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277244032 00000100:00100000:2.0:1789579176.294804:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277243776 00000100:00100000:2.0:1789579176.294806:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277243776 00000100:00100000:2.0:1789579176.294821:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789579176.294826:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277243904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579176.295008:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789579176.295018:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876509277243648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579176.295055:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876509277243648:12345-0@lo:400:kworker.0 Request processed in 39us (1809us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579176.295062:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789579176.295076:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789579176.295082:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277243008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579176.295109:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277243008:12345-0@lo:400:kworker.0 Request processed in 28us (1788us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579176.295115:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789579176.295129:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789579176.295134:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304171500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876509277243520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579176.295161:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304171500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876509277243520:12345-0@lo:400:kworker.0 Request processed in 27us (1764us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579176.295166:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789579176.295179:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789579176.295186:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304171180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876509277244032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579176.295199:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277243904:12345-0@lo:400:kworker.0 Request processed in 371us (2431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579176.295208:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789579176.295219:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304171180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876509277244032:12345-0@lo:400:kworker.0 Request processed in 32us (1750us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579176.295234:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789579176.295241:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277243776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579176.295273:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277243776:12345-0@lo:400:kworker.0 Request processed in 31us (1774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579176.295327:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277242624 00000100:00100000:1.0:1789579176.295333:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277242624 00000100:00100000:3.0:1789579176.295347:0:19143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277243264:12345-0@lo:400:kworker.0 Request processed in 1506us (1914us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579176.295382:0:19143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789579176.295383:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277243136 00000100:00100000:1.0:1789579176.295388:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277243136 00000100:00080000:3.0:1789579176.295409:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789579176.295409:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1789579176.295415:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789579176.295418:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277242624:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789579176.295420:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789579176.295424:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789579176.295468:0:3615:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000100:00100000:1.0:1789579176.295474:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277242624:12345-0@lo:400:kworker.0 Request processed in 56us (2293us total) trans 0 rc 0/0 00000004:00080000:3.0:1789579176.295476:0:3615:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff939303a48e00, transno 8589934596 00000100:00100000:1.0:1789579176.295485:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000004:00080000:3.0:1789579176.295493:0:3615:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:1.0:1789579176.295504:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789579176.295511:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277243136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579176.295526:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304172d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277242496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789579176.295545:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304812d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277243008:0@lo:400:kworker.0 00000100:00100000:1.0:1789579176.295546:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277243136:12345-0@lo:400:kworker.0 Request processed in 34us (2328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579176.295558:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789579176.295565:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876509277243520:0@lo:400:kworker.0 00010000:00080000:3.0:1789579176.295579:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303b15f80 x1876509277244032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579176.295590:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876509277244032:0@lo:400:kworker.0 00000100:00100000:3.0:1789579176.295601:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304812300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277242880:0@lo:400:kworker.0 00000100:00100000:3.0:1789579176.295612:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277243392:0@lo:400:kworker.0 00000100:00100000:3.0:1789579176.295621:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277243904:0@lo:400:kworker.0 00000100:00100000:3.0:1789579176.295630:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:044b3bf9-43fa-4501-b924-7b81ca047525:3615:1876509277242368:0@lo:400:kworker.0 00000100:00100000:1.0:1789579176.295665:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789579176.295677:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277244160:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789579176.295707:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579176.295804:0:18627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277244160 00000100:00100000:3.0:1789579176.295808:0:18627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277244160 00000100:00100000:3.0:1789579176.295831:0:18627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789579176.295849:0:18627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277244160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789579176.295861:0:18627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1789579176.296250:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277242240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789579176.296281:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277242752:0@lo:400:kworker.0 00000100:00100000:1.0:1789579176.296292:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277243264:0@lo:400:kworker.0 00010000:00080000:1.0:1789579176.296305:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303b15c00 x1876509277243776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579176.296315:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277243776:0@lo:400:kworker.0 00000100:00100000:1.0:1789579176.296326:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277242624:0@lo:400:kworker.0 00000100:00100000:1.0:1789579176.296335:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277243136:0@lo:400:kworker.0 00000100:00100000:1.0:1789579176.296345:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876509277243648:0@lo:400:kworker.0 00000100:00100000:0.0:1789579176.296545:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789579176.296577:0:18627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277244160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 738us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579176.296584:0:18627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789579176.297039:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277244160:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789579176.300420:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00010000:1.0:1789579176.872749:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789579177.030891:0:20494:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 13:19:34 (1789579174) 00000100:00100000:1.0:1789579177.322500:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277244288:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789579177.322567:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579177.322625:0:19911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277244288 00000100:00100000:1.0:1789579177.322633:0:19911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277244288 00000100:00100000:1.0:1789579177.322677:0:19911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789579177.322687:0:19911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943738a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277244288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789579177.322718:0:19911:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789579177.322762:0:19911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943738a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277244288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579177.322769:0:19911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789579177.322827:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277244288:0@lo:13:osp-pre-0-1.0 00000040:00080000:0.0:1789579177.571539:0:17152:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789579177.571548:0:17152:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789579177.571570:0:17152:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789579177.571578:0:17152:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1789579177.905821:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579178.105918:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579178.106107:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579178.106140:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579178.106160:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579178.106183:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579178.106209:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261447680 00000100:00100000:3.0:1789579178.106217:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261447680 00000100:00100000:3.0:1789579178.106268:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261447936 00000100:00100000:3.0:1789579178.106271:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261447936 00000100:00100000:3.0:1789579178.106285:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261447552 00000100:00100000:3.0:1789579178.106288:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261447552 00000100:00100000:3.0:1789579178.106302:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 92 00000100:00100000:3.0:1789579178.106312:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+5:2394:x1876509261447680:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789579178.106400:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+5:2394:x1876509261447680:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 89us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579178.106408:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 92 00000100:00100000:3.0:1789579178.106438:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 93 00000100:00100000:3.0:1789579178.106445:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304172a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+6:2394:x1876509261447936:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789579178.106473:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304172a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+6:2394:x1876509261447936:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 29us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579178.106479:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 93 00000100:00100000:3.0:1789579178.106493:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 94 00000100:00100000:3.0:1789579178.106500:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+13:2395:x1876509261447552:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789579178.106536:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+13:2395:x1876509261447552:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 37us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579178.106542:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 94 00000100:00100000:3.0:1789579178.106561:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261447808 00000100:00100000:3.0:1789579178.106564:0:18622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261447808 00000100:00100000:3.0:1789579178.107100:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 36 00000100:00100000:3.0:1789579178.107108:0:18622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304170a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:2395:x1876509261447808:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789579178.107135:0:18622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304170a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:2395:x1876509261447808:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 29us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579178.107141:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 36 00000100:00080000:3.0:1789579178.107156:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789579178.107160:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789579178.107162:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789579178.109123:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261447424 00000100:00100000:0.0:1789579178.109137:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261447424 00000100:00100000:3.0:1789579178.109263:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579178.109294:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261448064 00000100:00100000:3.0:1789579178.109298:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261448064 00000100:00100000:3.0:1789579178.109338:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 95 00000100:00100000:3.0:1789579178.109347:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304172300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+5:2395:x1876509261448064:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789579178.109444:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304172300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+5:2395:x1876509261448064:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 98us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579178.109451:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 95 00000100:00080000:3.0:1789579178.109470:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789579178.111031:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 172 00000100:00100000:0.0:1789579178.111047:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f7f6d69-9306-485c-8954-48c3fbe6cf31+13:2394:x1876509261447424:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789579178.111106:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f7f6d69-9306-485c-8954-48c3fbe6cf31+13:2394:x1876509261447424:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 64us (5196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579178.111112:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 172 00000100:00100000:1.0:1789579178.852536:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277244416:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789579178.852595:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579178.852634:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789579178.852640:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277244544:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789579178.852661:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579178.854213:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277244416 00000100:00100000:3.0:1789579178.854225:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277244416 00000100:00100000:3.0:1789579178.854276:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277244544 00000100:00100000:3.0:1789579178.854280:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277244544 00000100:00100000:3.0:1789579178.854300:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789579178.854318:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277244416:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789579178.854533:0:18222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789579178.854545:0:18222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277244544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789579178.854580:0:18222:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1789579178.854651:0:18222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277244544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (1988us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579178.854659:0:18222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00000024:3.0:1789579178.855086:0:17123:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789579178.855127:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277244416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 810us (2530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579178.855134:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789579178.855209:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277244544:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789579178.855225:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277244416:0@lo:41:osp-pre-1-0.0 00000001:00100000:1.0:1789579178.855341:0:19437:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1c259fca-ec9a-4b20-b3ac-ca463a9ba85c 00000020:00000080:1.0:1789579178.855347:0:19437:0:(genops.c:885:class_export_put()) final put ffff939436c51800/1c259fca-ec9a-4b20-b3ac-ca463a9ba85c 00000001:00100000:0.0:1789579178.855500:0:18619:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1c259fca-ec9a-4b20-b3ac-ca463a9ba85c 00000020:00000080:0.0:1789579178.855504:0:18619:0:(genops.c:885:class_export_put()) final put ffff939403951800/1c259fca-ec9a-4b20-b3ac-ca463a9ba85c 00000001:00100000:0.0:1789579178.855514:0:18619:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fb59b6f8-2a36-456b-b988-f5328ecc7957 00000020:00000080:0.0:1789579178.855516:0:18619:0:(genops.c:885:class_export_put()) final put ffff9393048c6800/fb59b6f8-2a36-456b-b988-f5328ecc7957 00000020:00000080:3.0:1789579178.855587:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff939436c51800/1c259fca-ec9a-4b20-b3ac-ca463a9ba85c for lustre-OST0001 00000020:00000080:3.0:1789579178.855716:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff939403951800/1c259fca-ec9a-4b20-b3ac-ca463a9ba85c for lustre-OST0000 00000020:00000080:3.0:1789579178.856211:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9393048c6800/fb59b6f8-2a36-456b-b988-f5328ecc7957 for lustre-OST0000 00000020:00000080:3.0:1789579178.856230:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff939436c54000 for lustre-OST0001 00000020:00000080:3.0:1789579178.856234:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff939403951000 for lustre-OST0000 00000020:00000080:3.0:1789579178.856238:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9393048c5000 for lustre-OST0000 00010000:00010000:1.0:1789579178.915567:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789579179.685337:0:17872:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:0.0:1789579179.877861:0:17098:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:0.0:1789579179.877875:0:17098:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:2.0:1789579179.877938:0:17157:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:2.0:1789579179.877948:0:17157:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00010000:00010000:1.0:1789579179.939674:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579180.963576:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579181.411768:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943738bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277244672:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789579181.411848:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579181.411902:0:18627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277244672 00000100:00100000:0.0:1789579181.411921:0:18627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277244672 00000100:00100000:0.0:1789579181.411998:0:18627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789579181.412008:0:18627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277244672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789579181.412036:0:18627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789579181.412081:0:18627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277244672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579181.412089:0:18627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1789579181.412121:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789579181.412591:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277244928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789579181.412627:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579181.412700:0:18626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277244928 00000100:00100000:2.0:1789579181.412705:0:18626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277244928 00000100:00100000:2.0:1789579181.412738:0:18626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789579181.412745:0:18626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277244928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789579181.412761:0:18626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789579181.412790:0:18626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277244928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579181.412795:0:18626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789579181.412823:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437388a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277244800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789579181.412846:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579181.414694:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943738a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:044b3bf9-43fa-4501-b924-7b81ca047525:3616:1876509277245056:0@lo:400:kworker.0 00000100:00100000:1.0:1789579181.414753:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579181.416536:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943738bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277244672:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789579181.416574:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277245184:0@lo:400:kworker.0 00000100:00100000:3.0:1789579181.417774:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579181.418450:0:18222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277245184 00000100:00100000:3.0:1789579181.418684:0:18222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277245184 00000100:00100000:3.0:1789579181.418740:0:18222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789579181.418755:0:18222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277245184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579181.418829:0:18222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277245184:12345-0@lo:400:kworker.0 Request processed in 77us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579181.419586:0:18222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789579181.422779:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277244928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789579181.422815:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943738aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277245440:0@lo:400:kworker.0 00000100:00100000:0.0:1789579181.422875:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579181.425257:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277245184:0@lo:400:kworker.0 00000100:00100000:3.0:1789579181.425275:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277245696:0@lo:400:kworker.0 00000100:00100000:3.0:1789579181.425377:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579181.425767:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876509277246208:0@lo:400:kworker.0 00000100:00100000:3.0:1789579181.425794:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579181.431696:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789579181.431731:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943738b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277245312:0@lo:400:kworker.0 00000100:00100000:3.0:1789579181.431800:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579181.432777:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876509277245824:0@lo:400:kworker.0 00000100:00100000:3.0:1789579181.432817:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579181.433297:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277245696 00000100:00100000:3.0:1789579181.433305:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277245696 00000100:00100000:3.0:1789579181.433388:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277246208 00000100:00100000:3.0:1789579181.433402:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277246208 00000100:00100000:3.0:1789579181.433421:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277245312 00000100:00100000:3.0:1789579181.433425:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277245312 00000100:00100000:3.0:1789579181.433435:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277245824 00000100:00100000:3.0:1789579181.433438:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277245824 00000100:00100000:3.0:1789579181.433454:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789579181.433463:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876509277245696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579181.433480:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277245952:0@lo:400:kworker.0 00000100:00100000:3.0:1789579181.433524:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876509277245696:12345-0@lo:400:kworker.0 Request processed in 62us (8147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579181.433530:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789579181.433547:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789579181.433553:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943738bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876509277246208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579181.433592:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943738bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876509277246208:12345-0@lo:400:kworker.0 Request processed in 40us (7797us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579181.433599:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789579181.433611:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789579181.434877:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579181.434928:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277245440 00000100:00100000:0.0:1789579181.434935:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277245440 00000100:00100000:0.0:1789579181.434977:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789579181.434985:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277245440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579181.435029:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277245440:12345-0@lo:400:kworker.0 Request processed in 45us (12154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579181.435036:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789579181.435058:0:19911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277244800 00000100:00100000:0.0:1789579181.435062:0:19911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277244800 00000100:00100000:0.0:1789579181.435091:0:19911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789579181.435098:0:19911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277244800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789579181.435113:0:19911:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789579181.435756:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277245312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579181.435799:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277245312:12345-0@lo:400:kworker.0 Request processed in 48us (3999us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579181.435805:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789579181.435822:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277245952 00000100:00100000:3.0:1789579181.435826:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277245952 00000100:00100000:3.0:1789579181.435859:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789579181.435866:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304813b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876509277245824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579181.436321:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304813b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876509277245824:12345-0@lo:400:kworker.0 Request processed in 454us (3502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579181.436328:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789579181.436347:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789579181.436377:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277245952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579181.436423:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277245568:0@lo:400:kworker.0 00000100:00100000:3.0:1789579181.436425:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277245952:12345-0@lo:400:kworker.0 Request processed in 49us (1550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579181.436435:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789579181.436486:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943738b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277245312:0@lo:400:kworker.0 00000100:00100000:3.0:1789579181.436499:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876509277245824:0@lo:400:kworker.0 00000100:00100000:3.0:1789579181.436509:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277245696:0@lo:400:kworker.0 00010000:00080000:3.0:1789579181.436524:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a5d180 x1876509277246208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579181.436535:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876509277246208:0@lo:400:kworker.0 00000100:00100000:1.0:1789579181.436541:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579181.436580:0:19143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277245568 00000100:00100000:1.0:1789579181.436584:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876509277246080:0@lo:400:kworker.0 00000100:00100000:3.0:1789579181.436585:0:19143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277245568 00000100:00100000:1.0:1789579181.436624:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579181.436650:0:19143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789579181.436660:0:19143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277245568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579181.436664:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277245056 00000100:00100000:1.0:1789579181.436670:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277245056 00000100:00100000:3.0:1789579181.436702:0:19143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277245568:12345-0@lo:400:kworker.0 Request processed in 45us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579181.436708:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789579181.436713:0:19143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789579181.436720:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+24:3616:x1876509277245056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579181.436735:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277246080 00000100:00100000:3.0:1789579181.436740:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277246080 00000100:00100000:1.0:1789579181.436759:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+24:3616:x1876509277245056:12345-0@lo:400:kworker.0 Request processed in 41us (22004us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579181.436771:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789579181.436776:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789579181.436781:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876509277246080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579181.436811:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876509277246080:12345-0@lo:400:kworker.0 Request processed in 33us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579181.436817:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:3.0:1789579181.436850:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789579181.436855:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789579181.436857:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789579181.436859:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789579181.437191:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943738a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:044b3bf9-43fa-4501-b924-7b81ca047525:3616:1876509277245056:0@lo:400:kworker.0 00000100:00100000:1.0:1789579181.437204:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277245568:0@lo:400:kworker.0 00000100:00100000:1.0:1789579181.437212:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876509277246080:0@lo:400:kworker.0 00000100:00100000:0.0:1789579181.437991:0:19911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277244800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2891us (25142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579181.437999:0:19911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789579181.439613:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943738aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277245440:0@lo:400:kworker.0 00000100:00100000:1.0:1789579181.439765:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437388a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277244800:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789579181.440505:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a4ad80 x1876509277245952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579181.440519:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277245952:0@lo:400:kworker.0 00000100:00100000:0.0:1789579181.474779:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579181.475714:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579181.475745:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579181.476643:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261448576 00000100:00100000:3.0:1789579181.476655:0:19481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261448576 00000100:00100000:3.0:1789579181.476734:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 33 00000100:00100000:3.0:1789579181.476745:0:19481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:2391:x1876509261448576:12345-192.168.203.37@tcp:9:umount.0 00000020:00000080:3.0:1789579181.476778:0:19481:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f2232b 00000020:00010000:3.0:1789579181.476786:0:19481:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9393048c0800: total 0 00000100:00080000:3.0:1789579181.476791:0:19481:0:(import.c:65:import_set_state_nolock()) ffff9393048c2000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789579181.476831:0:19481:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1789579181.477310:0:19481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb59b6f8-2a36-456b-b988-f5328ecc7957+4:2391:x1876509261448576:12345-192.168.203.37@tcp:9:umount.0 Request processed in 565us (1598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579181.477319:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 33 00000020:00010000:1.0:1789579181.479723:0:17106:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9393048c0800: total 0 00010000:00010000:1.0:1789579181.479784:0:17106:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9393048c0800, canceled 0 locks, left on hash table 1. 00002000:00010000:1.0:1789579181.479819:0:17106:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789579181.479822:0:17106:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1789579181.479850:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000165ad199/0xd90373d592f22696 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec47e expref: 3 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579181.479875:0:17106:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9393048c0800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789579181.479887:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579181.479888:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579181.479890:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789579181.479901:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789579181.481547:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579181.482662:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261448192 00000100:00100000:2.0:1789579181.482675:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261448192 00000100:00100000:3.0:1789579181.482883:0:20146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261448704 00000100:00100000:3.0:1789579181.482888:0:20146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261448704 00000100:00100000:0.0:1789579181.483201:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261448320 00000100:00100000:0.0:1789579181.483206:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261448320 00000100:00100000:0.0:1789579181.483250:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 4 00000100:00100000:0.0:1789579181.483260:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f7f6d69-9306-485c-8954-48c3fbe6cf31+15:2392:x1876509261448192:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789579181.483286:0:17105:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789579181.483304:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303436a00/0xd90373d592f22301 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec2b7 expref: 15 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579181.483322:0:17105:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789579181.483410:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f7f6d69-9306-485c-8954-48c3fbe6cf31+14:2392:x1876509261448192:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 151us (8639us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579181.483417:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 4 00000100:00100000:0.0:1789579181.483434:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 5 00000100:00100000:0.0:1789579181.483441:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f7f6d69-9306-485c-8954-48c3fbe6cf31+13:2395:x1876509261448704:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789579181.483459:0:17105:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789579181.483469:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303437a00/0xd90373d592f2238d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec39e expref: 13 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579181.483478:0:17105:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789579181.483495:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f7f6d69-9306-485c-8954-48c3fbe6cf31+12:2395:x1876509261448704:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 55us (7750us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579181.483766:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 6 00000100:00100000:2.0:1789579181.483777:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f7f6d69-9306-485c-8954-48c3fbe6cf31+12:2392:x1876509261448320:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789579181.483787:0:17103:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579181.483797:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939302b2f800/0xd90373d592f22308 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec2e8 expref: 12 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579181.483824:0:17103:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789579181.483846:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f7f6d69-9306-485c-8954-48c3fbe6cf31+11:2392:x1876509261448320:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 72us (2304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579181.483853:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 6 00000100:00100000:0.0:1789579181.485582:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 5 00000100:00100000:3.0:1789579181.497323:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579181.497769:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261449600 00000100:00100000:0.0:1789579181.497789:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261449600 00000100:00100000:0.0:1789579181.497859:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 76 00000100:00100000:0.0:1789579181.497869:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304812300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+12:2391:x1876509261449600:12345-192.168.203.37@tcp:39:umount.0 00000020:00000080:0.0:1789579181.497908:0:18390:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f22316 00000020:00010000:0.0:1789579181.497937:0:18390:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9393034f8800: total 0 00000100:00080000:0.0:1789579181.497942:0:18390:0:(import.c:65:import_set_state_nolock()) ffff9393034fd000 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1789579181.498175:0:17107:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9393034f8800: total 0 00010000:00010000:3.0:1789579181.498222:0:17107:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9393034f8800, canceled 0 locks, left on hash table 7. 00010000:00010000:3.0:1789579181.498251:0:17107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93940905b700) 00010000:00010000:3.0:1789579181.498254:0:17107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789579181.498262:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f22642 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec45b expref: 11 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579181.498289:0:17107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9394039cee00) 00010000:00010000:3.0:1789579181.498291:0:17107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789579181.498300:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e600/0xd90373d592f223fd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3ac expref: 10 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579181.498323:0:17107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93940905bb00) 00010000:00010000:3.0:1789579181.498325:0:17107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789579181.498329:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401519e00/0xd90373d592f2243c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3ba expref: 9 pid: 18390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579181.498343:0:17107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:3.0:1789579181.498345:0:17107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789579181.498370:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363afa00/0xd90373d592f225e7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec446 expref: 8 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579181.498384:0:17107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:3.0:1789579181.498409:0:17107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789579181.498414:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7b200/0xd90373d592f226ab lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec485 expref: 7 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579181.498433:0:17107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93940905b000) 00010000:00010000:3.0:1789579181.498445:0:17107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789579181.498448:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401518c00/0xd90373d592f223e1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3a5 expref: 6 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579181.498464:0:17107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff939302356200) 00010000:00010000:3.0:1789579181.498467:0:17107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789579181.498470:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f224c1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3e4 expref: 5 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579181.498483:0:17107:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9393034f8800, canceled 7 locks, left on hash table 0. 00010000:00010000:3.0:1789579181.498497:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579181.498499:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579181.498500:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789579181.498659:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00000004:0.0:1789579181.498714:0:18390:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934635 00000100:00100000:0.0:1789579181.498876:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304812300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+3:2391:x1876509261449600:12345-192.168.203.37@tcp:39:umount.0 Request processed in 1006us (1561us total) trans 8589934636 rc 0/0 00000100:00100000:0.0:1789579181.498884:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 76 00000100:00100000:0.0:1789579181.510423:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579181.510515:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261449728 00000100:00100000:3.0:1789579181.510528:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261449728 00000100:00100000:3.0:1789579181.510610:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 77 00000100:00100000:3.0:1789579181.510623:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+5:2391:x1876509261449728:12345-192.168.203.37@tcp:39:umount.0 00000020:00000080:3.0:1789579181.510669:0:17119:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f2231d 00000100:00080000:3.0:1789579181.510692:0:17119:0:(import.c:65:import_set_state_nolock()) ffff9393034fb000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789579181.510726:0:17119:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1789579181.511041:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+3:2391:x1876509261449728:12345-192.168.203.37@tcp:39:umount.0 Request processed in 420us (692us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789579181.511051:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 77 00010000:00010000:0.0:1789579181.511445:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789579181.511511:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789579181.988226:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579182.437678:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277246336:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789579182.437750:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579182.438001:0:18627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277246336 00000100:00100000:2.0:1789579182.438009:0:18627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277246336 00000100:00100000:2.0:1789579182.438069:0:18627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789579182.438079:0:18627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277246336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789579182.438101:0:18627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789579182.438154:0:18627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277246336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579182.438160:0:18627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789579182.438242:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277246336:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789579183.011582:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579183.232774:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579183.232932:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261449856 00000100:00100000:0.0:1789579183.232942:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261449856 00000100:00100000:0.0:1789579183.232996:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 174 00000100:00100000:0.0:1789579183.233006:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f7f6d69-9306-485c-8954-48c3fbe6cf31+10:2392:x1876509261449856:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789579183.233094:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f7f6d69-9306-485c-8954-48c3fbe6cf31+10:2392:x1876509261449856:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 89us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579183.233102:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 174 00000100:00100000:1.0:1789579183.233416:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579183.233449:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579183.233501:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261450112 00000100:00100000:2.0:1789579183.233505:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261450112 00000100:00100000:2.0:1789579183.233547:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261449984 00000100:00100000:2.0:1789579183.233550:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261449984 00000100:00100000:2.0:1789579183.233573:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 102 00000100:00100000:2.0:1789579183.233579:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+5:2392:x1876509261450112:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789579183.233631:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+5:2392:x1876509261450112:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 52us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579183.233637:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 102 00000100:00100000:2.0:1789579183.233650:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 103 00000100:00100000:2.0:1789579183.233657:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+6:2392:x1876509261449984:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789579183.233680:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+6:2392:x1876509261449984:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 24us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579183.233695:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 103 00000100:00080000:1.0:1789579183.233993:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789579183.233998:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789579183.287452:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579183.287497:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579183.287614:0:20146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261450368 00000100:00100000:3.0:1789579183.287624:0:20146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261450368 00000100:00100000:3.0:1789579183.287682:0:20146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261450240 00000100:00100000:3.0:1789579183.287685:0:20146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261450240 00000100:00100000:3.0:1789579183.287724:0:20146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:3.0:1789579183.287734:0:20146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f7f6d69-9306-485c-8954-48c3fbe6cf31+11:2394:x1876509261450368:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789579183.287749:0:20146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789579183.287768:0:20146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303437e00/0xd90373d592f22347 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec358 expref: 11 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579183.288305:0:20146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789579183.288419:0:20146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f7f6d69-9306-485c-8954-48c3fbe6cf31+10:2394:x1876509261450368:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 685us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579183.288428:0:20146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:3.0:1789579183.288450:0:20146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 8 00000100:00100000:3.0:1789579183.288458:0:20146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f7f6d69-9306-485c-8954-48c3fbe6cf31+9:2394:x1876509261450240:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789579183.288466:0:20146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789579183.288476:0:20146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939302b2ee00/0xd90373d592f22340 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec327 expref: 9 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579183.288486:0:20146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789579183.288505:0:20146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f7f6d69-9306-485c-8954-48c3fbe6cf31+8:2394:x1876509261450240:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 48us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579183.288510:0:20146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 8 00000100:00100000:3.0:1789579183.288599:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579183.288672:0:20146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261450496 00000100:00100000:3.0:1789579183.288678:0:20146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261450496 00000100:00100000:3.0:1789579183.290331:0:20146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 9 00000100:00100000:3.0:1789579183.290589:0:20146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304812d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f7f6d69-9306-485c-8954-48c3fbe6cf31+8:2392:x1876509261450496:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789579183.290605:0:20146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789579183.290623:0:20146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939401519200/0xd90373d592f22386 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec397 expref: 8 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579183.290640:0:20146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789579183.290699:0:20146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304812d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f7f6d69-9306-485c-8954-48c3fbe6cf31+7:2392:x1876509261450496:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 113us (2099us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579183.290717:0:20146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 9 00000100:00100000:3.0:1789579183.303922:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579183.303994:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261450752 00000100:00100000:2.0:1789579183.304005:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261450752 00000100:00100000:2.0:1789579183.304171:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 78 00000100:00100000:2.0:1789579183.304180:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+6:2391:x1876509261450752:12345-192.168.203.37@tcp:39:umount.0 00000020:00000080:2.0:1789579183.304504:0:17120:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f2235c 00000020:00010000:2.0:1789579183.304513:0:17120:0:(genops.c:1920:obd_stale_export_put()) Put export ffff939403954800: total 0 00000100:00080000:2.0:1789579183.304518:0:17120:0:(import.c:65:import_set_state_nolock()) ffff939403952000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789579183.304545:0:17120:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00000100:00100000:2.0:1789579183.305138:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+5:2391:x1876509261450752:12345-192.168.203.37@tcp:39:umount.0 Request processed in 955us (1222us total) trans 8589934637 rc 0/0 00000100:00100000:2.0:1789579183.305147:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 78 00000020:00010000:1.0:1789579183.306884:0:19485:0:(genops.c:1906:obd_stale_export_get()) Get export ffff939403954800: total 0 00010000:00010000:1.0:1789579183.306892:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579183.306958:0:19485:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff939403954800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789579183.307002:0:19485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93940905bb00) 00010000:00010000:1.0:1789579183.307006:0:19485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789579183.307017:0:19485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401519400/0xd90373d592f2244a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3c1 expref: 4 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579183.307054:0:19485:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff939403954800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789579183.307071:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579183.307073:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579183.307075:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579183.325209:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579183.325586:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261450880 00000100:00100000:3.0:1789579183.325597:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261450880 00000100:00100000:3.0:1789579183.325656:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 79 00000100:00100000:3.0:1789579183.325666:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+5:2391:x1876509261450880:12345-192.168.203.37@tcp:39:umount.0 00000020:00000080:3.0:1789579183.325709:0:17119:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f22355 00000100:00080000:3.0:1789579183.325721:0:17119:0:(import.c:65:import_set_state_nolock()) ffff939436de8800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789579183.325748:0:17119:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00010000:00010000:1.0:1789579183.326059:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579183.326241:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+3:2391:x1876509261450880:12345-192.168.203.37@tcp:39:umount.0 Request processed in 574us (1038us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789579183.326250:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 79 00000100:00100000:2.0:1789579183.366287:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579183.366551:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261451136 00000100:00100000:1.0:1789579183.366561:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261451136 00000100:00100000:1.0:1789579183.366620:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 175 00000100:00100000:1.0:1789579183.366630:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f7f6d69-9306-485c-8954-48c3fbe6cf31+7:2391:x1876509261451136:12345-192.168.203.37@tcp:251:umount.0 00000020:00000080:1.0:1789579183.366673:0:17113:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f222f3 00000020:00010000:1.0:1789579183.366680:0:17113:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9393048c3000: total 0 00000100:00080000:1.0:1789579183.366685:0:17113:0:(import.c:65:import_set_state_nolock()) ffff9393048c1000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789579183.366757:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f7f6d69-9306-485c-8954-48c3fbe6cf31+3:2391:x1876509261451136:12345-192.168.203.37@tcp:251:umount.0 Request processed in 128us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579183.366765:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 175 00000020:00010000:3.0:1789579183.367821:0:17107:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9393048c3000: total 0 00010000:00010000:3.0:1789579183.367887:0:17107:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9393048c3000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789579183.367977:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939302b2e800/0xd90373d592f222fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec2b0 expref: 2 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579183.367995:0:17107:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9393048c3000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1789579183.368028:0:17107:0:(genops.c:885:class_export_put()) final put ffff9393048c3000/2f7f6d69-9306-485c-8954-48c3fbe6cf31 00010000:00010000:3.0:1789579183.368072:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579183.368075:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579183.368077:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789579183.373985:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9393048c3000/2f7f6d69-9306-485c-8954-48c3fbe6cf31 for MGS 00000020:00000080:1.0:1789579183.374057:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9393048c1000 for MGS 00000100:00100000:2.0:1789579183.972798:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277246464:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789579183.972862:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579183.972944:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277246464 00000100:00100000:2.0:1789579183.972952:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277246464 00000100:00100000:2.0:1789579183.973002:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789579183.973011:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277246464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789579183.973049:0:17123:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789579183.973109:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277246464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579183.973126:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789579183.973182:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277246464:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789579183.974921:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789579183.974943:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277246592:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789579183.974996:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579183.975040:0:18222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277246592 00000100:00100000:2.0:1789579183.975047:0:18222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277246592 00000100:00100000:2.0:1789579183.975083:0:18222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789579183.975091:0:18222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277246592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789579183.975121:0:18222:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1789579183.975179:0:18222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277246592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579183.975186:0:18222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789579183.975229:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277246592:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789579184.037189:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789579185.040607:0:20689:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789579185.057478:0:20689:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1789579185.057554:0:20689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939304367e00/0xd90373d592f21eb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21ebd expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579185.057574:0:20689:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939304367e00/0xd90373d592f21eb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f21ebd expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579185.057602:0:20689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939304367e00/0xd90373d592f21eb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f21ebd expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579185.057610:0:20689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff939304367e00/0xd90373d592f21eb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f21ebd expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579185.057637:0:20689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789579185.057643:0:20689:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789579185.057672:0:20689:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789579185.057678:0:20689:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789579185.057685:0:20689:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789579185.057710:0:20689:0:(import.c:65:import_set_state_nolock()) ffff939302082800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1789579185.057783:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579185.057791:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939304367e00/0xd90373d592f21eb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f21ebd expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579185.057798:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304367e00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1789579185.057802:0:17106:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939304367e00/0xd90373d592f21eb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f21ebd expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579185.057811:0:17106:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939304367e00/0xd90373d592f21eb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xd90373d592f21ebd expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789579185.057818:0:17106:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939304367e00/0xd90373d592f21eb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xd90373d592f21ebd expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789579185.057823:0:17106:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789579185.057826:0:17106:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789579185.057828:0:17106:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789579185.057856:0:17106:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939304367e00/0xd90373d592f21eb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f21ebd expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579185.057863:0:17106:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789579185.057893:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939304367e00/0xd90373d592f21eb6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f21ebd expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579185.057900:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939304367e00/0xd90373d592f21eb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f21ebd expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579185.057913:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579185.057915:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579185.057917:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579185.057933:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789579185.057971:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:044b3bf9-43fa-4501-b924-7b81ca047525:3618:1876509277246848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789579185.058045:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579185.058125:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277246848 00000100:00100000:1.0:1789579185.058132:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277246848 00000100:00100000:1.0:1789579185.058189:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789579185.058198:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441a80450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:044b3bf9-43fa-4501-b924-7b81ca047525+24:3618:x1876509277246848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789579185.058217:0:17104:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789579185.058231:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394363af200/0xd90373d592f21ebd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd90373d592f21eb6 expref: 24 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579185.058245:0:17104:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789579185.058280:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441a80450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:044b3bf9-43fa-4501-b924-7b81ca047525+23:3618:x1876509277246848:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579185.058287:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789579185.058347:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:044b3bf9-43fa-4501-b924-7b81ca047525:3618:1876509277246848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789579185.058700:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876509277246720:0@lo:39:umount.0 00000100:00100000:2.0:1789579185.058735:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579185.058930:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277246720 00000100:00100000:0.0:1789579185.058935:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277246720 00000100:00100000:0.0:1789579185.058996:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789579185.059004:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1876509277246720:12345-0@lo:39:umount.0 00000020:00000080:0.0:1789579185.059026:0:17118:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f21ee7 00000100:00080000:0.0:1789579185.059034:0:17118:0:(import.c:65:import_set_state_nolock()) ffff9394069db000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789579185.059103:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3614:x1876509277246720:12345-0@lo:39:umount.0 Request processed in 101us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579185.059110:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000020:00000080:0.0:1789579185.059117:0:17118:0:(genops.c:885:class_export_put()) final put ffff939402ad9800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1789579185.059302:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789579185.059312:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff939402ad9800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1789579185.059388:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9394069db000 for lustre-MDT0000 00010000:00010000:1.0:1789579185.060166:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789579185.060875:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939302082800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789579185.060894:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876509277246720:0@lo:39:umount.0 00000100:00080000:0.0:1789579185.061735:0:20689:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789579185.061741:0:20689:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789579185.061745:0:20689:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789579185.065426:0:20689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303437400/0xd90373d592f21e07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21e0e expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579185.065462:0:20689:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303437400/0xd90373d592f21e07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f21e0e expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579185.065469:0:20689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303437400/0xd90373d592f21e07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f21e0e expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579185.065476:0:20689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff939303437400/0xd90373d592f21e07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f21e0e expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579185.065493:0:20689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789579185.065498:0:20689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394421c7a00/0xd90373d592f2216b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22172 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579185.065504:0:20689:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394421c7a00/0xd90373d592f2216b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f22172 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579185.065510:0:20689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394421c7a00/0xd90373d592f2216b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f22172 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579185.065515:0:20689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff9394421c7a00/0xd90373d592f2216b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f22172 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579185.065526:0:20689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789579185.065531:0:20689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2fa00/0xd90373d592f223be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f223c5 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579185.065538:0:20689:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2fa00/0xd90373d592f223be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f223c5 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579185.065554:0:20689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2fa00/0xd90373d592f223be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f223c5 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579185.065560:0:20689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff939302b2fa00/0xd90373d592f223be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f223c5 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579185.065574:0:20689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789579185.065579:0:20689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303436000/0xd90373d592f21df9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21e00 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579185.065585:0:20689:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303436000/0xd90373d592f21df9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f21e00 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579185.065590:0:20689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303436000/0xd90373d592f21df9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f21e00 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579185.065596:0:20689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff939303436000/0xd90373d592f21df9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f21e00 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579185.065603:0:20689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1789579185.065606:0:20689:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1789579185.065639:0:20689:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1789579185.065644:0:20689:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1789579185.065647:0:20689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789579185.065652:0:20689:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:0.0:1789579185.065659:0:20689:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff939436dea000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789579185.065664:0:20689:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9394100ea800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789579185.065669:0:20689:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff939302b3f000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789579185.065678:0:20689:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff939304090000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789579185.065685:0:20689:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff939403954800 1c259fca-ec9a-4b20-b3ac-ca463a9ba85c 192.168.203.37@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:0.0:1789579185.065690:0:20689:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9393034f8800 fb59b6f8-2a36-456b-b988-f5328ecc7957 192.168.203.37@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934635 stale:0 00000020:00080000:0.0:1789579185.065695:0:20689:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff93942e1519c0) has exports, disconnecting them 00000020:00080000:0.0:1789579185.065700:0:20689:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff939436dea000), last request at 1789579181 00000020:00000080:0.0:1789579185.065706:0:20689:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f2211e 00000100:00080000:0.0:1789579185.065723:0:20689:0:(import.c:65:import_set_state_nolock()) ffff939436de9000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789579185.065769:0:20689:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff939436dea000): rc 0 00000020:00000080:0.0:1789579185.065772:0:20689:0:(genops.c:885:class_export_put()) final put ffff939436dea000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1789579185.065781:0:20689:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9394100ea800), last request at 1789579181 00000020:00000080:0.0:1789579185.065784:0:20689:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f22084 00000100:00080000:0.0:1789579185.065789:0:20689:0:(import.c:65:import_set_state_nolock()) ffff939403b62800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789579185.065796:0:20689:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9394100ea800): rc 0 00000020:00000080:0.0:1789579185.065797:0:20689:0:(genops.c:885:class_export_put()) final put ffff9394100ea800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1789579185.065800:0:20689:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff939302b3f000), last request at 1789579106 00000020:00000080:0.0:1789579185.065802:0:20689:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f21fd5 00000100:00080000:0.0:1789579185.065806:0:20689:0:(import.c:65:import_set_state_nolock()) ffff939302b3d000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789579185.065810:0:20689:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff939302b3f000): rc 0 00000020:00000080:0.0:1789579185.065812:0:20689:0:(genops.c:885:class_export_put()) final put ffff939302b3f000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1789579185.065815:0:20689:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff939304090000), last request at 1789579106 00000020:00000080:0.0:1789579185.065818:0:20689:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f21f7a 00000100:00080000:0.0:1789579185.065820:0:20689:0:(import.c:65:import_set_state_nolock()) ffff939303a21800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789579185.065827:0:20689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000020:00080000:0.0:1789579185.065889:0:20689:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff939304090000): rc 0 00000020:00000080:2.0:1789579185.065989:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff939436dea000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1789579185.066066:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff9394100ea800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1789579185.066089:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff939302b3f000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1789579185.066109:0:14907:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff939436de9000 for lustre-MDT0000 00000020:00000080:2.0:1789579185.066113:0:14907:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff939403b62800 for lustre-MDT0000 00000020:00000080:2.0:1789579185.066116:0:14907:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff939302b3d000 for lustre-MDT0000 00000004:00000080:0.0:1789579185.066849:0:20689:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbd978571bae0 00000100:00080000:0.0:1789579185.066870:0:20689:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789579185.066883:0:20689:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789579185.070499:0:20689:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789579185.070538:0:20689:0:(import.c:65:import_set_state_nolock()) ffff939407188000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789579185.070682:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277246976:0@lo:39:umount.0 00000100:00100000:2.0:1789579185.070793:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789579185.071200:0:20689:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789579185.071206:0:20689:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:0.0:1789579185.071219:0:20689:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789579185.071278:0:20689:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1789579185.071291:0:20689:0:(import.c:65:import_set_state_nolock()) ffff939407190000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1789579185.071617:0:17107:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789579185.071626:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939303437400/0xd90373d592f21e07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f21e0e expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579185.071636:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437400 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1789579185.071641:0:17107:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939303437400/0xd90373d592f21e07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f21e0e expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579185.071663:0:17107:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939303437400/0xd90373d592f21e07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xd90373d592f21e0e expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789579185.071670:0:17107:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939303437400/0xd90373d592f21e07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xd90373d592f21e0e expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789579185.071676:0:17107:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789579185.071679:0:17107:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1789579185.071682:0:17107:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1789579185.071711:0:17107:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939303437400/0xd90373d592f21e07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f21e0e expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579185.071717:0:17107:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789579185.071735:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939303437400/0xd90373d592f21e07 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f21e0e expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579185.071738:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277246976 00010000:00010000:1.0:1789579185.071742:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939303437400/0xd90373d592f21e07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f21e0e expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579185.071745:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277246976 00010000:00010000:1.0:1789579185.071753:0:17107:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789579185.071756:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff9394421c7a00/0xd90373d592f2216b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f22172 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579185.071761:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c7a00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1789579185.071764:0:17107:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff9394421c7a00/0xd90373d592f2216b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f22172 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579185.071770:0:17107:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff9394421c7a00/0xd90373d592f2216b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd90373d592f22172 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579185.071785:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 10000000:00010000:1.0:1789579185.071785:0:17107:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff9394421c7a00/0xd90373d592f2216b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd90373d592f22172 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789579185.071790:0:17107:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1789579185.071793:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1876509277246976:12345-0@lo:39:umount.0 10000000:01000000:1.0:1789579185.071793:0:17107:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1789579185.071794:0:17107:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1789579185.071807:0:17107:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff9394421c7a00/0xd90373d592f2216b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f22172 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579185.071812:0:17107:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:3.0:1789579185.071818:0:17124:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f21fff 00010000:00010000:1.0:1789579185.071825:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff9394421c7a00/0xd90373d592f2216b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f22172 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789579185.071826:0:17124:0:(import.c:65:import_set_state_nolock()) ffff93940eb0d800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789579185.071831:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff9394421c7a00/0xd90373d592f2216b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f22172 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579185.071839:0:17107:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789579185.071842:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939302b2fa00/0xd90373d592f223be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f223c5 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579185.071847:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939302b2fa00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1789579185.071850:0:17107:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939302b2fa00/0xd90373d592f223be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f223c5 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579185.071856:0:17107:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939302b2fa00/0xd90373d592f223be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xd90373d592f223c5 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789579185.071863:0:17107:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939302b2fa00/0xd90373d592f223be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xd90373d592f223c5 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1789579185.071866:0:17124:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 10000000:01000000:1.0:1789579185.071877:0:17107:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789579185.071879:0:17107:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789579185.071881:0:17107:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789579185.071894:0:17107:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939302b2fa00/0xd90373d592f223be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f223c5 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579185.071910:0:17107:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789579185.071917:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939302b2fa00/0xd90373d592f223be lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f223c5 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579185.071923:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939302b2fa00/0xd90373d592f223be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f223c5 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579185.071931:0:17107:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579185.071935:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939303436000/0xd90373d592f21df9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f21e00 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579185.071941:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436000 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1789579185.071943:0:17107:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939303436000/0xd90373d592f21df9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f21e00 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579185.071949:0:17107:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939303436000/0xd90373d592f21df9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd90373d592f21e00 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789579185.071954:0:17107:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939303436000/0xd90373d592f21df9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd90373d592f21e00 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789579185.071958:0:17107:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1789579185.071960:0:17107:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1789579185.071962:0:17107:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1789579185.071978:0:17107:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939303436000/0xd90373d592f21df9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f21e00 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579185.071985:0:17107:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789579185.071990:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939303436000/0xd90373d592f21df9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f21e00 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579185.072255:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939303436000/0xd90373d592f21df9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f21e00 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579185.072270:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579185.072272:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579185.072273:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579185.072288:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:044b3bf9-43fa-4501-b924-7b81ca047525:3617:1876509277247616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789579185.072325:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579185.072412:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789579185.072419:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:044b3bf9-43fa-4501-b924-7b81ca047525:3617:1876509277247232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789579185.072443:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579185.072470:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:044b3bf9-43fa-4501-b924-7b81ca047525:3616:1876509277247488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789579185.072491:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579185.072508:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789579185.072513:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:044b3bf9-43fa-4501-b924-7b81ca047525:3616:1876509277247360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789579185.072535:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579185.072572:0:20146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277247616 00000100:00100000:1.0:1789579185.072577:0:20146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277247616 00000100:00100000:1.0:1789579185.072603:0:20146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277247232 00000100:00100000:1.0:1789579185.072606:0:20146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277247232 00000100:00100000:1.0:1789579185.072619:0:20146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277247488 00000100:00100000:1.0:1789579185.072622:0:20146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277247488 00000100:00100000:1.0:1789579185.072632:0:20146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277247360 00000100:00100000:1.0:1789579185.072642:0:20146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277247360 00000100:00100000:1.0:1789579185.072661:0:20146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789579185.072668:0:20146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:044b3bf9-43fa-4501-b924-7b81ca047525+26:3617:x1876509277247616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789579185.072679:0:20146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789579185.072692:0:20146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394421c7e00/0xd90373d592f21e00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd90373d592f21df9 expref: 26 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579185.072703:0:20146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789579185.072733:0:20146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:044b3bf9-43fa-4501-b924-7b81ca047525+25:3617:x1876509277247616:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579185.072739:0:20146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789579185.072753:0:20146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789579185.072759:0:20146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:044b3bf9-43fa-4501-b924-7b81ca047525+24:3617:x1876509277247232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789579185.072766:0:20146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789579185.072774:0:20146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939304367600/0xd90373d592f21e0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd90373d592f21e07 expref: 24 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579185.072782:0:20146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789579185.072803:0:20146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:044b3bf9-43fa-4501-b924-7b81ca047525+23:3617:x1876509277247232:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579185.072809:0:20146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789579185.072821:0:20146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789579185.072827:0:20146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:044b3bf9-43fa-4501-b924-7b81ca047525+22:3616:x1876509277247488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789579185.072833:0:20146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789579185.072841:0:20146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939400031c00/0xd90373d592f223c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd90373d592f223be expref: 22 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579185.072849:0:20146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789579185.072882:0:20146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:044b3bf9-43fa-4501-b924-7b81ca047525+21:3616:x1876509277247488:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579185.072888:0:20146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789579185.073492:0:20146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789579185.073503:0:20146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304812d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:044b3bf9-43fa-4501-b924-7b81ca047525+20:3616:x1876509277247360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789579185.073512:0:20146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789579185.073521:0:20146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394421c7c00/0xd90373d592f22172 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd90373d592f2216b expref: 20 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579185.073531:0:20146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789579185.073572:0:20146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304812d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:044b3bf9-43fa-4501-b924-7b81ca047525+19:3616:x1876509277247360:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579185.073578:0:20146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789579185.073621:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:044b3bf9-43fa-4501-b924-7b81ca047525:3617:1876509277247232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789579185.073629:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:044b3bf9-43fa-4501-b924-7b81ca047525:3617:1876509277247616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789579185.073657:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:044b3bf9-43fa-4501-b924-7b81ca047525:3616:1876509277247360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789579185.073664:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:044b3bf9-43fa-4501-b924-7b81ca047525:3616:1876509277247488:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789579185.073678:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579185.073684:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579185.073814:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939403cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277247104:0@lo:9:umount.0 00000100:00100000:2.0:1789579185.073852:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579185.073931:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277247104 00000100:00100000:1.0:1789579185.073936:0:18624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277247104 00000100:00100000:1.0:1789579185.074022:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789579185.074029:0:18624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1876509277247104:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789579185.074049:0:18624:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f22141 00000100:00080000:1.0:1789579185.074541:0:18624:0:(import.c:65:import_set_state_nolock()) ffff9393023ba000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789579185.074597:0:18624:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1789579185.074743:0:18624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3614:x1876509277247104:12345-0@lo:9:umount.0 Request processed in 713us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579185.074750:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1789579185.074771:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789579185.074782:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789579185.075142:0:20689:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789579185.075147:0:20689:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:0.0:1789579185.075165:0:20689:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789579185.075223:0:20689:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789579185.075243:0:20689:0:(import.c:65:import_set_state_nolock()) ffff939402ad9000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1789579185.075291:0:20689:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff93942e1519c0) has no exports 00000100:00100000:3.0:1789579185.075554:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3614:x1876509277246976:12345-0@lo:39:umount.0 Request processed in 3759us (4759us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1789579185.075562:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1789579185.075633:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939407188000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789579185.075640:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277246976:0@lo:39:umount.0 00000100:00100000:2.0:1789579185.075654:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939403cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277247744:0@lo:9:umount.0 00000100:00100000:2.0:1789579185.075690:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789579185.075757:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939407190000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789579185.075771:0:3614:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789579185.075773:0:3614:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789579185.075776:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939403cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277247104:0@lo:9:umount.0 00000100:00100000:1.0:1789579185.077005:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277247744 00000100:00100000:1.0:1789579185.077137:0:18623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277247744 00000100:00100000:1.0:1789579185.077240:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789579185.077251:0:18623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1876509277247744:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789579185.077276:0:18623:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f22148 00000100:00080000:1.0:1789579185.077286:0:18623:0:(import.c:65:import_set_state_nolock()) ffff9393023bf800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789579185.077324:0:18623:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:1.0:1789579185.077492:0:18623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3614:x1876509277247744:12345-0@lo:9:umount.0 Request processed in 243us (1800us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579185.077499:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:1.0:1789579185.077518:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789579185.077611:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939402ad9000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789579185.077628:0:3614:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789579185.077631:0:3614:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789579185.077634:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939403cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277247744:0@lo:9:umount.0 00000100:00080000:0.0:1789579185.077782:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:0.0:1789579185.092643:0:20689:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff93942e1519c0) has no exports 00000020:00000080:0.0:1789579185.140542:0:20689:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f21e54 00000020:00000080:0.0:1789579185.140556:0:20689:0:(genops.c:885:class_export_put()) final put ffff93940718a000/lustre-QMT0000_UUID 00000020:01000000:0.0:1789579185.140573:0:20689:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1789579185.140677:0:20689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789579185.140687:0:20689:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789579185.140692:0:20689:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff939303573380) has no exports 00000020:00000080:1.0:1789579185.140995:0:20689:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f21e4d 00000020:00000080:1.0:1789579185.141001:0:20689:0:(genops.c:885:class_export_put()) final put ffff93940f42e000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789579185.141152:0:20689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789579185.141159:0:20689:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789579185.142226:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93940718a000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789579185.142236:0:8:0:(genops.c:885:class_export_put()) final put ffff93940f42a000/lustre-QMT0000_UUID 00000020:00000080:2.0:1789579185.142239:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93940f42a000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789579185.142248:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1789579185.142597:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93940f42e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1789579186.084105:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579186.532606:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277247872:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789579186.532700:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579186.532824:0:19911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277247872 00000100:00100000:0.0:1789579186.532832:0:19911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277247872 00000100:00100000:0.0:1789579186.532888:0:19911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789579186.532906:0:19911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277247872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789579186.532933:0:19911:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00080000:1.0:1789579186.532990:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789579186.536254:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277248128:0@lo:400:kworker.0 00000100:00100000:3.0:1789579186.536321:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579186.536380:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789579186.536386:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:044b3bf9-43fa-4501-b924-7b81ca047525:3616:1876509277248000:0@lo:400:kworker.0 00000100:00100000:3.0:1789579186.536412:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579186.536448:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277248000 00000100:00100000:3.0:1789579186.536455:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277248000 00000100:00100000:3.0:1789579186.536499:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789579186.536507:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+19:3616:x1876509277248000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579186.538526:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+19:3616:x1876509277248000:12345-0@lo:400:kworker.0 Request processed in 2000us (2094us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579186.538539:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789579186.538597:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277248256:0@lo:400:kworker.0 00000100:00100000:3.0:1789579186.538644:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579186.538688:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277248256 00000100:00100000:3.0:1789579186.538695:0:18622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277248256 00000100:00100000:3.0:1789579186.538743:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789579186.538751:0:18622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277248256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579186.538784:0:18622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277248256:12345-0@lo:400:kworker.0 Request processed in 34us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579186.538790:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789579186.538891:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277248256:0@lo:400:kworker.0 00000100:00100000:3.0:1789579186.538920:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:044b3bf9-43fa-4501-b924-7b81ca047525:3616:1876509277248000:0@lo:400:kworker.0 00000100:00100000:3.0:1789579186.538960:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277248128 00000100:00100000:3.0:1789579186.538965:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277248128 00000100:00100000:3.0:1789579186.538994:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789579186.538999:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3616:x1876509277248128:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789579186.539006:0:17123:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789579186.539038:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3616:x1876509277248128:12345-0@lo:400:kworker.0 Request processed in 37us (2716us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789579186.539044:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1789579186.539067:0:3616:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789579186.539072:0:3616:0:(import.c:65:import_set_state_nolock()) ffff939432173000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789579186.539076:0:3616:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1789579186.539971:0:19911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277247872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 7063us (7267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579186.539981:0:19911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1789579186.540039:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789579186.544788:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277248512:0@lo:400:kworker.0 00000100:00100000:0.0:1789579186.544873:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579186.544919:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789579186.544926:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277248640:0@lo:400:kworker.0 00000100:00100000:0.0:1789579186.544948:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579186.544977:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3617:1876509277248768:0@lo:400:kworker.0 00000100:00100000:0.0:1789579186.544998:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579186.545015:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789579186.545020:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277248384:0@lo:400:kworker.0 00000100:00100000:0.0:1789579186.545040:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579186.545063:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876509277248896:0@lo:400:kworker.0 00000100:00100000:0.0:1789579186.545082:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579186.545103:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277248512 00000100:00100000:0.0:1789579186.545109:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277248512 00000100:00100000:0.0:1789579186.545139:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277248640 00000100:00100000:0.0:1789579186.545142:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277248640 00000100:00100000:0.0:1789579186.545475:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277248768 00000100:00100000:0.0:1789579186.545479:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277248768 00000100:00100000:0.0:1789579186.545488:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277248384 00000100:00100000:0.0:1789579186.545490:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277248384 00000100:00100000:0.0:1789579186.545499:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277248896 00000100:00100000:0.0:1789579186.545501:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277248896 00000100:00100000:0.0:1789579186.545528:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789579186.545537:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277248640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579186.545589:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277248640:12345-0@lo:400:kworker.0 Request processed in 54us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579186.545597:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789579186.545614:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789579186.545620:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876509277248896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579186.545659:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876509277248896:12345-0@lo:400:kworker.0 Request processed in 40us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579186.545665:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789579186.545678:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789579186.545682:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3615:x1876509277248512:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789579186.545688:0:17118:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789579186.545710:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3615:x1876509277248512:12345-0@lo:400:kworker.0 Request processed in 26us (837us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789579186.545715:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789579186.545727:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789579186.545730:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1876509277248768:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789579186.545734:0:17118:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789579186.545751:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1876509277248768:12345-0@lo:400:kworker.0 Request processed in 19us (752us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789579186.545755:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789579186.545763:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789579186.545766:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1876509277248384:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789579186.545769:0:17118:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789579186.545783:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1876509277248384:12345-0@lo:400:kworker.0 Request processed in 16us (742us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789579186.545788:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:0.0:1789579186.545832:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9393043a9f80 x1876509277248640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579186.545846:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277248640:0@lo:400:kworker.0 00000100:00080000:0.0:1789579186.545856:0:3615:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789579186.545861:0:3615:0:(import.c:65:import_set_state_nolock()) ffff939436231800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789579186.545869:0:3615:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789579186.545874:0:3615:0:(import.c:65:import_set_state_nolock()) ffff939436231800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789579186.545878:0:3615:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 476 00000100:00080000:0.0:1789579186.545886:0:3615:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff939436231800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:0.0:1789579186.545907:0:3615:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93930350f480 x1876509277249024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789579186.545926:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277248512:0@lo:400:kworker.0 00000100:00080000:0.0:1789579186.545948:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789579186.545961:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789579186.545964:0:3617:0:(import.c:65:import_set_state_nolock()) ffff939403c90800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789579186.545968:0:3617:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789579186.545970:0:3617:0:(import.c:65:import_set_state_nolock()) ffff939403c90800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789579186.545973:0:3617:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 462 00000100:00080000:0.0:1789579186.545977:0:3617:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff939403c90800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:0.0:1789579186.545989:0:3617:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93930350f100 x1876509277249152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789579186.545998:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277248384:0@lo:400:kworker.0 00010000:00080000:0.0:1789579186.546007:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9393043a8700 x1876509277248896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579186.546014:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876509277248896:0@lo:400:kworker.0 00000100:00080000:0.0:1789579186.546021:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789579186.546023:0:3617:0:(import.c:65:import_set_state_nolock()) ffff939304086800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789579186.546031:0:3617:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789579186.546033:0:3617:0:(import.c:65:import_set_state_nolock()) ffff939304086800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789579186.546036:0:3617:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 494 00000100:00080000:0.0:1789579186.546040:0:3617:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff939304086800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:0.0:1789579186.546050:0:3617:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93930350d180 x1876509277249280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789579186.546059:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3617:1876509277248768:0@lo:400:kworker.0 00000100:00100000:0.0:1789579186.546091:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3614:1876509277249024:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1789579186.546127:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579186.546143:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876509277249152:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1789579186.547131:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277249024 00000100:00100000:1.0:1789579186.547140:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277249024 00000100:00100000:1.0:1789579186.547185:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789579186.547192:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3614:x1876509277249024:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1789579186.547208:0:18390:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789579186.547544:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579186.547564:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3614:1876509277249280:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1789579186.547579:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579186.547603:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277249152 00000100:00100000:0.0:1789579186.547607:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277249152 00000100:00100000:0.0:1789579186.547619:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277249280 00000100:00100000:0.0:1789579186.547621:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277249280 00000100:00100000:0.0:1789579186.547630:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789579186.547635:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3614:x1876509277249152:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1789579186.547643:0:17120:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789579186.547678:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3614:x1876509277249152:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 41us (133us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789579186.547683:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789579186.547696:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789579186.547699:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3614:x1876509277249280:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1789579186.547711:0:17120:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789579186.547733:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3614:x1876509277249280:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 32us (152us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789579186.547738:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1789579186.547767:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939403c90800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789579186.547771:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789579186.547774:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876509277249152:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:0.0:1789579186.547781:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939304086800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789579186.547784:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789579186.547786:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3614:1876509277249280:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1789579186.555087:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277247872:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1789579186.564056:0:3616:0:(import.c:65:import_set_state_nolock()) ffff939432173000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789579186.564065:0:3616:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 461 00000100:00080000:3.0:1789579186.564078:0:3616:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff939432173000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789579186.564120:0:3616:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939303a4a680 x1876509277249408/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789579186.566479:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277248128:0@lo:400:kworker.0 00000100:00100000:2.0:1789579186.566660:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277249408:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1789579186.566729:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579186.567052:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277249408 00000100:00100000:3.0:1789579186.567061:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277249408 00000100:00100000:3.0:1789579186.567105:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789579186.567112:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3614:x1876509277249408:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1789579186.567129:0:17124:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789579186.567186:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3614:x1876509277249408:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 73us (457us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789579186.567198:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1789579186.568666:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939432173000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789579186.568690:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789579186.568695:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277249408:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1789579186.581020:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3614:x1876509277249024:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 33819us (34883us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789579186.581034:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1789579186.584962:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939436231800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789579186.584974:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789579186.584979:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3614:1876509277249024:0@lo:38:ptlrpcd_00_00.0 00000001:00100000:0.0:1789579187.049026:0:17098:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789579187.049035:0:17098:0:(genops.c:885:class_export_put()) final put ffff939304090000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1789579187.049071:0:17098:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1c259fca-ec9a-4b20-b3ac-ca463a9ba85c 00000001:00080000:0.0:1789579187.049078:0:17098:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:0.0:1789579187.049081:0:17098:0:(genops.c:885:class_export_put()) final put ffff939403954800/1c259fca-ec9a-4b20-b3ac-ca463a9ba85c 00000001:00100000:0.0:1789579187.049087:0:17098:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fb59b6f8-2a36-456b-b988-f5328ecc7957 00000001:00080000:0.0:1789579187.049090:0:17098:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00000080:0.0:1789579187.049092:0:17098:0:(genops.c:885:class_export_put()) final put ffff9393034f8800/fb59b6f8-2a36-456b-b988-f5328ecc7957 00000020:00000080:2.0:1789579187.049192:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff939304090000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1789579187.049265:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff939403954800/1c259fca-ec9a-4b20-b3ac-ca463a9ba85c for lustre-MDT0000 00000020:00000080:2.0:1789579187.049293:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff9393034f8800/fb59b6f8-2a36-456b-b988-f5328ecc7957 for lustre-MDT0000 00000020:00000080:2.0:1789579187.049318:0:14907:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff939303a21800 for lustre-MDT0000 00000020:00000080:2.0:1789579187.049323:0:14907:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff939403952000 for lustre-MDT0000 00000020:00000080:2.0:1789579187.049326:0:14907:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9393034fd000 for lustre-MDT0000 00000001:00100000:1.0:1789579187.051909:0:17849:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789579187.051923:0:17849:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:1.0:1789579187.051928:0:17849:0:(genops.c:885:class_export_put()) final put ffff9394069de800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789579187.052038:0:19437:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789579187.052042:0:19437:0:(genops.c:885:class_export_put()) final put ffff9393023b8800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789579187.052063:0:17849:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1c259fca-ec9a-4b20-b3ac-ca463a9ba85c 00000001:00080000:1.0:1789579187.052068:0:17849:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:1.0:1789579187.052071:0:17849:0:(genops.c:885:class_export_put()) final put ffff939436dee800/1c259fca-ec9a-4b20-b3ac-ca463a9ba85c 00000020:00000080:3.0:1789579187.056019:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9394069de800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1789579187.056114:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93940eb0d800 for lustre-MDT0001 00000001:00100000:0.0:1789579187.058227:0:19437:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fb59b6f8-2a36-456b-b988-f5328ecc7957 00000020:00000080:0.0:1789579187.058236:0:19437:0:(genops.c:885:class_export_put()) final put ffff9393048c0800/fb59b6f8-2a36-456b-b988-f5328ecc7957 00000020:00000080:2.0:1789579187.062663:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff9393023b8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1789579187.062724:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff9393048c0800/fb59b6f8-2a36-456b-b988-f5328ecc7957 for lustre-OST0001 00000020:00000080:2.0:1789579187.062748:0:14907:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9393023bf800 for lustre-OST0001 00000020:00000080:2.0:1789579187.062754:0:14907:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9393048c2000 for lustre-OST0001 00000001:00100000:1.0:1789579187.065434:0:17849:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of fb59b6f8-2a36-456b-b988-f5328ecc7957 00000001:00080000:1.0:1789579187.065446:0:17849:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:1.0:1789579187.065451:0:17849:0:(genops.c:885:class_export_put()) final put ffff9393034fd800/fb59b6f8-2a36-456b-b988-f5328ecc7957 00000020:00000080:3.0:1789579187.071459:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff939436dee800/1c259fca-ec9a-4b20-b3ac-ca463a9ba85c for lustre-MDT0001 00000020:00000080:3.0:1789579187.071527:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff939436de8800 for lustre-MDT0001 00000020:00000080:2.0:1789579187.077154:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff9393034fd800/fb59b6f8-2a36-456b-b988-f5328ecc7957 for lustre-MDT0001 00000020:00000080:2.0:1789579187.077256:0:14907:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9393034fb000 for lustre-MDT0001 00010000:00010000:1.0:1789579187.109174:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789579187.171551:0:20689:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9394361083c0 - data ffff939429f03a20/ffff939435d68000 00000020:01000000:1.0:1789579187.171725:0:20689:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9393041adb40 - data ffff939429e48360/ffff93943bb5b000 00000001:00000004:1.0:1789579187.176859:0:20689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000100:00080000:2.0:1789579187.226929:0:20689:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789579187.226938:0:20689:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789579187.226951:0:20689:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff939303a31880 x1876509277246976/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789579195 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579187.226974:0:20689:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789579187.229161:0:20689:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789579187.229167:0:20689:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:2.0:1789579187.229301:0:20689:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789579187.229316:0:20689:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789579187.230468:0:17142:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789579187.230473:0:17142:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1789579187.230482:0:17142:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1789579187.231471:0:20689:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789579187.231477:0:20689:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:2.0:1789579187.231491:0:20689:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789579187.231493:0:20689:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789579187.231913:0:17144:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789579187.231917:0:17144:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:3.0:1789579187.231928:0:17144:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1789579187.233077:0:20689:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f21e1c 00000020:00000080:2.0:1789579187.233087:0:20689:0:(genops.c:885:class_export_put()) final put ffff93930206f800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789579187.233427:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93930206f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789579187.236637:0:20689:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f21e31 00000020:00000080:3.0:1789579187.236662:0:20689:0:(genops.c:885:class_export_put()) final put ffff939302068000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789579187.236679:0:20689:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1789579187.236685:0:20689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789579187.236693:0:20689:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789579187.236698:0:20689:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff93942e154d40) has no exports 00000004:01000000:3.0:1789579187.236876:0:20689:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789579187.236885:0:20689:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f21e93 00000020:00000080:3.0:1789579187.236890:0:20689:0:(genops.c:885:class_export_put()) final put ffff93942e140000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789579187.236894:0:20689:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789579187.236897:0:20689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789579187.236911:0:20689:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789579187.236913:0:20689:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9393035719c0) has no exports 00000020:00000080:3.0:1789579187.236919:0:20689:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f21e8c 00000020:00000080:3.0:1789579187.236923:0:20689:0:(genops.c:885:class_export_put()) final put ffff93942e143800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1789579187.237265:0:20689:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789579187.237270:0:20689:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789579187.237273:0:20689:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:3.0:1789579187.237279:0:20689:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789579187.237281:0:20689:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789579187.237322:0:20689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789579187.237329:0:20689:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789579187.237333:0:20689:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f21e7e 00000020:00000080:3.0:1789579187.237338:0:20689:0:(genops.c:885:class_export_put()) final put ffff93942e141800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789579187.237342:0:20689:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789579187.237345:0:20689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789579187.237573:0:20689:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789579187.237577:0:20689:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff93942edfb380) has no exports 00000020:00000080:3.0:1789579187.237581:0:20689:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f21e77 00000020:00000080:3.0:1789579187.237585:0:20689:0:(genops.c:885:class_export_put()) final put ffff939407194800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789579187.237790:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff939302068000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1789579187.237799:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93942e140000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789579187.237804:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93942e143800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789579187.237809:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff939402ad9000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789579187.237816:0:8:0:(genops.c:885:class_export_put()) final put ffff93942e144000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789579187.237819:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93942e144000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1789579187.237824:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789579187.238088:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93942e141800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1789579187.238096:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff939407194800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1789579187.238100:0:20689:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789579187.238104:0:20689:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789579187.238107:0:20689:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:3.0:1789579187.238112:0:20689:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789579187.238114:0:20689:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789579187.238153:0:20689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789579187.238159:0:20689:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1789579187.238170:0:20689:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1789579187.238174:0:20689:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f21e69 00000020:00000080:3.0:1789579187.238178:0:20689:0:(genops.c:885:class_export_put()) final put ffff939407192800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789579187.238182:0:20689:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1789579187.238186:0:20689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789579187.238189:0:20689:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789579187.238198:0:20689:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff93942edf8000) has no exports 00000020:00000080:3.0:1789579187.238202:0:20689:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f21e62 00000020:00000080:3.0:1789579187.238206:0:20689:0:(genops.c:885:class_export_put()) final put ffff93940718c800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789579187.239013:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff939407190000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1789579187.239022:0:8:0:(genops.c:885:class_export_put()) final put ffff939407197000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789579187.239024:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff939407197000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1789579187.239029:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789579187.239081:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff939407192800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1789579187.239086:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93940718c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1789579187.243456:0:20689:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1789579187.243465:0:20689:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789579187.243469:0:20689:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789579187.243478:0:20689:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789579187.243533:0:20689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789579187.243544:0:20689:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789579187.243573:0:20689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789579187.243588:0:20689:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789579187.243594:0:20689:0:(genops.c:885:class_export_put()) final put ffff93930206b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789579187.243599:0:20689:0:(genops.c:844:class_export_destroy()) destroying export ffff93930206b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1789579187.243607:0:20689:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789579187.243723:0:20689:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f21e38 00000020:00000080:2.0:1789579187.243730:0:20689:0:(genops.c:885:class_export_put()) final put ffff93930206e800/lustre-MDD0000_UUID 00000020:01000000:2.0:1789579187.243735:0:20689:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1789579187.243739:0:20689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789579187.243743:0:20689:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789579187.243747:0:20689:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff93942e150000) has no exports 00000020:00000080:2.0:1789579187.243780:0:20689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789579187.243784:0:20689:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1789579187.243788:0:20689:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f21e3f 00000020:00000080:2.0:1789579187.243792:0:20689:0:(genops.c:885:class_export_put()) final put ffff93930206a800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1789579187.243799:0:20689:0:(tgt_mount.c:187:server_put_mount()) put mount ffff939304130800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1789579187.243803:0:20689:0:(obd_mount.c:710:lustre_put_lsi()) put ffff939304130800 3 00000020:01000004:2.0:1789579187.243806:0:20689:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff939304130800 from lustre-MDT0000 00000020:00000080:2.0:1789579187.243823:0:20689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789579187.243826:0:20689:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1789579187.243828:0:20689:0:(genops.c:885:class_export_put()) final put ffff93930206c800/lustre-MDT0000_UUID 00000020:00000080:2.0:1789579187.243830:0:20689:0:(genops.c:844:class_export_destroy()) destroying export ffff93930206c800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1789579187.243837:0:20689:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1789579187.243867:0:20689:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1789579187.243871:0:20689:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1789579187.243874:0:20689:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1789579187.243877:0:20689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789579187.243879:0:20689:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789579187.243886:0:20689:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff93943f7a8800 044b3bf9-43fa-4501-b924-7b81ca047525 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789579187.243891:0:20689:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff93942e153380) has exports, disconnecting them 00000020:00080000:2.0:1789579187.243895:0:20689:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff93943f7a8800), last request at 1789579094 00000020:00000080:2.0:1789579187.243908:0:20689:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f21de4 00000020:00010000:2.0:1789579187.243911:0:20689:0:(genops.c:1920:obd_stale_export_put()) Put export ffff93943f7a8800: total 2 00000100:00080000:2.0:1789579187.243920:0:20689:0:(import.c:65:import_set_state_nolock()) ffff93943f7ab800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789579187.243941:0:20689:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93943f7a8800): rc 0 00000020:00080000:2.0:1789579187.243945:0:20689:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff93942e153380) has no exports 00000100:00100000:2.0:1789579187.244001:0:17111:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff939403930200:17111] 0 exiting: rc = 1 00000100:00100000:0.0:1789579187.244147:0:17112:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff939403930800:17112] 1 exiting: rc = 0 00000100:00100000:0.0:1789579187.244266:0:17113:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff939303b95e00:17113] 2 exiting: rc = 0 00000020:00000080:0.0:1789579187.244317:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff939407188000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1789579187.244323:0:8:0:(genops.c:885:class_export_put()) final put ffff93940718a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789579187.244325:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93940718a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1789579187.244329:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789579187.244408:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93930206e800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1789579187.244412:0:8:0:(genops.c:885:class_export_put()) final put ffff93930206c000/lustre-MDD0000_UUID 00000020:00000080:0.0:1789579187.244414:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93930206c000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1789579187.244418:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1789579187.244443:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93930206a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1789579187.244803:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.244814:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.244820:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.244826:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.244831:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.244838:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.244843:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.244849:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.244855:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.244862:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.244868:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.244874:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.244879:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.244885:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.244891:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.244897:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.244903:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.244908:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.244914:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.244919:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.244925:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.244930:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.244936:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.244942:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.244948:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.244954:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.244960:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.244965:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.244970:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.244976:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.244991:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.244995:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.245001:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.245006:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.245011:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.245017:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.245022:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.245028:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.245032:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.245037:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.245043:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.245048:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.245054:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.245059:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.245065:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.245071:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.245077:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.245082:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.245088:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.245094:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.245099:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.245105:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.245110:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.245116:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.245121:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.245127:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.245132:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.245139:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.245145:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.245151:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.245156:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.245161:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.245167:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579187.245172:0:20689:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1789579187.247129:0:20689:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9394421c6a00/0xd90373d592f21f03 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xd90373d592f21efc expref: 14 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579187.247166:0:20689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394421c6a00/0xd90373d592f21f03 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xd90373d592f21efc expref: 14 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579187.247186:0:20689:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9394363af000/0xd90373d592f21df2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xd90373d592f21deb expref: 13 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579187.247196:0:20689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394363af000/0xd90373d592f21df2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xd90373d592f21deb expref: 13 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579187.247205:0:20689:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff939303436e00/0xd90373d592f21f1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xd90373d592f21f18 expref: 12 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579187.247214:0:20689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303436e00/0xd90373d592f21f1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xd90373d592f21f18 expref: 12 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579187.247225:0:20689:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9394363ae200/0xd90373d592f21fc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xd90373d592f21fb9 expref: 11 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579187.247234:0:20689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394363ae200/0xd90373d592f21fc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xd90373d592f21fb9 expref: 11 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579187.247256:0:20689:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff939304366800/0xd90373d592f22045 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xd90373d592f2203e expref: 10 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579187.247265:0:20689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939304366800/0xd90373d592f22045 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xd90373d592f2203e expref: 10 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579187.247274:0:20689:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff939303437200/0xd90373d592f2206f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xd90373d592f22068 expref: 9 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579187.247295:0:20689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303437200/0xd90373d592f2206f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xd90373d592f22068 expref: 9 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579187.247314:0:20689:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff939304367200/0xd90373d592f220df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xd90373d592f220d8 expref: 8 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579187.247324:0:20689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939304367200/0xd90373d592f220df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xd90373d592f220d8 expref: 8 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579187.247333:0:20689:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9394363aec00/0xd90373d592f22109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xd90373d592f22102 expref: 7 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579187.247342:0:20689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394363aec00/0xd90373d592f22109 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xd90373d592f22102 expref: 7 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579187.247385:0:20689:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9394421c6800/0xd90373d592f2215d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xd90373d592f22156 expref: 6 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579187.247393:0:20689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394421c6800/0xd90373d592f2215d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xd90373d592f22156 expref: 6 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579187.247405:0:20689:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9394421c7400/0xd90373d592f21f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xd90373d592f21f0a expref: 5 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579187.247413:0:20689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394421c7400/0xd90373d592f21f11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xd90373d592f21f0a expref: 5 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579187.247423:0:20689:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff939302b2fc00/0xd90373d592f2239b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xd90373d592f22394 expref: 4 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579187.247443:0:20689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939302b2fc00/0xd90373d592f2239b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xd90373d592f22394 expref: 4 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579187.247452:0:20689:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff939302b2f600/0xd90373d592f223a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xd90373d592f223a2 expref: 3 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579187.247459:0:20689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939302b2f600/0xd90373d592f223a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xd90373d592f223a2 expref: 3 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579187.247466:0:20689:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff939303436200/0xd90373d592f223b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xd90373d592f223b0 expref: 2 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579187.247473:0:20689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303436200/0xd90373d592f223b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xd90373d592f223b0 expref: 2 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:1.0:1789579187.249962:0:19485:0:(genops.c:1906:obd_stale_export_get()) Get export ffff93943f7a8800: total 0 00010000:00010000:1.0:1789579187.250035:0:19485:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93943f7a8800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789579187.250052:0:19485:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93943f7a8800, canceled 0 locks, left on hash table 0. 00000020:00000080:1.0:1789579187.250062:0:19485:0:(genops.c:885:class_export_put()) final put ffff93943f7a8800/044b3bf9-43fa-4501-b924-7b81ca047525 00010000:00010000:1.0:1789579187.250087:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579187.250089:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579187.250091:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789579187.250259:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93943f7a8800/044b3bf9-43fa-4501-b924-7b81ca047525 for MGS 00000020:00000080:0.0:1789579187.250290:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93943f7ab800 for MGS 00000100:00100000:0.0:1789579187.557781:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277249536:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789579187.557865:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579187.558036:0:18626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277249536 00000100:00100000:1.0:1789579187.558045:0:18626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277249536 00000100:00100000:1.0:1789579187.558101:0:18626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789579187.558112:0:18626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277249536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789579187.558147:0:18626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789579187.558219:0:18626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277249536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579187.558226:0:18626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789579187.558327:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277249536:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789579188.131724:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579189.156507:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789579189.283680:0:20689:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff939302a82060 - data ffff939429cc9948/ffff939435d3c400 00000020:01000000:0.0:1789579189.283870:0:20689:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9394373fe180 - data ffff939429eb6e58/ffff93942da19c00 00000020:00000080:0.0:1789579189.284315:0:20689:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f21dc8 00000020:00000080:0.0:1789579189.284324:0:20689:0:(genops.c:885:class_export_put()) final put ffff93943f7ae800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789579189.284436:0:20689:0:(tgt_mount.c:187:server_put_mount()) put mount ffff939304130800 from MGS, refs=2 00000020:01000004:0.0:1789579189.284440:0:20689:0:(obd_mount.c:710:lustre_put_lsi()) put ffff939304130800 2 00000020:01000004:0.0:1789579189.284444:0:20689:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff939304130800 from MGS 00000020:00000080:0.0:1789579189.284467:0:20689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789579189.284474:0:20689:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1789579189.284476:0:20689:0:(genops.c:885:class_export_put()) final put ffff93943f7ae000/MGS 00000020:00000080:0.0:1789579189.284479:0:20689:0:(genops.c:844:class_export_destroy()) destroying export ffff93943f7ae000/MGS for MGS 00000020:01000000:0.0:1789579189.284486:0:20689:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1789579189.284551:0:20689:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1789579189.284555:0:20689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789579189.284571:0:20689:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789579189.284577:0:20689:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff939302083800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789579189.284583:0:20689:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff93943bba8000) has exports, disconnecting them 00000020:00080000:0.0:1789579189.284588:0:20689:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff939302083800), last request at 1789579095 00000020:00000080:0.0:1789579189.284592:0:20689:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f21ecb 00000020:00080000:0.0:1789579189.284602:0:20689:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff939302083800): rc 0 00000020:00000080:0.0:1789579189.284606:0:20689:0:(genops.c:885:class_export_put()) final put ffff939302083800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789579189.285413:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff93943f7ae800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789579189.285426:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff939302083800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1789579189.285451:0:20689:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1789579189.285456:0:20689:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789579189.285460:0:20689:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789579189.285465:0:20689:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789579189.285630:0:20689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789579189.285635:0:20689:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1789579189.285640:0:20689:0:(obd_mount.c:710:lustre_put_lsi()) put ffff939304130800 1 00000020:00000080:1.0:1789579189.285644:0:20689:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f21dba 00000020:00000080:1.0:1789579189.285650:0:20689:0:(genops.c:885:class_export_put()) final put ffff93943f7aa000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789579189.292433:0:14907:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff939302082800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789579189.292452:0:14907:0:(genops.c:885:class_export_put()) final put ffff93930206d000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1789579189.292456:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff93930206d000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1789579189.292471:0:14907:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:1.0:1789579189.292691:0:20689:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1789579189.292699:0:20689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789579189.292707:0:20689:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789579189.292712:0:20689:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff93943f5419c0) has no exports 00000020:00000080:3.0:1789579189.295037:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff93943f7aa000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789579189.349793:0:20689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789579189.349809:0:20689:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1789579189.349815:0:20689:0:(genops.c:885:class_export_put()) final put ffff939304131000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789579189.349821:0:20689:0:(genops.c:844:class_export_destroy()) destroying export ffff939304131000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1789579189.349833:0:20689:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1789579189.349969:0:20689:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff939304136000 00000020:02000400:2.0:1789579189.350028:0:20689:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00000040:00080000:0.0:1789579189.927401:0:17872:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789579190.180745:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789579190.638052:0:18619:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789579190.638063:0:18619:0:(genops.c:885:class_export_put()) final put ffff9393023b9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789579190.638246:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9393023b9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789579190.638295:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9393023ba000 for lustre-OST0000 00010000:00010000:1.0:1789579191.205856:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789579191.653715:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789579191.653721:0:14907:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789579191.653725:0:14907:0:(import.c:65:import_set_state_nolock()) ffff939432173000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789579191.653732:0:14907:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 541 00000100:00080000:2.0:1789579191.653751:0:14907:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789579191.653763:0:14907:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff939432173000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:2.0:1789579191.653787:0:14907:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939303b17800 x1876509277249920/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789579191.653815:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789579191.653818:0:14907:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789579191.653820:0:14907:0:(import.c:65:import_set_state_nolock()) ffff939403c90800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789579191.653822:0:14907:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 541 00000100:00080000:2.0:1789579191.653825:0:14907:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789579191.653828:0:14907:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff939403c90800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:2.0:1789579191.653837:0:14907:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939304886d80 x1876509277250304/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789579191.653846:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789579191.653848:0:14907:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789579191.653850:0:14907:0:(import.c:65:import_set_state_nolock()) ffff939436231800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789579191.653853:0:14907:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 541 00000100:00080000:2.0:1789579191.653855:0:14907:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789579191.653858:0:14907:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff939436231800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:2.0:1789579191.653866:0:14907:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939304886a00 x1876509277250432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789579191.653878:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789579191.653880:0:14907:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789579191.653881:0:14907:0:(import.c:65:import_set_state_nolock()) ffff939304086800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789579191.653884:0:14907:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 541 00000100:00080000:2.0:1789579191.653891:0:14907:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789579191.653896:0:14907:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff939304086800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:2.0:1789579191.653904:0:14907:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939304886680 x1876509277250688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789579191.653936:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277250048:0@lo:400:kworker.0 00000100:00100000:2.0:1789579191.653992:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579191.654049:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789579191.654054:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:044b3bf9-43fa-4501-b924-7b81ca047525:3618:1876509277249792:0@lo:400:kworker.0 00000400:00000100:2.0:1789579191.654073:0:3618:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876509277249792 offset 0 length 224: 4 00000100:00100000:2.0:1789579191.654089:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277250816:0@lo:400:kworker.0 00000100:00100000:2.0:1789579191.654110:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579191.654135:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277249920:0@lo:38:kworker.0 00000100:00100000:2.0:1789579191.654157:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579191.654171:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876509277250304:0@lo:38:kworker.0 00000100:00100000:2.0:1789579191.654190:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579191.654203:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3614:1876509277250432:0@lo:38:kworker.0 00000100:00100000:2.0:1789579191.654221:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579191.654235:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3614:1876509277250688:0@lo:38:kworker.0 00000100:00100000:2.0:1789579191.654252:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579191.654393:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277250176:0@lo:400:kworker.0 00000100:00100000:0.0:1789579191.654424:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579191.654454:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789579191.654460:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277249664:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789579191.654490:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579191.654506:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277250560:0@lo:400:kworker.0 00000100:00100000:0.0:1789579191.654523:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579191.654543:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277250816 00000100:00100000:0.0:1789579191.654550:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277250816 00000100:00100000:0.0:1789579191.654592:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277250304 00000100:00100000:0.0:1789579191.654596:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277250304 00000100:00100000:0.0:1789579191.654605:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277250432 00000100:00100000:0.0:1789579191.654607:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277250432 00000100:00100000:0.0:1789579191.654613:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277250688 00000100:00100000:0.0:1789579191.654616:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277250688 00000100:00100000:0.0:1789579191.654622:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277250560 00000100:00100000:0.0:1789579191.654624:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277250560 00000100:00100000:0.0:1789579191.654641:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789579191.654650:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876509277250816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579191.654701:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876509277250816:12345-0@lo:400:kworker.0 Request processed in 52us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579191.654715:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789579191.654742:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789579191.654748:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277250560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579191.654779:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277250560:12345-0@lo:400:kworker.0 Request processed in 31us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579191.654785:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789579191.654795:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789579191.654799:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3614:x1876509277250304:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789579191.654817:0:17120:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789579191.654834:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277250048 00000100:00100000:2.0:1789579191.654838:0:18623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277250048 00000100:00100000:2.0:1789579191.654866:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277250176 00000100:00100000:2.0:1789579191.654869:0:18623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277250176 00000100:00100000:2.0:1789579191.654889:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789579191.654896:0:18623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277250048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579191.654933:0:18623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277250048:12345-0@lo:400:kworker.0 Request processed in 38us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579191.654940:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789579191.654955:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789579191.654962:0:18623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277250176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579191.654990:0:18623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277250176:12345-0@lo:400:kworker.0 Request processed in 29us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579191.654996:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789579191.655235:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789579191.655241:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3614:x1876509277250432:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789579191.655251:0:18390:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789579191.655294:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3614:x1876509277250432:12345-0@lo:38:kworker.0 Request processed in 51us (1071us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789579191.655300:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789579191.655313:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789579191.655326:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3614:x1876509277250688:12345-0@lo:38:kworker.0 00000100:00080000:2.0:1789579191.655334:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939436231800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789579191.655339:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789579191.655342:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3614:1876509277250432:0@lo:38:kworker.0 00010000:00020000:1.0:1789579191.655342:0:18390:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789579191.655395:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3614:x1876509277250688:12345-0@lo:38:kworker.0 Request processed in 67us (1142us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789579191.655402:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1789579191.655409:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939304086800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789579191.655413:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789579191.655417:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3614:1876509277250688:0@lo:38:kworker.0 00000100:00100000:1.0:1789579191.655436:0:19911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277249664 00000100:00100000:1.0:1789579191.655440:0:19911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277249664 00000100:00100000:2.0:1789579191.655513:0:18627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789579191.655522:0:18627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277249664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789579191.655554:0:18627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789579191.655588:0:18627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277249664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579191.655594:0:18627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789579191.655611:0:18222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277249920 00000100:00100000:1.0:1789579191.655615:0:18222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277249920 00000100:00100000:1.0:1789579191.655761:0:18222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789579191.655767:0:18222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3614:x1876509277249920:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789579191.655777:0:18222:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789579191.655813:0:18222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3614:x1876509277249920:12345-0@lo:38:kworker.0 Request processed in 45us (1655us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789579191.655818:0:18222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1789579191.655842:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789579191.655845:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789579191.655847:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789579191.655866:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff939304884a80 x1876509277250816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579191.655878:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277250816:0@lo:400:kworker.0 00000100:00100000:1.0:1789579191.655888:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277250048:0@lo:400:kworker.0 00000100:00100000:1.0:1789579191.655923:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277249664:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1789579191.655934:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff939304887480 x1876509277250560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579191.655942:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277250560:0@lo:400:kworker.0 00000100:00100000:1.0:1789579191.655959:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277250176:0@lo:400:kworker.0 00000100:00080000:2.0:1789579191.656153:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939432173000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789579191.656158:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789579191.656161:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277249920:0@lo:38:kworker.0 00000100:00100000:0.0:1789579191.692903:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3614:x1876509277250304:12345-0@lo:38:kworker.0 Request processed in 38092us (38703us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789579191.692918:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1789579191.692977:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939403c90800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789579191.692995:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789579191.692999:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876509277250304:0@lo:38:kworker.0 00010000:00010000:1.0:1789579192.227668:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579192.675538:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789579192.675567:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277250944:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789579192.675636:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579192.675701:0:18626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277250944 00000100:00100000:2.0:1789579192.675711:0:18626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277250944 00000100:00100000:2.0:1789579192.675765:0:18626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789579192.675777:0:18626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277250944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789579192.675810:0:18626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789579192.675865:0:18626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277250944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579192.675873:0:18626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789579192.675933:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277250944:0@lo:13:osp-pre-0-1.0 00000020:01000004:2.0:1789579193.030725:0:20891:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789579193.041471:0:20891:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1789579193.041518:0:20891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303437800/0xd90373d592f21fb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21fc0 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579193.041532:0:20891:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303437800/0xd90373d592f21fb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f21fc0 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579193.041540:0:20891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303437800/0xd90373d592f21fb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f21fc0 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579193.041547:0:20891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff939303437800/0xd90373d592f21fb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f21fc0 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579193.041566:0:20891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789579193.041571:0:20891:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789579193.041593:0:20891:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789579193.041609:0:20891:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789579193.041614:0:20891:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789579193.041619:0:20891:0:(import.c:65:import_set_state_nolock()) ffff939403c90800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1789579193.041624:0:20891:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789579193.041626:0:20891:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789579193.041629:0:20891:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789579193.042544:0:20891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939304366200/0xd90373d592f21f18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21f1f expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579193.042556:0:20891:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939304366200/0xd90373d592f21f18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f21f1f expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579193.042562:0:20891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939304366200/0xd90373d592f21f18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f21f1f expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579193.042570:0:20891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff939304366200/0xd90373d592f21f18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f21f1f expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579193.042596:0:20891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789579193.042601:0:20891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394421c7000/0xd90373d592f22156 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f2215d expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579193.042608:0:20891:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394421c7000/0xd90373d592f22156 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f2215d expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579193.042614:0:20891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394421c7000/0xd90373d592f22156 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f2215d expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579193.042619:0:20891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff9394421c7000/0xd90373d592f22156 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f2215d expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579193.042651:0:20891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789579193.042658:0:20891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2e000/0xd90373d592f223b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f223b7 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579193.042665:0:20891:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2e000/0xd90373d592f223b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f223b7 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579193.042671:0:20891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2e000/0xd90373d592f223b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f223b7 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579193.042676:0:20891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff939302b2e000/0xd90373d592f223b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f223b7 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579193.042683:0:20891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1789579193.042688:0:20891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939304366600/0xd90373d592f21f0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21f11 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579193.042694:0:20891:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939304366600/0xd90373d592f21f0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f21f11 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579193.042700:0:20891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939304366600/0xd90373d592f21f0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f21f11 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579193.042706:0:20891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff939304366600/0xd90373d592f21f0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f21f11 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579193.042713:0:20891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:2.0:1789579193.042715:0:20891:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1789579193.042742:0:20891:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1789579193.042746:0:20891:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1789579193.042750:0:20891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789579193.042755:0:20891:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1789579193.042763:0:20891:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9393034f9800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789579193.042768:0:20891:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9393023b9800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789579193.042773:0:20891:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff93942edfcd40) has exports, disconnecting them 00000020:00080000:2.0:1789579193.042777:0:20891:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9393034f9800), last request at 1789579191 00000020:00000080:2.0:1789579193.042782:0:20891:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f22133 00000100:00080000:2.0:1789579193.042798:0:20891:0:(import.c:65:import_set_state_nolock()) ffff9393034fc000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789579193.042842:0:20891:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9393034f9800): rc 0 00000020:00000080:2.0:1789579193.042844:0:20891:0:(genops.c:885:class_export_put()) final put ffff9393034f9800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1789579193.042853:0:20891:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9393023b9800), last request at 1789579191 00000020:00000080:2.0:1789579193.042856:0:20891:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f22099 00000100:00080000:2.0:1789579193.042861:0:20891:0:(import.c:65:import_set_state_nolock()) ffff9393023bc000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789579193.042867:0:20891:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9393023b9800): rc 0 00000020:00000080:2.0:1789579193.042868:0:20891:0:(genops.c:885:class_export_put()) final put ffff9393023b9800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1789579193.042875:0:20891:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffbd97819b7ae0 00000100:00080000:2.0:1789579193.042891:0:20891:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789579193.042894:0:20891:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789579193.043781:0:20891:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789579193.043788:0:20891:0:(import.c:65:import_set_state_nolock()) ffff939432173000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1789579193.043920:0:20891:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789579193.043924:0:20891:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1789579193.043935:0:20891:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789579193.043998:0:20891:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789579193.044020:0:20891:0:(import.c:65:import_set_state_nolock()) ffff939302b3b800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789579193.044034:0:20891:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789579193.044046:0:20891:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1789579193.044056:0:20891:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789579193.044130:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277251072:0@lo:9:umount.0 00000100:00100000:2.0:1789579193.044190:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789579193.044235:0:20891:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789579193.044245:0:20891:0:(import.c:65:import_set_state_nolock()) ffff939436236000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789579193.044260:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277251200:0@lo:9:umount.0 00000100:00100000:2.0:1789579193.044282:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789579193.044467:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789579193.044476:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939303437800/0xd90373d592f21fb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f21fc0 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579193.044486:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437800 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1789579193.044490:0:17106:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939303437800/0xd90373d592f21fb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f21fc0 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579193.044501:0:17106:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939303437800/0xd90373d592f21fb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xd90373d592f21fc0 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789579193.044509:0:17106:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939303437800/0xd90373d592f21fb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xd90373d592f21fc0 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789579193.044516:0:17106:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789579193.044519:0:17106:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789579193.044522:0:17106:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789579193.044548:0:17106:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939303437800/0xd90373d592f21fb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f21fc0 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579193.044565:0:17106:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789579193.044583:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939303437800/0xd90373d592f21fb9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f21fc0 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579193.044591:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939303437800/0xd90373d592f21fb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f21fc0 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579193.044603:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789579193.044607:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939304366200/0xd90373d592f21f18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f21f1f expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579193.044613:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304366200 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1789579193.044615:0:17106:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939304366200/0xd90373d592f21f18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f21f1f expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579193.044622:0:17106:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939304366200/0xd90373d592f21f18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xd90373d592f21f1f expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789579193.044628:0:17106:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939304366200/0xd90373d592f21f18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xd90373d592f21f1f expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789579193.044632:0:17106:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789579193.044635:0:17106:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:3.0:1789579193.044637:0:17106:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:3.0:1789579193.044650:0:17106:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939304366200/0xd90373d592f21f18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f21f1f expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579193.044656:0:17106:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789579193.044662:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939304366200/0xd90373d592f21f18 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f21f1f expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579193.044678:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939304366200/0xd90373d592f21f18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f21f1f expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579193.044687:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789579193.044690:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff9394421c7000/0xd90373d592f22156 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f2215d expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579193.044696:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c7000 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1789579193.044698:0:17106:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff9394421c7000/0xd90373d592f22156 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f2215d expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579193.044705:0:17106:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff9394421c7000/0xd90373d592f22156 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd90373d592f2215d expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789579193.044712:0:17106:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff9394421c7000/0xd90373d592f22156 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd90373d592f2215d expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789579193.044717:0:17106:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1789579193.044719:0:17106:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1789579193.044721:0:17106:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789579193.044733:0:17106:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff9394421c7000/0xd90373d592f22156 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f2215d expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579193.044740:0:17106:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789579193.044755:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff9394421c7000/0xd90373d592f22156 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f2215d expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579193.044762:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff9394421c7000/0xd90373d592f22156 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f2215d expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579193.044787:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789579193.044791:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939302b2e000/0xd90373d592f223b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f223b7 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579193.044797:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939302b2e000 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1789579193.044799:0:17106:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939302b2e000/0xd90373d592f223b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f223b7 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579193.044806:0:17106:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939302b2e000/0xd90373d592f223b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd90373d592f223b7 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789579193.044812:0:17106:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939302b2e000/0xd90373d592f223b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd90373d592f223b7 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789579193.044823:0:17106:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789579193.044825:0:17106:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789579193.044828:0:17106:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789579193.044841:0:17106:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939302b2e000/0xd90373d592f223b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f223b7 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579193.044846:0:17106:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789579193.044852:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939302b2e000/0xd90373d592f223b0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f223b7 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579193.044858:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939302b2e000/0xd90373d592f223b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f223b7 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579193.044866:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789579193.044869:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939304366600/0xd90373d592f21f0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f21f11 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579193.044882:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304366600 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1789579193.044885:0:17106:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939304366600/0xd90373d592f21f0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f21f11 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579193.044892:0:17106:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939304366600/0xd90373d592f21f0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd90373d592f21f11 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789579193.044899:0:17106:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939304366600/0xd90373d592f21f0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd90373d592f21f11 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789579193.044904:0:17106:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789579193.044907:0:17106:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789579193.044908:0:17106:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1789579193.044920:0:17106:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939304366600/0xd90373d592f21f0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f21f11 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579193.044926:0:17106:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789579193.044931:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939304366600/0xd90373d592f21f0a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f21f11 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579193.044938:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939304366600/0xd90373d592f21f0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f21f11 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579193.044950:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579193.044951:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579193.044953:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579193.044969:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277251072 00000100:00100000:3.0:1789579193.044976:0:18624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277251072 00000100:00100000:3.0:1789579193.045019:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277251200 00000100:00100000:3.0:1789579193.045022:0:18624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277251200 00000100:00100000:3.0:1789579193.045052:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789579193.045060:0:18624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1876509277251072:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789579193.045082:0:18624:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f220c3 00000100:00080000:3.0:1789579193.045090:0:18624:0:(import.c:65:import_set_state_nolock()) ffff93930377c800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789579193.045124:0:18624:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1789579193.045279:0:18624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3614:x1876509277251072:12345-0@lo:9:umount.0 Request processed in 219us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579193.045287:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789579193.045315:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789579193.045323:0:18624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1876509277251200:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789579193.045335:0:18624:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f2214f 00000100:00080000:3.0:1789579193.045341:0:18624:0:(import.c:65:import_set_state_nolock()) ffff939303778800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789579193.045377:0:18624:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1789579193.045444:0:18624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3614:x1876509277251200:12345-0@lo:9:umount.0 Request processed in 121us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579193.045451:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789579193.045475:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:044b3bf9-43fa-4501-b924-7b81ca047525:3615:1876509277251328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789579193.045504:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579193.045531:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943738b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:044b3bf9-43fa-4501-b924-7b81ca047525:3615:1876509277251840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789579193.045547:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579193.045564:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789579193.045570:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943738aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:044b3bf9-43fa-4501-b924-7b81ca047525:3615:1876509277251456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789579193.045589:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579193.045614:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437388a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:044b3bf9-43fa-4501-b924-7b81ca047525:3617:1876509277251584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789579193.045634:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579193.045650:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789579193.045662:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943738a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:044b3bf9-43fa-4501-b924-7b81ca047525:3617:1876509277251712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789579193.045681:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789579193.045704:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789579193.045707:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789579193.045723:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277251328 00000100:00100000:3.0:1789579193.045727:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277251328 00000100:00100000:3.0:1789579193.045742:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277251840 00000100:00100000:3.0:1789579193.045744:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277251840 00000100:00100000:3.0:1789579193.045751:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277251456 00000100:00100000:3.0:1789579193.045753:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277251456 00000100:00100000:3.0:1789579193.045759:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277251584 00000100:00100000:3.0:1789579193.045762:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277251584 00000100:00100000:3.0:1789579193.045768:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277251712 00000100:00100000:3.0:1789579193.045770:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277251712 00000100:00100000:3.0:1789579193.045779:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789579193.045784:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3615:x1876509277251328:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789579193.045790:0:17105:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789579193 with bad export cookie 15637469692291063268 00010000:00010000:0.0:1789579193.046248:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789579193.046261:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff9393034f9800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1789579193.046315:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff9393023b9800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1789579193.046337:0:14907:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9393034fc000 for lustre-MDT0001 00000020:00000080:0.0:1789579193.046342:0:14907:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9393023bc000 for lustre-MDT0001 00010000:00010000:1.0:1789579193.047261:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789579193.051015:0:20891:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff93942edfcd40) has no exports 00000100:00080000:2.0:1789579193.051121:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939436236000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789579193.051134:0:3614:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789579193.051136:0:3614:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789579193.051142:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277251200:0@lo:9:umount.0 00000100:00080000:2.0:1789579193.051277:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939302b3b800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789579193.051287:0:3614:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789579193.051289:0:3614:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789579193.051291:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277251072:0@lo:9:umount.0 00010000:00010000:2.0:1789579193.051560:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579193.051593:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789579193.051601:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3615:x1876509277251840:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789579193.051678:0:17103:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789579193 with bad export cookie 15637469692291063268 00000100:00100000:2.0:1789579193.051764:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3615:x1876509277251840:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (6215us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789579193.051772:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789579193.051794:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789579193.051959:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441a81c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3615:x1876509277251456:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789579193.051965:0:17103:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789579193 with bad export cookie 15637469692291063268 00000100:00100000:2.0:1789579193.052010:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441a81c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3615:x1876509277251456:12345-0@lo:103:ldlm_bl.0 Request processed in 211us (6420us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789579193.052017:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789579193.052032:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789579193.052036:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3617:x1876509277251584:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789579193.052040:0:17103:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789579193 with bad export cookie 15637469692291063268 00000100:00100000:2.0:1789579193.052077:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3617:x1876509277251584:12345-0@lo:103:ldlm_bl.0 Request processed in 40us (6442us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789579193.052083:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789579193.052096:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789579193.052100:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3617:x1876509277251712:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789579193.052105:0:17103:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789579193 with bad export cookie 15637469692291063268 00000100:00100000:2.0:1789579193.052130:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3617:x1876509277251712:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (6448us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789579193.052136:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1789579193.052559:0:3615:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.137@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789579193.052564:0:3615:0:(import.c:65:import_set_state_nolock()) ffff939436336800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1789579193.052568:0:3615:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.137@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1789579193.076823:0:3615:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.137@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1789579193.076828:0:3615:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789579193.076840:0:3615:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff939303b14000 x1876509277249792/t0(0) o400->MGC192.168.203.137@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789579207 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579193.076926:0:3615:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff939303a4a680 x1876509277251328/t0(0) o103->MGC192.168.203.137@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789579209 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579193.076936:0:3615:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93943738b800 x1876509277251840/t0(0) o103->MGC192.168.203.137@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789579209 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579193.076969:0:3615:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93943738aa00 x1876509277251456/t0(0) o103->MGC192.168.203.137@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789579209 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579193.076976:0:3615:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff939437388a80 x1876509277251584/t0(0) o103->MGC192.168.203.137@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789579209 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579193.076984:0:3615:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93943738a300 x1876509277251712/t0(0) o103->MGC192.168.203.137@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789579209 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789579193.076992:0:3615:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789579193.076995:0:3615:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789579193.076996:0:3615:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789579193.076999:0:3615:0:(import.c:65:import_set_state_nolock()) ffff939436336800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789579193.077003:0:3615:0:(import.c:545:import_select_connection()) MGC192.168.203.137@tcp: connect to NID 0@lo last attempt 450 00000100:00080000:2.0:1789579193.077017:0:3615:0:(import.c:666:import_select_connection()) MGC192.168.203.137@tcp: import ffff939436336800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:2.0:1789579193.077047:0:3615:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939304886d80 x1876509277251968/t0(0) o250->MGC192.168.203.137@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789579193.077078:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:044b3bf9-43fa-4501-b924-7b81ca047525:3614:1876509277251968:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:2.0:1789579193.077124:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876509277251968 offset 0 length 520: 4 00000100:00100000:2.0:1789579193.077338:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:044b3bf9-43fa-4501-b924-7b81ca047525:3615:1876509277251328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789579193.077346:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943738b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:044b3bf9-43fa-4501-b924-7b81ca047525:3615:1876509277251840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789579193.077384:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943738aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:044b3bf9-43fa-4501-b924-7b81ca047525:3615:1876509277251456:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789579193.077649:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943738a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:044b3bf9-43fa-4501-b924-7b81ca047525:3617:1876509277251712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789579193.077657:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437388a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:044b3bf9-43fa-4501-b924-7b81ca047525:3617:1876509277251584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789579193.077721:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:044b3bf9-43fa-4501-b924-7b81ca047525:3618:1876509277249792:0@lo:400:kworker.0 00000400:00000100:2.0:1789579193.084853:0:17105:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1876509277251328 offset 224 length 224: 4 00000100:00100000:2.0:1789579193.084882:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3615:x1876509277251328:12345-0@lo:103:ldlm_bl.0 Request processed in 39095us (39375us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789579193.084907:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000020:00080000:1.0:1789579193.089953:0:20891:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff93942edfcd40) has no exports 00000020:01000000:0.0:1789579193.141736:0:20891:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9394361082a0 - data ffff939420caa510/ffff939435d6ac00 00000020:01000000:0.0:1789579193.141892:0:20891:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff939429174960 - data ffff939429e71360/ffff939436c8bc00 00000001:00000004:2.0:1789579193.163520:0:20891:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1789579193.193210:0:20891:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789579193.193220:0:20891:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789579193.193228:0:20891:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1789579193.195277:0:20891:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789579193.195284:0:20891:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1789579193.195341:0:20891:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789579193.195345:0:20891:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789579193.199293:0:17858:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789579193.199299:0:17858:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:1.0:1789579193.199337:0:17858:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1789579193.208276:0:20891:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789579193.208285:0:20891:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1789579193.208315:0:20891:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789579193.208318:0:20891:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789579193.211590:0:17860:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789579193.211612:0:17860:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1789579193.211626:0:17860:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1789579193.217893:0:20891:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f21f2d 00000020:00000080:3.0:1789579193.217907:0:20891:0:(genops.c:885:class_export_put()) final put ffff93940718e800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789579193.218631:0:20891:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f21f42 00000020:00000080:3.0:1789579193.218658:0:20891:0:(genops.c:885:class_export_put()) final put ffff939432173800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789579193.219081:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93940718e800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1789579193.219147:0:20891:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1789579193.219154:0:20891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789579193.219163:0:20891:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789579193.219167:0:20891:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff93942edf99c0) has no exports 00000004:01000000:3.0:1789579193.219479:0:20891:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789579193.219489:0:20891:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f21f96 00000020:00000080:3.0:1789579193.219494:0:20891:0:(genops.c:885:class_export_put()) final put ffff939303a24000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789579193.219528:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff939432173800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1789579193.219583:0:20891:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1789579193.219588:0:20891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789579193.219593:0:20891:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789579193.219596:0:20891:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff93943bbab380) has no exports 00000020:00000080:3.0:1789579193.219602:0:20891:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f21f8f 00000020:00000080:3.0:1789579193.219606:0:20891:0:(genops.c:885:class_export_put()) final put ffff939407190800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789579193.219628:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff939303a24000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789579193.220015:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff939407190800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1789579193.220533:0:20891:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1789579193.220538:0:20891:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789579193.220542:0:20891:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1789579193.220548:0:20891:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789579193.220550:0:20891:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789579193.220658:0:20891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789579193.220667:0:20891:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789579193.220680:0:20891:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f21f81 00000020:00000080:3.0:1789579193.220686:0:20891:0:(genops.c:885:class_export_put()) final put ffff939303a25800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789579193.220769:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff939436236000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789579193.220777:0:36:0:(genops.c:885:class_export_put()) final put ffff939303a26800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789579193.220779:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff939303a26800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1789579193.220786:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1789579193.221001:0:20891:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1789579193.221006:0:20891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789579193.221012:0:20891:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789579193.221016:0:20891:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff93943f543380) has no exports 00000020:00000080:3.0:1789579193.221021:0:20891:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f21f73 00000020:00000080:3.0:1789579193.221025:0:20891:0:(genops.c:885:class_export_put()) final put ffff939302b39800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789579193.221048:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff939303a25800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:3.0:1789579193.221511:0:20891:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1789579193.221515:0:20891:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789579193.221519:0:20891:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1789579193.221532:0:20891:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789579193.221534:0:20891:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789579193.221899:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff939302b39800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1789579193.221991:0:20891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789579193.221998:0:20891:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1789579193.222014:0:20891:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1789579193.222020:0:20891:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f21f65 00000020:00000080:3.0:1789579193.222026:0:20891:0:(genops.c:885:class_export_put()) final put ffff939302b3e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789579193.222049:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff939302b3b800 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789579193.222054:0:36:0:(genops.c:885:class_export_put()) final put ffff939302b39000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789579193.222056:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff939302b39000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1789579193.222060:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1789579193.228740:0:20891:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1789579193.228756:0:20891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789579193.228778:0:20891:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789579193.228783:0:20891:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff93943bb399c0) has no exports 00000020:00000080:3.0:1789579193.228793:0:20891:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f21f5e 00000020:00000080:3.0:1789579193.228801:0:20891:0:(genops.c:885:class_export_put()) final put ffff939432170000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789579193.230289:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff939302b3e000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789579193.230320:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff939432170000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789579193.251443:0:20891:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1789579193.251452:0:20891:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789579193.251457:0:20891:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789579193.251464:0:20891:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789579193.251535:0:20891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789579193.251547:0:20891:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789579193.251575:0:20891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789579193.251578:0:20891:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789579193.251584:0:20891:0:(genops.c:885:class_export_put()) final put ffff93942e158800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789579193.251588:0:20891:0:(genops.c:844:class_export_destroy()) destroying export ffff93942e158800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1789579193.251609:0:20891:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789579193.251750:0:20891:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f21f49 00000020:00000080:0.0:1789579193.251757:0:20891:0:(genops.c:885:class_export_put()) final put ffff939432175800/lustre-MDD0001_UUID 00000020:01000000:0.0:1789579193.251762:0:20891:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1789579193.251766:0:20891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789579193.251771:0:20891:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789579193.251774:0:20891:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff93943bb3b380) has no exports 00000020:00000080:0.0:1789579193.251791:0:20891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789579193.251795:0:20891:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1789579193.251800:0:20891:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f21f50 00000020:00000080:0.0:1789579193.251803:0:20891:0:(genops.c:885:class_export_put()) final put ffff939432176000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1789579193.251810:0:20891:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93943f640800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1789579193.251813:0:20891:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93943f640800 2 00000020:01000004:0.0:1789579193.251815:0:20891:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93943f640800 from lustre-MDT0001 00000020:00000080:1.0:1789579193.251918:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff939432173000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789579193.251926:0:36:0:(genops.c:885:class_export_put()) final put ffff939432170800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789579193.251929:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff939432170800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1789579193.251936:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789579193.252024:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff939432175800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1789579193.252028:0:36:0:(genops.c:885:class_export_put()) final put ffff939432171000/lustre-MDD0001_UUID 00000020:00000080:1.0:1789579193.252030:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff939432171000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1789579193.252033:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1789579193.252136:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff939432176000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789579193.252164:0:20891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789579193.252170:0:20891:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1789579193.252173:0:20891:0:(genops.c:885:class_export_put()) final put ffff93940718d000/lustre-MDT0001_UUID 00000020:00000080:0.0:1789579193.252175:0:20891:0:(genops.c:844:class_export_destroy()) destroying export ffff93940718d000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1789579193.252182:0:20891:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1789579193.252210:0:20891:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1789579193.252213:0:20891:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1789579193.252217:0:20891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789579193.252220:0:20891:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789579193.252227:0:20891:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff939406798000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789579193.252232:0:20891:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff939303574d40) has exports, disconnecting them 00000020:00080000:0.0:1789579193.252236:0:20891:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff939406798000), last request at 1789579106 00000020:00000080:0.0:1789579193.252240:0:20891:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f21fce 00000020:00080000:0.0:1789579193.252252:0:20891:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff939406798000): rc 0 00000020:00000080:0.0:1789579193.252255:0:20891:0:(genops.c:885:class_export_put()) final put ffff939406798000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789579193.252762:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff939406798000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:00010000:1.0:1789579193.315202:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:01000000:1.0:1789579193.315471:0:20891:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1789579193.315477:0:20891:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789579193.315481:0:20891:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789579193.315487:0:20891:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789579193.315661:0:20891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789579193.315671:0:20891:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1789579193.315678:0:20891:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93943f640800 1 00000020:00000080:1.0:1789579193.315684:0:20891:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f21ef5 00000020:00000080:1.0:1789579193.315691:0:20891:0:(genops.c:885:class_export_put()) final put ffff9394069d9000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1789579193.315696:0:20891:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1789579193.315711:0:20891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789579193.315715:0:20891:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789579193.315723:0:20891:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff939303570000) has no exports 00000020:00000080:3.0:1789579193.316046:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff939403c90800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1789579193.316059:0:36:0:(genops.c:885:class_export_put()) final put ffff939403953000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1789579193.316062:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff939403953000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1789579193.316070:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1789579193.316514:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9394069d9000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1789579193.346113:0:20891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789579193.346128:0:20891:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1789579193.346134:0:20891:0:(genops.c:885:class_export_put()) final put ffff93943f645800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789579193.346138:0:20891:0:(genops.c:844:class_export_destroy()) destroying export ffff93943f645800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1789579193.346144:0:20891:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1789579193.346274:0:20891:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93943f646000 00000020:01000000:3.0:1789579193.346294:0:20891:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1789579193.346298:0:20891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789579193.346313:0:20891:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789579193.346318:0:20891:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff93943f540000) has no exports 00000100:00100000:0.0:1789579193.346478:0:17119:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff9394362fce00:17119] 1 exiting: rc = 0 00000100:00100000:1.0:1789579193.346564:0:18390:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff93942eb02600:18390] 3 exiting: rc = 0 00000100:00100000:0.0:1789579193.346595:0:17120:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff9394362fd800:17120] 2 exiting: rc = 0 00000100:00100000:1.0:1789579193.346668:0:17118:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff9394362fc400:17118] 0 exiting: rc = 1 00000100:00100000:3.0:1789579193.346764:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.346772:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.346778:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.346784:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.346797:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.346803:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.346808:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.346814:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.346819:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.346824:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.346829:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.346835:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.346840:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.346846:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.346851:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.346857:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.346864:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.346868:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.346874:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.346879:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.346884:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.346890:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.346894:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.346900:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.346906:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.346911:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.346917:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.346922:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.346929:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.346944:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.346957:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.346963:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.346968:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.346975:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.346982:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.346989:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.346996:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.347003:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.347011:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.347028:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.347037:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.347045:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.347052:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.347059:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.347066:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.347074:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.347081:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.347087:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.347094:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.347127:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.347134:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.347139:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.347146:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.347153:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.347158:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.347163:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.347168:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.347179:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.347475:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.347481:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.347485:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.347492:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.347499:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.347503:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579193.352249:0:17122:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9393039fb400:17122] 1 exiting: rc = 0 00000100:00100000:0.0:1789579193.353509:0:17121:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff93942f10d800:17121] 0 exiting: rc = 1 00000100:00100000:3.0:1789579193.353703:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.353809:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.353823:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.353832:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.353840:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.353847:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.353854:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.353861:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.353868:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.353876:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.353896:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.353901:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.353906:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.353911:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.353916:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.353921:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.353926:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.353931:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354100:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354109:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354116:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354124:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354131:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354140:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354147:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354155:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354163:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354169:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354176:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354183:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354190:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354198:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354205:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354214:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354220:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354227:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354234:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354241:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354248:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354255:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354260:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354265:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354270:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354275:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354279:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354292:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354297:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354312:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354318:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354322:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354327:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354331:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354336:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354341:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354534:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354542:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354550:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354557:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354564:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354571:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354578:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354584:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354591:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.354597:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579193.355820:0:18222:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff93943bb13e00:18222] 2 exiting: rc = 0 00000100:00100000:0.0:1789579193.356021:0:17124:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff9393039fba00:17124] 1 exiting: rc = 0 00000100:00100000:2.0:1789579193.356033:0:17123:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff9393039faa00:17123] 0 exiting: rc = 1 00000100:00100000:3.0:1789579193.356087:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356097:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356105:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356112:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356130:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356137:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356142:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356148:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356153:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356159:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356165:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356176:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356183:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356189:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356195:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356200:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356243:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356253:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356260:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356267:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356272:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356277:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356283:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356288:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356293:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356298:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356314:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356319:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356338:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356373:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356386:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356394:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356408:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356418:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356429:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356492:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356507:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356520:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356530:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356544:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356600:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356614:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356629:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356644:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356663:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356675:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356695:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356705:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356716:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356723:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356735:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356751:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356908:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356914:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356919:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356923:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356927:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356930:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.356943:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.357587:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.357600:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.357608:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.357614:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.357619:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.371333:0:17125:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9393039fae00:17125] 0 exiting: rc = 1 00000100:00100000:1.0:1789579193.371513:0:17126:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9393039fb800:17126] 1 exiting: rc = 0 00000100:00100000:0.0:1789579193.371980:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.371987:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.371993:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.371998:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372004:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372008:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372014:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372019:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372023:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372028:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372033:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372037:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372041:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372046:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372052:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372057:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372062:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372067:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372072:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372078:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372082:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372087:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372092:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372098:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372103:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372108:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372113:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372118:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372123:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372128:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372133:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372139:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372143:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372161:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372166:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372172:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372177:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372182:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372187:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372192:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372197:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372202:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372208:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372212:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372217:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372222:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372228:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372233:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372238:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372244:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372248:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372253:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372257:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372262:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372577:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372583:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372588:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372594:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372599:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372605:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372610:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372615:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372621:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.372626:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.373633:0:17127:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9393039fb000:17127] 0 exiting: rc = 1 00000100:00100000:1.0:1789579193.373776:0:17128:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9393039fa000:17128] 1 exiting: rc = 0 00000100:00100000:3.0:1789579193.373916:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.373923:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.373928:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.373933:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.373939:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.373944:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.373949:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.373954:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.373960:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.373965:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.373970:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.373975:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.373980:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.373985:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.373991:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.373996:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374001:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374006:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374011:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374016:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374033:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374038:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374044:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374049:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374054:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374059:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374065:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374070:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374075:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374081:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374086:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374092:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374097:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374101:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374106:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374111:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374115:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374120:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374125:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374130:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374135:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374140:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374145:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374150:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374155:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374160:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374166:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374171:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374175:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374181:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374186:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374191:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374196:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374201:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374206:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374219:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374224:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374230:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374235:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374241:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374246:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374251:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374269:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579193.374283:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.374820:0:17130:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff9393039fa600:17130] 1 exiting: rc = 0 00000100:00100000:1.0:1789579193.375246:0:17129:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff9393039fac00:17129] 0 exiting: rc = 1 00000100:00100000:0.0:1789579193.375426:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375433:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375439:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375455:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375461:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375465:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375470:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375475:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375480:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375485:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375491:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375496:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375501:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375506:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375511:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375517:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375522:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375527:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375531:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375536:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375541:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375546:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375551:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375556:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375560:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375565:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375570:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375574:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375579:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375585:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375590:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375595:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375599:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375605:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375611:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375616:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375622:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375627:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375641:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375646:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375650:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375656:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375660:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375666:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375671:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375676:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375681:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375686:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375691:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375696:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375701:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375707:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375712:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375717:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375723:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375728:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375733:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375738:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375744:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375748:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375754:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375760:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375765:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.375770:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.376223:0:17133:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff939302390800:17133] 2 exiting: rc = 0 00000100:00100000:3.0:1789579193.376742:0:17131:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff93942f10c800:17131] 0 exiting: rc = 1 00000100:00100000:3.0:1789579193.376993:0:17132:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff93942f10c400:17132] 1 exiting: rc = 0 00000100:00100000:0.0:1789579193.377159:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377180:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377187:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377193:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377199:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377205:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377211:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377217:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377235:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377241:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377247:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377253:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377270:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377285:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377290:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377296:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377310:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377316:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377549:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377558:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377563:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377568:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377573:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377578:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377584:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377604:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377611:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377616:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377622:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377627:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377632:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377638:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377643:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377649:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377655:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377660:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377665:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377672:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377678:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377683:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377689:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377695:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377701:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377715:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377721:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377727:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377732:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377738:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377743:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377762:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377769:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377775:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377780:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377786:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377791:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377796:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377802:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377810:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377815:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377821:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377827:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377833:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377838:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579193.377844:0:20891:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789579193.393014:0:20891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789579193.393027:0:20891:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1789579193.393033:0:20891:0:(genops.c:885:class_export_put()) final put ffff939436334000/MDS_uuid 00000020:00000080:0.0:1789579193.393037:0:20891:0:(genops.c:844:class_export_destroy()) destroying export ffff939436334000/MDS_uuid for MDS 00000020:01000000:0.0:1789579193.393048:0:20891:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1789579193.393562:0:20891:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1789579194.348582:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579195.368551:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579196.387486:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789579196.779684:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 044b3bf9-43fa-4501-b924-7b81ca047525->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789579196.779694:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 044b3bf9-43fa-4501-b924-7b81ca047525->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789579196.779700:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789579196.779711:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789579196.779716:0:36:0:(import.c:65:import_set_state_nolock()) ffff939436231800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789579196.779724:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 546 00000100:00080000:3.0:1789579196.779730:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789579196.779742:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff939436231800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789579196.779780:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9393048edf80 x1876509277252096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789579196.779837:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789579196.779841:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789579196.779842:0:36:0:(import.c:65:import_set_state_nolock()) ffff939304086800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789579196.779846:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 546 00000100:00080000:3.0:1789579196.779849:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789579196.779854:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff939304086800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789579196.779878:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9393048eed80 x1876509277252352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789579196.779920:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789579196.779936:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277252224:0@lo:400:kworker.0 00000400:00000100:3.0:1789579196.779983:0:3615:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876509277252224 offset 0 length 224: 4 00000100:00100000:3.0:1789579196.780043:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876509277252480:0@lo:400:kworker.0 00000400:00000100:3.0:1789579196.780060:0:3617:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876509277252480 offset 0 length 224: 4 00000100:00100000:0.0:1789579196.780167:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3614:1876509277252096:0@lo:38:kworker.0 00000400:00000100:0.0:1789579196.780191:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876509277252096 offset 0 length 520: 4 00000100:00100000:0.0:1789579196.780204:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3614:1876509277252352:0@lo:38:kworker.0 00000400:00000100:0.0:1789579196.780216:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876509277252352 offset 0 length 520: 4 00000020:01000004:2.0:1789579197.207475:0:21091:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789579197.220521:0:21091:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1789579197.220576:0:21091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939304367000/0xd90373d592f22068 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f2206f expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579197.220591:0:21091:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939304367000/0xd90373d592f22068 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f2206f expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579197.220598:0:21091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939304367000/0xd90373d592f22068 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f2206f expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579197.220605:0:21091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff939304367000/0xd90373d592f22068 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f2206f expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579197.220632:0:21091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789579197.220637:0:21091:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789579197.220662:0:21091:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789579197.220672:0:21091:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9393048edf80 x1876509277252096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789579216 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579197.220693:0:21091:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789579197.220700:0:21091:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789579197.220705:0:21091:0:(import.c:65:import_set_state_nolock()) ffff939436231800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789579197.220710:0:21091:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789579197.220721:0:21091:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9393048edf80 x1876509277252096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789579216 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579197.220746:0:21091:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789579197.220750:0:21091:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00010000:00010000:1.0:1789579197.220822:0:17107:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579197.220830:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939304367000/0xd90373d592f22068 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f2206f expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579197.220837:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304367000 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1789579197.220841:0:17107:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939304367000/0xd90373d592f22068 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f2206f expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579197.220850:0:17107:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939304367000/0xd90373d592f22068 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xd90373d592f2206f expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789579197.220857:0:17107:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939304367000/0xd90373d592f22068 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xd90373d592f2206f expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789579197.220863:0:17107:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789579197.220866:0:17107:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789579197.220868:0:17107:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789579197.220879:0:17107:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff939436336800 00010000:00010000:1.0:1789579197.220882:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939304367000/0xd90373d592f22068 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xd90373d592f2206f expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579197.220898:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939304367000/0xd90373d592f22068 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xd90373d592f2206f expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579197.220909:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579197.220911:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579197.220912:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579197.221234:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3614:1876509277252096:0@lo:38:kworker.0 00000100:00080000:2.0:1789579197.222931:0:21091:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789579197.222946:0:21091:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9393048ef480 x1876509277252224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579212 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579197.223093:0:21091:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789579197.223099:0:21091:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789579197.223132:0:21091:0:(import.c:65:import_set_state_nolock()) ffff939304095000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789579197.223294:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3614:1876509277252608:0@lo:39:umount.0 00000400:00000100:0.0:1789579197.223343:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876509277252608 offset 0 length 224: 4 00000100:00100000:3.0:1789579197.223589:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277252224:0@lo:400:kworker.0 00010000:00010000:0.0:1789579197.411700:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579198.443416:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789579198.819819:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) 044b3bf9-43fa-4501-b924-7b81ca047525->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789579198.819826:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) 044b3bf9-43fa-4501-b924-7b81ca047525->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789579198.819829:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789579198.819832:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789579198.819955:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277252736:0@lo:400:kworker.0 00000400:00000100:1.0:1789579198.820005:0:3618:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876509277252736 offset 0 length 224: 4 00000001:00100000:2.0:1789579198.822237:0:18619:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789579198.822246:0:18619:0:(genops.c:885:class_export_put()) final put ffff93930377f800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789579198.822480:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93930377f800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789579198.822534:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93930377c800 for lustre-OST0000 00000001:00100000:1.0:1789579198.827450:0:19437:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789579198.827459:0:19437:0:(genops.c:885:class_export_put()) final put ffff9393023bc800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789579198.830196:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff9393023bc800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789579198.830254:0:14907:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff939303778800 for lustre-OST0001 00010000:00010000:1.0:1789579199.460233:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579200.485480:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579201.507585:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789579201.827585:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) 044b3bf9-43fa-4501-b924-7b81ca047525->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789579201.827595:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) 044b3bf9-43fa-4501-b924-7b81ca047525->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789579201.827598:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789579201.827602:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789579201.827787:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789579201.827806:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876509277252864:0@lo:400:kworker.0 00000400:00000100:1.0:1789579201.827855:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876509277252864 offset 0 length 224: 4 00010000:00010000:1.0:1789579202.531621:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579203.363465:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789579193/real 1789579193] req@ffff939304886d80 x1876509277251968/t0(0) o250->MGC192.168.203.137@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789579203 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579203.363499:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff939304886d80 x1876509277251968/t0(0) o250->MGC192.168.203.137@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789579203 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789579203.363519:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939436336800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789579203.363549:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1789579203.363553:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:044b3bf9-43fa-4501-b924-7b81ca047525:3614:1876509277251968:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:1.0:1789579203.363660:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) 044b3bf9-43fa-4501-b924-7b81ca047525->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789579203.363665:0:14907:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1789579203.363668:0:14907:0:(import.c:65:import_set_state_nolock()) ffff939436336800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789579203.363673:0:14907:0:(import.c:545:import_select_connection()) MGC192.168.203.137@tcp: connect to NID 0@lo last attempt 548 00000100:00080000:1.0:1789579203.363678:0:14907:0:(import.c:630:import_select_connection()) MGC192.168.203.137@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789579203.363688:0:14907:0:(import.c:666:import_select_connection()) MGC192.168.203.137@tcp: import ffff939436336800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:1.0:1789579203.363716:0:14907:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9393043aad80 x1876509277252992/t0(0) o250->MGC192.168.203.137@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789579203.363747:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789579203.363756:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789579203.363877:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876509277253120:0@lo:400:kworker.0 00000400:00000100:3.0:1789579203.363923:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876509277253120 offset 0 length 224: 4 00000100:00100000:0.0:1789579203.363952:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:044b3bf9-43fa-4501-b924-7b81ca047525:3614:1876509277252992:0@lo:250:kworker.0 00000400:00000100:0.0:1789579203.363979:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876509277252992 offset 0 length 520: 4 00010000:00010000:0.0:1789579203.558490:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579204.579637:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579205.603582:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579206.627552:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579207.459498:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789579197/real 1789579197] req@ffff939304886a00 x1876509277252608/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789579207 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579207.459532:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff939304886a00 x1876509277252608/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789579207 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789579207.459553:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939304095000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789579207.459573:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3614:1876509277252608:0@lo:39:umount.0 00000100:00080000:2.0:1789579207.459759:0:21091:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789579207.459764:0:21091:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789579207.459769:0:21091:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789579207.460805:0:21091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303436400/0xd90373d592f2203e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22045 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579207.460822:0:21091:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303436400/0xd90373d592f2203e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f22045 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579207.460829:0:21091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303436400/0xd90373d592f2203e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f22045 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579207.460836:0:21091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff939303436400/0xd90373d592f2203e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f22045 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579207.460865:0:21091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789579207.460872:0:21091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303437000/0xd90373d592f223a2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f223a9 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579207.460896:0:21091:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303437000/0xd90373d592f223a2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f223a9 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579207.460902:0:21091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303437000/0xd90373d592f223a2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f223a9 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579207.460908:0:21091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff939303437000/0xd90373d592f223a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f223a9 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579207.460934:0:21091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789579207.460940:0:21091:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1789579207.460966:0:21091:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1789579207.460970:0:21091:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1789579207.460975:0:21091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789579207.460980:0:21091:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789579207.460985:0:21091:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff93943bba99c0) has no exports 00000020:00080000:2.0:1789579207.461014:0:21091:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff93943bba99c0) has no exports 00010000:00010000:3.0:1789579207.461474:0:17107:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789579207.461483:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939303436400/0xd90373d592f2203e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f22045 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579207.461491:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436400 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1789579207.461495:0:17107:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939303436400/0xd90373d592f2203e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f22045 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579207.461503:0:17107:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939303436400/0xd90373d592f2203e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xd90373d592f22045 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789579207.461510:0:17107:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939303436400/0xd90373d592f2203e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xd90373d592f22045 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789579207.461529:0:17107:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789579207.461531:0:17107:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1789579207.461534:0:17107:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1789579207.461547:0:17107:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff939436336800 00010000:00010000:3.0:1789579207.461551:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939303436400/0xd90373d592f2203e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xd90373d592f22045 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579207.461557:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939303436400/0xd90373d592f2203e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xd90373d592f22045 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579207.461573:0:17107:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789579207.461576:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939303437000/0xd90373d592f223a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f223a9 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579207.461581:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437000 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1789579207.461584:0:17107:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939303437000/0xd90373d592f223a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f223a9 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579207.461590:0:17107:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939303437000/0xd90373d592f223a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd90373d592f223a9 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789579207.461596:0:17107:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939303437000/0xd90373d592f223a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd90373d592f223a9 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789579207.461601:0:17107:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789579207.461603:0:17107:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789579207.461605:0:17107:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789579207.461610:0:17107:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff939436336800 00010000:00010000:3.0:1789579207.461613:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939303437000/0xd90373d592f223a2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd90373d592f223a9 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579207.461624:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939303437000/0xd90373d592f223a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd90373d592f223a9 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579207.461633:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579207.461635:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579207.461636:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579207.462789:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789579207.465175:0:21091:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff939302a820c0 - data ffff939429efdaf8/ffff939435d3d400 00000020:01000000:2.0:1789579207.465615:0:21091:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9393035dc960 - data ffff939429f48870/ffff939436d95000 00100000:10000000:2.0:1789579207.473088:0:21091:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789579207.485172:0:21091:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f22053 00000020:00000080:3.0:1789579207.485188:0:21091:0:(genops.c:885:class_export_put()) final put ffff939303a20000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1789579207.485218:0:21091:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93940f414000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1789579207.485221:0:21091:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93940f414000 2 00000020:01000004:3.0:1789579207.485225:0:21091:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93940f414000 from lustre-OST0000 00000020:00000080:3.0:1789579207.485251:0:21091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789579207.485264:0:21091:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1789579207.485267:0:21091:0:(genops.c:885:class_export_put()) final put ffff939403957000/lustre-OST0000_UUID 00000020:00000080:3.0:1789579207.485269:0:21091:0:(genops.c:844:class_export_destroy()) destroying export ffff939403957000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1789579207.485276:0:21091:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:1.0:1789579207.485325:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff939303a20000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:3.0:1789579207.486154:0:21091:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1789579207.486161:0:21091:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789579207.486165:0:21091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789579207.486171:0:21091:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789579207.486178:0:21091:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9394100ee000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789579207.486184:0:21091:0:(genops.c:1552:class_disconnect_exports()) OBD device 23 (ffff9394361599c0) has exports, disconnecting them 00000020:00080000:3.0:1789579207.486189:0:21091:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9394100ee000), last request at 1789579120 00000020:00000080:3.0:1789579207.486193:0:21091:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f2207d 00000020:00080000:3.0:1789579207.486221:0:21091:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9394100ee000): rc 0 00000020:00000080:3.0:1789579207.486227:0:21091:0:(genops.c:885:class_export_put()) final put ffff9394100ee000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789579207.491308:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff9394100ee000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1789579207.491385:0:21091:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789579207.491391:0:21091:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789579207.491396:0:21091:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789579207.491402:0:21091:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789579207.491436:0:14907:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff939436231800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789579207.491599:0:21091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789579207.491609:0:21091:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1789579207.491615:0:21091:0:(genops.c:885:class_export_put()) final put ffff9394100e8000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1789579207.491618:0:21091:0:(genops.c:844:class_export_destroy()) destroying export ffff9394100e8000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1789579207.491627:0:21091:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1789579207.491707:0:21091:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789579207.491712:0:21091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789579207.491717:0:21091:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789579207.491724:0:21091:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff93940f410000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789579207.491730:0:21091:0:(genops.c:1552:class_disconnect_exports()) OBD device 24 (ffff93943bb3cd40) has exports, disconnecting them 00000020:00080000:0.0:1789579207.491735:0:21091:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff93940f410000), last request at 1789579120 00000020:00000080:0.0:1789579207.491740:0:21091:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f22092 00000020:00080000:0.0:1789579207.491753:0:21091:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93940f410000): rc 0 00000020:00000080:0.0:1789579207.491758:0:21091:0:(genops.c:885:class_export_put()) final put ffff93940f410000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1789579207.491806:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff93940f410000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1789579207.495459:0:21091:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1789579207.495468:0:21091:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789579207.495473:0:21091:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789579207.495480:0:21091:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789579207.495510:0:14907:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff939304095000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1789579207.495695:0:21091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789579207.495704:0:21091:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1789579207.495709:0:21091:0:(genops.c:885:class_export_put()) final put ffff9394100ef000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1789579207.495712:0:21091:0:(genops.c:844:class_export_destroy()) destroying export ffff9394100ef000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1789579207.495720:0:21091:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1789579207.495786:0:21091:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93940f414000 1 00000020:00000080:1.0:1789579207.495800:0:21091:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f22030 00000020:00000080:1.0:1789579207.495807:0:21091:0:(genops.c:885:class_export_put()) final put ffff93940f415800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1789579207.495816:0:21091:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1789579207.495825:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff93940f415800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789579207.495834:0:21091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789579207.495840:0:21091:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789579207.495844:0:21091:0:(genops.c:1557:class_disconnect_exports()) OBD device 20 (ffff93943615b380) has no exports 00000020:00000080:2.0:1789579207.526874:0:21091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789579207.526889:0:21091:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1789579207.526895:0:21091:0:(genops.c:885:class_export_put()) final put ffff93940f417800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1789579207.526899:0:21091:0:(genops.c:844:class_export_destroy()) destroying export ffff93940f417800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1789579207.526909:0:21091:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1789579207.527012:0:21091:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93940f413000 00000020:02000400:2.0:1789579207.527062:0:21091:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1789579207.653811:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789579208.548152:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) 044b3bf9-43fa-4501-b924-7b81ca047525->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789579208.548161:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) 044b3bf9-43fa-4501-b924-7b81ca047525->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789579208.548164:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789579208.548167:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789579208.548302:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789579208.548322:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277253248:0@lo:400:kworker.0 00000400:00000100:1.0:1789579208.548407:0:3618:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876509277253248 offset 0 length 224: 4 00010000:00010000:3.0:1789579208.675518:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579209.700215:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789579210.619608:0:21294:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789579210.641610:0:21294:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1789579210.641709:0:21294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363aee00/0xd90373d592f22102 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22109 expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579210.641724:0:21294:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363aee00/0xd90373d592f22102 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f22109 expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579210.641732:0:21294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363aee00/0xd90373d592f22102 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f22109 expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579210.641738:0:21294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff9394363aee00/0xd90373d592f22102 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f22109 expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579210.641759:0:21294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789579210.641764:0:21294:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789579210.641789:0:21294:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789579210.641800:0:21294:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9393048eed80 x1876509277252352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789579216 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579210.641820:0:21294:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789579210.641826:0:21294:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789579210.641832:0:21294:0:(import.c:65:import_set_state_nolock()) ffff939304086800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1789579210.641836:0:21294:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789579210.641840:0:21294:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9393048eed80 x1876509277252352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789579216 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579210.641846:0:21294:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789579210.641849:0:21294:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:1.0:1789579210.641974:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3614:1876509277252352:0@lo:38:kworker.0 00010000:00010000:2.0:1789579210.642049:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789579210.642067:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff9394363aee00/0xd90373d592f22102 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f22109 expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579210.642074:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363aee00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:2.0:1789579210.642078:0:17106:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff9394363aee00/0xd90373d592f22102 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f22109 expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579210.642087:0:17106:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff9394363aee00/0xd90373d592f22102 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd90373d592f22109 expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789579210.642095:0:17106:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff9394363aee00/0xd90373d592f22102 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd90373d592f22109 expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789579210.642101:0:17106:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789579210.642104:0:17106:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789579210.642106:0:17106:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789579210.642129:0:17106:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff939436336800 00010000:00010000:2.0:1789579210.642134:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff9394363aee00/0xd90373d592f22102 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd90373d592f22109 expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579210.642140:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff9394363aee00/0xd90373d592f22102 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd90373d592f22109 expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579210.642151:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579210.642153:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579210.642155:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789579210.643195:0:21294:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789579210.643207:0:21294:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9393048ec000 x1876509277252480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579212 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579210.643277:0:21294:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93930350e300 x1876509277252736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579214 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579210.643306:0:21294:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93930350ca80 x1876509277252864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579217 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579210.643444:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277252736:0@lo:400:kworker.0 00000100:00100000:3.0:1789579210.643487:0:21294:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9393043abb80 x1876509277253120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579219 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579210.643495:0:21294:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93930350e680 x1876509277253248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579224 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579210.643502:0:21294:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789579210.643508:0:21294:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789579210.646885:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876509277252480:0@lo:400:kworker.0 00000100:00100000:0.0:1789579210.646969:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277253248:0@lo:400:kworker.0 00000100:00100000:1.0:1789579210.647780:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876509277252864:0@lo:400:kworker.0 00000100:00100000:1.0:1789579210.647801:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876509277253120:0@lo:400:kworker.0 00000100:00080000:3.0:1789579210.650520:0:21294:0:(import.c:65:import_set_state_nolock()) ffff939304082800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789579210.650595:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3614:1876509277253376:0@lo:39:umount.0 00000400:00000100:1.0:1789579210.650644:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876509277253376 offset 0 length 224: 4 00010000:00010000:3.0:1789579210.723528:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579211.747687:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579212.775419:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789579213.668944:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 044b3bf9-43fa-4501-b924-7b81ca047525->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789579213.668954:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 044b3bf9-43fa-4501-b924-7b81ca047525->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1789579213.796690:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579214.826569:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579215.843624:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579216.867820:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579217.892822:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789579218.789516:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) 044b3bf9-43fa-4501-b924-7b81ca047525->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789579218.789529:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) 044b3bf9-43fa-4501-b924-7b81ca047525->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789579218.851568:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789579203/real 1789579203] req@ffff9393043aad80 x1876509277252992/t0(0) o250->MGC192.168.203.137@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789579218 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579218.851645:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9393043aad80 x1876509277252992/t0(0) o250->MGC192.168.203.137@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789579218 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789579218.851678:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939436336800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789579218.851701:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1789579218.851705:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:044b3bf9-43fa-4501-b924-7b81ca047525:3614:1876509277252992:0@lo:250:kworker.0 00000100:00080000:0.0:1789579218.854078:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) 044b3bf9-43fa-4501-b924-7b81ca047525->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789579218.854091:0:14907:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1789579218.854096:0:14907:0:(import.c:65:import_set_state_nolock()) ffff939436336800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789579218.854106:0:14907:0:(import.c:545:import_select_connection()) MGC192.168.203.137@tcp: connect to NID 0@lo last attempt 558 00000100:00080000:0.0:1789579218.854122:0:14907:0:(import.c:630:import_select_connection()) MGC192.168.203.137@tcp: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789579218.854141:0:14907:0:(import.c:666:import_select_connection()) MGC192.168.203.137@tcp: import ffff939436336800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:0.0:1789579218.854191:0:14907:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93930350e680 x1876509277253504/t0(0) o250->MGC192.168.203.137@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789579218.854477:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:044b3bf9-43fa-4501-b924-7b81ca047525:3614:1876509277253504:0@lo:250:kworker.0 00000400:00000100:2.0:1789579218.854544:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876509277253504 offset 0 length 520: 4 00010000:00010000:2.0:1789579218.916123:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579219.942181:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579220.899640:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789579210/real 1789579210] req@ffff9393048ef480 x1876509277253376/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789579220 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579220.899672:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9393048ef480 x1876509277253376/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789579220 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789579220.899690:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939304082800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789579220.899711:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3614:1876509277253376:0@lo:39:umount.0 00000100:00080000:3.0:1789579220.899895:0:21294:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789579220.899899:0:21294:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789579220.899904:0:21294:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789579220.900835:0:21294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363aea00/0xd90373d592f220d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f220df expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579220.900848:0:21294:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363aea00/0xd90373d592f220d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f220df expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579220.900856:0:21294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363aea00/0xd90373d592f220d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f220df expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579220.900881:0:21294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff9394363aea00/0xd90373d592f220d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f220df expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579220.900908:0:21294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789579220.900916:0:21294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401519000/0xd90373d592f22394 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f2239b expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579220.900924:0:21294:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401519000/0xd90373d592f22394 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f2239b expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579220.900930:0:21294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401519000/0xd90373d592f22394 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f2239b expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579220.900937:0:21294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff939401519000/0xd90373d592f22394 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f2239b expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579220.900955:0:21294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789579220.900959:0:21294:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1789579220.900983:0:21294:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1789579220.900987:0:21294:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1789579220.900991:0:21294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789579220.900997:0:21294:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789579220.901001:0:21294:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff939405a9cd40) has no exports 00000020:00080000:3.0:1789579220.901024:0:21294:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff939405a9cd40) has no exports 00010000:00010000:1.0:1789579220.902155:0:19485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789579220.902164:0:19485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff9394363aea00/0xd90373d592f220d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f220df expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579220.902173:0:19485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363aea00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1789579220.902177:0:19485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff9394363aea00/0xd90373d592f220d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f220df expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579220.902201:0:19485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff9394363aea00/0xd90373d592f220d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd90373d592f220df expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789579220.902208:0:19485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff9394363aea00/0xd90373d592f220d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd90373d592f220df expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789579220.902215:0:19485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789579220.902217:0:19485:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1789579220.902219:0:19485:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1789579220.902232:0:19485:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff939436336800 00010000:00010000:1.0:1789579220.902236:0:19485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff9394363aea00/0xd90373d592f220d8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd90373d592f220df expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579220.902242:0:19485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff9394363aea00/0xd90373d592f220d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd90373d592f220df expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579220.902256:0:19485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579220.902260:0:19485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939401519000/0xd90373d592f22394 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f2239b expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579220.902266:0:19485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401519000 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1789579220.902269:0:19485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939401519000/0xd90373d592f22394 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f2239b expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579220.902275:0:19485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939401519000/0xd90373d592f22394 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd90373d592f2239b expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789579220.902281:0:19485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939401519000/0xd90373d592f22394 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd90373d592f2239b expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789579220.902295:0:19485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789579220.902297:0:19485:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789579220.902299:0:19485:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789579220.902304:0:19485:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff939436336800 00010000:00010000:1.0:1789579220.902307:0:19485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939401519000/0xd90373d592f22394 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd90373d592f2239b expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579220.902314:0:19485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939401519000/0xd90373d592f22394 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd90373d592f2239b expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579220.902327:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579220.902329:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579220.902331:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789579220.902808:0:21294:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff939302a82c00 - data ffff939420f0aca8/ffff939435d3fc00 00000020:01000000:3.0:1789579220.902928:0:21294:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9393035dc8a0 - data ffff939429de7ca8/ffff939436c61c00 00010000:00010000:2.0:1789579220.904375:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1789579220.931385:0:21294:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789579220.947764:0:21294:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f220ed 00000020:00000080:2.0:1789579220.947775:0:21294:0:(genops.c:885:class_export_put()) final put ffff93942e15f000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1789579220.947787:0:21294:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93930377d800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1789579220.947790:0:21294:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93930377d800 2 00000020:01000004:2.0:1789579220.947792:0:21294:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93930377d800 from lustre-OST0001 00000020:00000080:2.0:1789579220.947814:0:21294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789579220.947824:0:21294:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1789579220.947827:0:21294:0:(genops.c:885:class_export_put()) final put ffff93930377b800/lustre-OST0001_UUID 00000020:00000080:2.0:1789579220.947830:0:21294:0:(genops.c:844:class_export_destroy()) destroying export ffff93930377b800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1789579220.947837:0:21294:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1789579220.947948:0:21294:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 044b3bf9-43fa-4501-b924-7b81ca047525->MGS 00010000:00010000:2.0:1789579220.947964:0:21294:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939304366000/0xd90373d592f21efc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd90373d592f21f03 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789579220.947976:0:21294:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939304366000/0xd90373d592f21efc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd90373d592f21f03 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789579220.947983:0:21294:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1789579220.947987:0:21294:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1789579220.947990:0:21294:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1789579220.948001:0:21294:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff939436336800 00010000:00010000:2.0:1789579220.948005:0:21294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939304366000/0xd90373d592f21efc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd90373d592f21f03 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579220.948019:0:21294:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939303437600/0xd90373d592f21deb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd90373d592f21df2 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789579220.948027:0:21294:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939303437600/0xd90373d592f21deb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd90373d592f21df2 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789579220.948032:0:21294:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789579220.948035:0:21294:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1789579220.948036:0:21294:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1789579220.948045:0:21294:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff939436336800 00010000:00010000:2.0:1789579220.948048:0:21294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939303437600/0xd90373d592f21deb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd90373d592f21df2 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789579220.948061:0:21294:0:(import.c:65:import_set_state_nolock()) ffff939436336800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1789579220.948065:0:21294:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789579220.948068:0:21294:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789579220.948069:0:21294:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789579220.948073:0:21294:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789579220.948090:0:21294:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93930350e680 x1876509277253504/t0(0) o250->MGC192.168.203.137@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789579238 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789579220.948118:0:21294:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789579220.948121:0:21294:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:2.0:1789579220.948148:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:044b3bf9-43fa-4501-b924-7b81ca047525:3614:1876509277253504:0@lo:250:kworker.0 10000000:01000000:2.0:1789579220.948171:0:21294:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789579220.948178:0:21294:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f21dd6 00000020:00000080:2.0:1789579220.948182:0:21294:0:(genops.c:885:class_export_put()) final put ffff939436335800/044b3bf9-43fa-4501-b924-7b81ca047525 00000020:01000000:2.0:1789579220.948187:0:21294:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.137@tcp (flags='') 00000020:00000080:2.0:1789579220.948192:0:21294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789579220.948196:0:21294:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.137@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789579220.948200:0:21294:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff93943f544d40) has no exports 10000000:01000000:2.0:1789579220.948215:0:17115:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1789579220.948247:0:21294:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.137@tcp: client import never connected 00000100:00080000:2.0:1789579220.948250:0:21294:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1789579220.948252:0:21294:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789579220.948255:0:21294:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1789579220.948256:0:21294:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789579220.948284:0:21294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789579220.948288:0:21294:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.137@tcp (uuid 044b3bf9-43fa-4501-b924-7b81ca047525) 00000020:01000000:2.0:1789579220.948292:0:21294:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789579220.948295:0:21294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789579220.948298:0:21294:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789579220.948302:0:21294:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff939304085000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789579220.948308:0:21294:0:(genops.c:1552:class_disconnect_exports()) OBD device 27 (ffff93943bbacd40) has exports, disconnecting them 00000020:00080000:2.0:1789579220.948312:0:21294:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff939304085000), last request at 1789579139 00000020:00000080:2.0:1789579220.948316:0:21294:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f22117 00000020:00080000:2.0:1789579220.948324:0:21294:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff939304085000): rc 0 00000020:00000080:2.0:1789579220.948328:0:21294:0:(genops.c:885:class_export_put()) final put ffff939304085000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789579220.949018:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93942e15f000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1789579220.949026:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff939436335800/044b3bf9-43fa-4501-b924-7b81ca047525 for MGC192.168.203.137@tcp 00000020:00000080:1.0:1789579220.949031:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff939436336800 for MGC192.168.203.137@tcp 00000020:00000080:1.0:1789579220.949036:0:36:0:(genops.c:885:class_export_put()) final put ffff939436330800/044b3bf9-43fa-4501-b924-7b81ca047525 00000020:00000080:1.0:1789579220.949039:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff939436330800/044b3bf9-43fa-4501-b924-7b81ca047525 for MGC192.168.203.137@tcp 00000020:01000000:1.0:1789579220.949042:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.137@tcp (044b3bf9-43fa-4501-b924-7b81ca047525) 00010000:01000000:3.0:1789579220.949222:0:21294:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1789579220.949233:0:21294:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789579220.949235:0:21294:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789579220.949239:0:21294:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789579220.949291:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff939304085000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789579220.949297:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff939304086800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789579220.949388:0:21294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789579220.949394:0:21294:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1789579220.949397:0:21294:0:(genops.c:885:class_export_put()) final put ffff939304085800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1789579220.949400:0:21294:0:(genops.c:844:class_export_destroy()) destroying export ffff939304085800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1789579220.949406:0:21294:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1789579220.949443:0:21294:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789579220.949446:0:21294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789579220.949450:0:21294:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789579220.949454:0:21294:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9393048c7000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789579220.949459:0:21294:0:(genops.c:1552:class_disconnect_exports()) OBD device 28 (ffff9393037c3380) has exports, disconnecting them 00000020:00080000:3.0:1789579220.949463:0:21294:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9393048c7000), last request at 1789579139 00000020:00000080:3.0:1789579220.949466:0:21294:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f2212c 00000020:00080000:3.0:1789579220.949475:0:21294:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9393048c7000): rc 0 00000020:00000080:3.0:1789579220.949478:0:21294:0:(genops.c:885:class_export_put()) final put ffff9393048c7000/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1789579220.950275:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff9393048c7000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1789579220.981337:0:21294:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1789579220.981416:0:21294:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789579220.981420:0:21294:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789579220.981427:0:21294:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789579220.981815:0:17107:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1789579220.981938:0:19485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1789579220.982022:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1789579220.982130:0:17101:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff939406600200:17101] 0 exiting: rc = 1 00000100:00100000:2.0:1789579220.982202:0:17102:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff93930350b400:17102] 1 exiting: rc = 0 00000100:00100000:2.0:1789579220.982264:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.982521:0:17104:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff939302a1ba00:17104] 1 exiting: rc = 0 00000100:00100000:2.0:1789579220.982578:0:20146:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9393041a0800:20146] 3 exiting: rc = 0 00000100:00100000:2.0:1789579220.982933:0:17105:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff939302a1a400:17105] 2 exiting: rc = 0 00000100:00100000:2.0:1789579220.982985:0:17103:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff939302a1a200:17103] 0 exiting: rc = 1 00000100:00100000:2.0:1789579220.983031:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983038:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983045:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983051:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983057:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983064:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983071:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983076:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983081:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983087:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983092:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983108:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983114:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983120:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983125:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983130:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983135:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983140:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983145:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983161:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983166:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983172:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983177:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983182:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983188:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983193:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983199:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983204:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983281:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983289:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983294:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983299:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983304:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983309:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983313:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983318:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983324:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983329:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983335:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983340:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983346:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983370:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983377:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983381:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983386:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983391:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983396:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983402:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983407:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983412:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983416:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983421:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983426:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983432:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983444:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983449:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983454:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983459:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983465:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983470:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983476:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983481:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983485:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579220.983491:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789579220.984565:0:21294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789579220.984576:0:21294:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1789579220.984582:0:21294:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93930377d800 1 00000020:00000080:2.0:1789579220.984588:0:21294:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f220d1 00000020:00000080:2.0:1789579220.984597:0:21294:0:(genops.c:885:class_export_put()) final put ffff939436def800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1789579220.985018:0:14907:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff939304082800 for lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1789579220.985027:0:14907:0:(genops.c:885:class_export_put()) final put ffff939304080800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1789579220.985030:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff939304080800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1789579220.985042:0:14907:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000000:2.0:1789579220.985183:0:21294:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1789579220.985189:0:21294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789579220.985195:0:21294:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789579220.985199:0:21294:0:(genops.c:1557:class_disconnect_exports()) OBD device 25 (ffff939405a999c0) has no exports 00000020:00000080:1.0:1789579220.988905:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff939436def800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1789579221.008311:0:21294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789579221.008324:0:21294:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1789579221.008330:0:21294:0:(genops.c:885:class_export_put()) final put ffff939303779000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1789579221.008334:0:21294:0:(genops.c:844:class_export_destroy()) destroying export ffff939303779000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1789579221.008347:0:21294:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1789579221.009585:0:21294:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93930377a000 00000020:01000000:2.0:1789579221.009620:0:21294:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1789579221.009843:0:21294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789579221.009850:0:21294:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789579221.009854:0:21294:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff93943615cd40) has no exports 00000020:00000080:2.0:1789579221.009882:0:21294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789579221.009889:0:21294:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1789579221.009893:0:21294:0:(genops.c:885:class_export_put()) final put ffff93940f413800/OSS_uuid 00000020:00000080:2.0:1789579221.009895:0:21294:0:(genops.c:844:class_export_destroy()) destroying export ffff93940f413800/OSS_uuid for OSS 00000020:01000000:2.0:1789579221.009899:0:21294:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1789579221.010061:0:18624:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff939436c31600:18624] 2 exiting: rc = 0 00000100:00100000:1.0:1789579221.010164:0:19143:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff939436c84600:19143] 3 exiting: rc = 0 00000100:00080000:3.0:1789579221.010827:0:17114:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1789579221.010937:0:19481:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff93930389e800:19481] 4 exiting: rc = 0 00000100:00100000:3.0:1789579221.011003:0:18622:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff939436c85a00:18622] 0 exiting: rc = 1 00000100:00100000:3.0:1789579221.011055:0:18623:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff939436c85200:18623] 1 exiting: rc = 0 00000100:00100000:2.0:1789579221.011154:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011163:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011169:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011174:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011180:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011186:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011191:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011236:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011243:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011249:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011254:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011259:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011264:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011269:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011489:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011495:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011500:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011505:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011510:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011516:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011521:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011526:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011531:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011536:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011542:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011547:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011551:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011555:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011560:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011564:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011569:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011574:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011579:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011584:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011594:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011832:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011838:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011843:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011848:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011855:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011860:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011910:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011918:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011923:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011929:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011933:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011938:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011943:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011948:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011954:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011960:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011965:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011970:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011975:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011980:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011985:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.011995:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.012040:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.012045:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.012050:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.012055:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.012060:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.012065:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579221.012070:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.020510:0:18626:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff93943705d200:18626] 0 exiting: rc = 1 00000100:00100000:1.0:1789579221.028795:0:19911:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff939303999400:19911] 2 exiting: rc = 0 00000100:00100000:1.0:1789579221.029506:0:18627:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff939437064c00:18627] 1 exiting: rc = 0 00000100:00100000:3.0:1789579221.029576:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029585:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029601:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029607:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029612:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029619:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029625:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029630:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029650:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029656:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029662:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029667:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029672:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029677:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029683:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029688:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029694:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029706:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029712:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029717:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029723:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029728:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029733:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029738:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029743:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029748:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029754:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029760:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029765:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029771:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029776:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029782:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029797:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029804:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029809:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029814:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029819:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029825:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029830:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029835:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029841:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029846:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029851:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029864:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029869:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029874:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029879:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029884:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029889:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029894:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029898:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029903:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029908:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029913:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029917:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029932:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029938:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029943:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029948:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029953:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029957:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029962:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029967:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.029972:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579221.032980:0:18629:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff939441951200:18629] 1 exiting: rc = 0 00000100:00100000:1.0:1789579221.033538:0:18630:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff93942eb2a600:18630] 2 exiting: rc = 0 00000100:00100000:2.0:1789579221.034028:0:18628:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9394131e3800:18628] 0 exiting: rc = 1 00000100:00100000:3.0:1789579221.034432:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034443:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034449:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034454:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034460:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034465:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034471:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034477:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034482:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034488:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034494:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034499:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034504:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034509:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034527:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034532:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034538:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034543:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034548:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034554:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034559:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034565:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034571:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034576:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034595:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034797:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034807:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034813:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034818:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034824:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034830:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034835:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034841:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034847:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034852:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034858:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034863:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034868:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034874:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034879:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034885:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034892:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034898:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034903:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034909:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034915:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034921:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034927:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034947:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034959:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034965:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034971:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034976:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034981:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034987:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034993:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.034999:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.035013:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.035028:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.035043:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.035049:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.035130:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.035139:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.035144:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579221.046466:0:18632:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9393034e4600:18632] 1 exiting: rc = 0 00000100:00100000:0.0:1789579221.046673:0:18631:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff93943bb13a00:18631] 0 exiting: rc = 1 00000100:00100000:3.0:1789579221.046842:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.046849:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.046855:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.046860:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.046865:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.046872:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.046878:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.046883:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.046889:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.046895:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.046900:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.046935:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.046942:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.046948:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.046953:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.046958:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.046964:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.046970:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.046976:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.046981:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.046997:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047002:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047008:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047013:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047018:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047024:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047030:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047035:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047040:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047163:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047171:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047177:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047183:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047189:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047195:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047201:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047207:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047278:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047285:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047290:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047295:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047300:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047305:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047310:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047314:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047320:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047325:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047330:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047336:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047342:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047347:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047419:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047425:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047430:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047435:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047447:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047452:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047458:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047464:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047470:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047475:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047480:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047486:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.047491:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579221.049857:0:18633:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff939436c40e00:18633] 0 exiting: rc = 1 00000100:00100000:3.0:1789579221.050193:0:18634:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff939436c41400:18634] 1 exiting: rc = 0 00000100:00100000:3.0:1789579221.050474:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.050484:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.050489:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.050495:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.050503:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.050509:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.050515:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.050541:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.050548:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.050554:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.050560:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.050566:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.050900:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.050909:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.050916:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.050980:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.050989:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.050994:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051000:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051006:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051012:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051019:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051024:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051030:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051051:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051144:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051150:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051156:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051162:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051167:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051173:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051178:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051184:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051190:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051195:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051200:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051434:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051442:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051448:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051453:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051459:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051465:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051471:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051476:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051483:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051488:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051494:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051501:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051522:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051530:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051536:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051541:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051548:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051554:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051559:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051565:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051571:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051577:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.051583:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.053557:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.053885:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.053893:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.053900:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579221.053907:0:21294:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1789579221.067002:0:21294:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1789579242.129927:0:22059:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg337-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789579251.275167:0:22659:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789579251.275172:0:22659:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1789579251.275174:0:22659:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789579251.275281:0:22659:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff939435d8b800 00000020:01000004:0.0:1789579251.275296:0:22659:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1789579251.275303:0:22659:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789579251.275317:0:22659:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9394361599c0) 00000020:00000080:0.0:1789579251.275330:0:22659:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789579251.365581:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789579251.365824:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1789579251.368170:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1789579251.371521:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789579251.372119:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1789579251.372525:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1789579251.373108:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1789579251.373375:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1789579251.373757:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789579251.373971:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1789579251.374210:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789579251.374553:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1789579251.374743:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1789579251.375100:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1789579251.375304:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1789579251.376259:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1789579251.376625:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1789579251.376889:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1789579251.377177:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1789579251.377397:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1789579251.377689:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1789579251.377991:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1789579251.378237:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1789579251.378537:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1789579251.379072:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1789579251.379805:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1789579251.380172:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1789579251.380419:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1789579251.380745:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1789579251.380984:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1789579251.381277:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1789579251.381696:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1789579251.383161:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1789579251.384184:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1789579251.384563:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1789579251.384861:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1789579251.385216:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1789579251.385554:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1789579251.385800:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1789579251.386038:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1789579251.386334:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1789579251.386938:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1789579251.387216:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1789579251.387616:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1789579251.387803:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1789579251.388217:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1789579251.389302:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1789579251.394261:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1789579251.395658:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1789579251.395926:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1789579251.396716:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1789579251.397201:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1789579251.397612:0:22659:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:2.0:1789579251.398304:0:22659:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789579251.398612:0:22659:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789579251.398621:0:22659:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789579251.398634:0:22659:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd90373d592f226dc 00000020:01000004:2.0:1789579251.398641:0:22659:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1789579251.398646:0:22659:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789579251.398651:0:22659:0:(tgt_mount.c:101:server_register_mount()) register mount ffff939435d8b800 from MGS 00000020:01000004:2.0:1789579251.398654:0:22659:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789579251.398664:0:22659:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9393037c19c0) 00000020:00000080:2.0:1789579251.398674:0:22659:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789579251.398729:0:22659:0:(tgt_mount.c:153:server_get_mount()) get mount ffff939435d8b800 from MGS, refs=2 00080000:01000000:2.0:1789579251.398733:0:22659:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789579251.398738:0:22659:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd90373d592f226ea 00000100:00100000:2.0:1789579251.398828:0:22659:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789579251.398970:0:22659:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789579251.398976:0:22659:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789579251.401565:0:22659:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789579251.401577:0:22659:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789579251.403240:0:22659:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789579251.403715:0:22659:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789579251.403738:0:22659:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789579251.404780:0:22659:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789579251.404789:0:22659:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789579251.405189:0:22659:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789579251.405195:0:22659:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789579251.409194:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579251.409199:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579251.409200:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579251.409891:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579251.409895:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579251.409896:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579251.410671:0:22659:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789579251.412202:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1789579251.417065:0:22659:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1789579251.421637:0:22672:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789579251.424744:0:22659:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789579251.424806:0:22659:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789579251.427934:0:22659:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789579251.428263:0:22659:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789579251.428472:0:22659:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789579251.428478:0:22659:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789579251.430575:0:22659:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789579251.430587:0:22659:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789579251.432980:0:22659:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789579251.432990:0:22659:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789579251.437133:0:22659:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789579251.437155:0:22659:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.137@tcp' 00000020:01000004:3.0:1789579251.437157:0:22659:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789579251.437182:0:22659:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.137@tcp (typ=mgc) 00000020:00000080:3.0:1789579251.437193:0:22659:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.137@tcp (ffff939405a9b380) 00000020:00000080:3.0:1789579251.437217:0:22659:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789579251.437290:0:22659:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93943711a000@MGC192.168.203.137@tcp: add connection 192.168.203.137@tcp at head 00000100:00080000:2.0:1789579251.437657:0:22676:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:3.0:1789579251.437792:0:22659:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.137@tcp-0 is initialized 00000040:01000000:3.0:1789579251.437798:0:22659:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.137@tcp ctxt 1 is initialized 10000000:01000000:3.0:1789579251.449705:0:22677:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789579251.449800:0:22659:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.137@tcp (uuid 39addb08-5233-4b30-82ca-229405d26fae) 00000020:00000080:0.0:1789579251.449826:0:22659:0:(genops.c:1384:class_connect()) connect: client 39addb08-5233-4b30-82ca-229405d26fae, cookie 0xd90373d592f226f8 00000100:00080000:0.0:1789579251.449838:0:22659:0:(import.c:545:import_select_connection()) MGC192.168.203.137@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789579251.449848:0:22659:0:(import.c:666:import_select_connection()) MGC192.168.203.137@tcp: import ffff93943711a000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:0.0:1789579251.449902:0:22659:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93930350e300 x1876509277253632/t0(0) o250->MGC192.168.203.137@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789579251.449935:0:22659:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 39addb08-5233-4b30-82ca-229405d26fae->MGS 00000020:01000004:0.0:1789579251.449963:0:22659:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789579251.449968:0:22659:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789579251.449983:0:22659:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff939436158000) 00000020:00000080:0.0:1789579251.449994:0:22659:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789579251.451309:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:39addb08-5233-4b30-82ca-229405d26fae:3614:1876509277253632:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789579251.451393:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579251.453623:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277253632 00000100:00100000:1.0:1789579251.453637:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277253632 00000100:00100000:1.0:1789579251.453674:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789579251.453681:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394360e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3614:x1876509277253632:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1789579251.453721:0:22673:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 39addb08-5233-4b30-82ca-229405d26fae@0@lo t0 exp 0000000000000000 cur 606 last 0 00000020:00000080:1.0:1789579251.453750:0:22673:0:(genops.c:1384:class_connect()) connect: client 39addb08-5233-4b30-82ca-229405d26fae, cookie 0xd90373d592f22706 00000100:00080000:1.0:1789579251.453889:0:22673:0:(import.c:65:import_set_state_nolock()) ffff93940f416800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789579251.453956:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394360e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+5:3614:x1876509277253632:12345-0@lo:250:mount.lustre.0 Request processed in 274us (2563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579251.453963:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789579251.459122:0:3614:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.137@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789579251.459139:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.137@tcp: connect to target with instance 0 00000100:00080000:1.0:1789579251.459148:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.137@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789579251.459154:0:3614:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789579251.459158:0:3614:0:(import.c:65:import_set_state_nolock()) ffff93943711a000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789579251.459161:0:3614:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789579251.459180:0:3614:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789579251.459199:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:39addb08-5233-4b30-82ca-229405d26fae:3614:1876509277253632:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789579251.465698:0:22659:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789579251.465893:0:22659:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789579251.465901:0:22659:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789579251.466816:0:22659:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789579251.466826:0:22659:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789579251.470272:0:22659:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789579251.470285:0:22659:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789579251.471344:0:22659:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789579251.472144:0:22659:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789579251.472150:0:22659:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789579251.472915:0:22659:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789579251.472923:0:22659:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789579251.513233:0:22659:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789579251.514238:0:22659:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789579251.514244:0:22659:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789579251.515382:0:22659:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789579251.515393:0:22659:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789579251.516204:0:22659:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789579251.516377:0:22659:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789579251.516383:0:22659:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789579251.517552:0:22659:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789579251.517562:0:22659:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789579251.518158:0:22659:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789579251.518718:0:22659:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789579251.518723:0:22659:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789579251.519314:0:22659:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789579251.519321:0:22659:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789579251.522173:0:22659:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789579251.522328:0:22659:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789579251.522334:0:22659:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789579251.523186:0:22659:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789579251.523194:0:22659:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789579251.543577:0:22659:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789579251.543908:0:22659:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789579251.543921:0:22659:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789579251.546231:0:22659:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789579251.546243:0:22659:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789579251.548892:0:22659:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789579251.548909:0:22659:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789579251.550278:0:22659:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789579251.550306:0:22659:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1789579251.550313:0:22659:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.137@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789579251.550809:0:22659:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.137@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789579251.550853:0:22659:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.137@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1789579251.550858:0:22659:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789579251.550860:0:22659:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789579251.550862:0:22659:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789579251.550863:0:22659:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789579251.550864:0:22659:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789579251.550866:0:22659:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789579251.550867:0:22659:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789579251.550880:0:22659:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789579251.550882:0:22659:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789579251.550883:0:22659:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789579251.550885:0:22659:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1789579251.550888:0:22659:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789579251.550889:0:22659:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789579251.550890:0:22659:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789579251.550891:0:22659:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789579251.550893:0:22659:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789579251.550894:0:22659:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789579251.550895:0:22659:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789579251.550896:0:22659:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789579251.550897:0:22659:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789579251.550899:0:22659:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789579251.550923:0:22659:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789579251.550942:0:22659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:22659:1876509277253760:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789579251.551007:0:22659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579251.551149:0:22659:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408e599c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789579251.551204:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277253760 00000100:00100000:0.0:1789579251.551212:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277253760 00000100:00100000:0.0:1789579251.551291:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789579251.551300:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394360eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+5:22659:x1876509277253760:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789579251.551345:0:22675:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789579251.551375:0:22675:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789579251.551385:0:22675:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1789579251.552143:0:22696:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789579251.552823:0:22675:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:3.0:1789579251.554692:0:22697:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1789579251.554698:0:22697:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1789579251.554701:0:22697:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1789579251.554704:0:22697:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1789579251.554888:0:22697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1789579251.555180:0:22675:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789579251.555196:0:22675:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789579251.560212:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394360eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+5:22659:x1876509277253760:12345-0@lo:253:mount.lustre.0 Request processed in 8904us (9196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579251.560226:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789579251.560310:0:22659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:22659:1876509277253760:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789579251.560324:0:22659:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789579251.560327:0:22659:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789579251.560329:0:22659:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789579251.560330:0:22659:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789579251.560332:0:22659:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789579251.560333:0:22659:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789579251.560334:0:22659:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789579251.560336:0:22659:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789579251.560338:0:22659:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789579251.560339:0:22659:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789579251.560340:0:22659:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789579251.560843:0:22659:0:(tgt_mount.c:101:server_register_mount()) register mount ffff939435d8b800 from lustre-MDT0000 10000000:01000000:1.0:1789579251.560884:0:22659:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789579251.560888:0:22659:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789579251.560892:0:22659:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff939405a9b380 10000000:01000000:1.0:1789579251.560897:0:22659:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789579251.560905:0:22659:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff939405a9b380 from 1 10000000:01000000:1.0:1789579251.560909:0:22659:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789579251.560946:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f2270d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579251.560957:0:22659:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f2270d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579251.560968:0:22659:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f2270d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579251.560987:0:22659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:22659:1876509277253888:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789579251.561095:0:22659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579251.561163:0:22659:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408e59d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789579251.561208:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277253888 00000100:00100000:3.0:1789579251.561214:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277253888 00000100:00100000:3.0:1789579251.561517:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789579251.561528:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394360e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+5:22659:x1876509277253888:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789579251.561540:0:22674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579251.561554:0:22674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939302b2ee00/0xd90373d592f22714 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f2270d expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579251.561576:0:22674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939302b2ee00/0xd90373d592f22714 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f2270d expref: 6 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579251.561587:0:22674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939302b2ee00/0xd90373d592f22714 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f2270d expref: 6 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579251.561594:0:22674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939302b2ee00, rc 0) 00000100:00100000:3.0:1789579251.562836:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394360e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+6:22659:x1876509277253888:12345-0@lo:101:mount.lustre.0 Request processed in 1303us (1733us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579251.562863:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789579251.563764:0:22659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:22659:1876509277253888:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789579251.563789:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f2270d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22714 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579251.563802:0:22659:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f2270d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f22714 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579251.563898:0:22659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304885500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:22659:1876509277254016:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789579251.563940:0:22659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579251.563979:0:22659:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405e4c540 going to sleep for 11 seconds 00000100:00100000:1.0:1789579251.564165:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277254016 00000100:00100000:1.0:1789579251.564173:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277254016 00000100:00100000:1.0:1789579251.564222:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789579251.564230:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394360e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+6:22659:x1876509277254016:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789579251.564314:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394360e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+6:22659:x1876509277254016:12345-0@lo:501:mount.lustre.0 Request processed in 84us (373us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789579251.564321:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789579251.564704:0:22659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304885500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:22659:1876509277254016:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789579251.564733:0:22659:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789579251.564753:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f2270d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22714 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579251.564763:0:22659:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f2270d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22714 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789579251.564773:0:22659:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff939435d8b800 10000000:01000000:2.0:1789579251.564778:0:22659:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789579251.564782:0:22659:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff939435d8b800 10000000:01000000:2.0:1789579251.564785:0:22659:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789579251.564788:0:22659:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff939435d8b800 from 1 10000000:01000000:2.0:1789579251.564791:0:22659:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789579251.564815:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363af000/0xd90373d592f2271b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579251.564824:0:22659:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff9394363af000/0xd90373d592f2271b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579251.564832:0:22659:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff9394363af000/0xd90373d592f2271b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579251.564846:0:22659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304885500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:22659:1876509277254144:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789579251.564884:0:22659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579251.564912:0:22659:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405e4c540 going to sleep for 11 seconds 00000100:00100000:1.0:1789579251.564999:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277254144 00000100:00100000:1.0:1789579251.565004:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277254144 00000100:00100000:1.0:1789579251.565134:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789579251.565142:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394360e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+6:22659:x1876509277254144:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789579251.565150:0:22675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579251.565162:0:22675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939401518400/0xd90373d592f22722 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f2271b expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579251.565180:0:22675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939401518400/0xd90373d592f22722 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f2271b expref: 7 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579251.565188:0:22675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939401518400/0xd90373d592f22722 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f2271b expref: 7 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579251.565196:0:22675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401518400, rc 0) 00000100:00100000:1.0:1789579251.565232:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394360e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+7:22659:x1876509277254144:12345-0@lo:101:mount.lustre.0 Request processed in 91us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579251.565238:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789579251.565341:0:22659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304885500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:22659:1876509277254144:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789579251.565634:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff9394363af000/0xd90373d592f2271b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22722 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579251.565658:0:22659:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff9394363af000/0xd90373d592f2271b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f22722 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789579251.565671:0:22659:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789579251.565680:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363af000/0xd90373d592f2271b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22722 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579251.565687:0:22659:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff9394363af000/0xd90373d592f2271b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22722 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789579251.565693:0:22659:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789579251.565696:0:22659:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789579251.565701:0:22659:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff939435d8b800 10000000:01000000:2.0:1789579251.565703:0:22659:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789579251.565706:0:22659:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1789579251.565709:0:22659:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789579251.565723:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363ae200/0xd90373d592f22729 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579251.565730:0:22659:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff9394363ae200/0xd90373d592f22729 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579251.565738:0:22659:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff9394363ae200/0xd90373d592f22729 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579251.565750:0:22659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304885500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:22659:1876509277254272:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789579251.565778:0:22659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579251.565796:0:22659:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405e4c540 going to sleep for 11 seconds 00000100:00100000:1.0:1789579251.565925:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277254272 00000100:00100000:1.0:1789579251.565930:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277254272 00000100:00100000:1.0:1789579251.565962:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789579251.565968:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394360eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+7:22659:x1876509277254272:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789579251.565976:0:22675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579251.565984:0:22675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939401518a00/0xd90373d592f22730 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f22729 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579251.565998:0:22675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939401518a00/0xd90373d592f22730 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f22729 expref: 8 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579251.566005:0:22675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939401518a00/0xd90373d592f22730 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f22729 expref: 8 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579251.566027:0:22675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401518a00, rc 0) 00000100:00100000:1.0:1789579251.566060:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394360eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+8:22659:x1876509277254272:12345-0@lo:101:mount.lustre.0 Request processed in 92us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579251.566066:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789579251.566209:0:22659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304885500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:22659:1876509277254272:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789579251.566220:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff9394363ae200/0xd90373d592f22729 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22730 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579251.566228:0:22659:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff9394363ae200/0xd90373d592f22729 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f22730 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579251.566273:0:22659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304885500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:22659:1876509277254400:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789579251.566297:0:22659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579251.566316:0:22659:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405e4c540 going to sleep for 11 seconds 00000100:00100000:1.0:1789579251.566375:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277254400 00000100:00100000:1.0:1789579251.566387:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277254400 00000100:00100000:3.0:1789579251.566673:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789579251.566684:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394360ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+8:22659:x1876509277254400:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789579251.566813:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394360ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+9:22659:x1876509277254400:12345-0@lo:501:mount.lustre.0 Request processed in 133us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579251.566820:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789579251.566921:0:22659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304885500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:22659:1876509277254400:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789579251.566948:0:22659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304885500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:22659:1876509277254528:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789579251.566986:0:22659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579251.567014:0:22659:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405e4c540 going to sleep for 11 seconds 00000100:00100000:3.0:1789579251.567097:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277254528 00000100:00100000:3.0:1789579251.567102:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277254528 00000100:00100000:3.0:1789579251.567131:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789579251.567138:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+9:22659:x1876509277254528:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789579251.568174:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+9:22659:x1876509277254528:12345-0@lo:503:mount.lustre.0 Request processed in 1034us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579251.568183:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789579251.568329:0:22659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304885500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:22659:1876509277254528:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789579251.568982:0:22698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39addb08-5233-4b30-82ca-229405d26fae:22698:1876509277254656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789579251.569111:0:22698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579251.569137:0:22698:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303bece40 going to sleep for 11 seconds 00000100:00100000:1.0:1789579251.569180:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277254656 00000100:00100000:1.0:1789579251.569186:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277254656 00000100:00100000:1.0:1789579251.569227:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789579251.569235:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+9:22698:x1876509277254656:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789579251.570308:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+9:22698:x1876509277254656:12345-0@lo:502:llog_process_th.0 Request processed in 1070us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579251.570317:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789579251.570805:0:22698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39addb08-5233-4b30-82ca-229405d26fae:22698:1876509277254656:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789579251.570836:0:22698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789579251.570848:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579251.570850:0:22698:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789579251.570855:0:22698:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789579251.570858:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789579251.570881:0:22698:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff939405a98000) 00000020:00000080:3.0:1789579251.570897:0:22698:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789579251.570903:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789579251.570971:0:22698:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789579251.570984:0:22698:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd90373d592f2273e 00000020:00000080:3.0:1789579251.571244:0:22698:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789579251.571248:0:22698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789579251.571252:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579251.571253:0:22698:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789579251.571256:0:22698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789579251.571260:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579251.571261:0:22698:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789579251.571264:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789579251.571272:0:22698:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff939405a999c0) 00000020:00000080:3.0:1789579251.571281:0:22698:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789579251.571284:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789579251.571286:0:22698:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789579251.571289:0:22698:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789579251.571294:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789579251.571344:0:22698:0:(tgt_mount.c:153:server_get_mount()) get mount ffff939435d8b800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789579251.571737:0:22698:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff939405a9cd40) 00000020:00000080:3.0:1789579251.571747:0:22698:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789579251.571802:0:22698:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789579251.571808:0:22698:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd90373d592f22753 00000020:00000080:3.0:1789579251.571918:0:22698:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789579251.571924:0:22698:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789579251.571928:0:22698:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xd90373d592f2275a 00080000:01000000:3.0:1789579251.571933:0:22698:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789579251.571937:0:22698:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd90373d592f22761 00010000:00010000:3.0:1789579251.645836:0:22698:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1789579251.648752:0:22698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934637 00000001:00080000:3.0:1789579251.649667:0:22698:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789579251.652255:0:22698:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff93943bbacd40) 00000020:00000080:3.0:1789579251.652276:0:22698:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789579251.654003:0:22698:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789579251.654017:0:22698:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd90373d592f2276f 00000020:00000080:3.0:1789579251.654922:0:22698:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789579251.661614:0:22698:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xd90373d592f22776 00000020:00000080:3.0:1789579251.662194:0:22698:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789579251.662205:0:22698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789579251.662211:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579251.662213:0:22698:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789579251.662217:0:22698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789579251.662219:0:22698:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1789579251.662221:0:22698:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789579251.662223:0:22698:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789579251.662224:0:22698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789579251.662227:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579251.662228:0:22698:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789579251.662231:0:22698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789579251.662235:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579251.662237:0:22698:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789579251.662241:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789579251.662276:0:22698:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789579251.662289:0:22698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789579251.662293:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579251.662295:0:22698:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789579251.662297:0:22698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789579251.662301:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579251.662303:0:22698:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1789579251.662306:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789579251.662311:0:22698:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.137@tcp to nid 0x20000c0a8cb89 (192.168.203.137@tcp) 00000020:00000080:3.0:1789579251.662334:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789579251.662368:0:22698:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff93943bba99c0) 00000020:00000080:3.0:1789579251.662381:0:22698:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1789579251.662387:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789579251.662459:0:22698:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1789579251.662465:0:22698:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789579251.662471:0:22698:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd90373d592f22784 00010000:00080000:3.0:1789579251.662501:0:22698:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9394100ee000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.137@tcp at head 00010000:00010000:3.0:1789579251.664328:0:22698:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1789579251.671843:0:22698:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789579251.671858:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789579251.671908:0:22698:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789579251.671929:0:22698:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd90373d592f2278b 00000100:00080000:3.0:1789579251.671940:0:22698:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789579251.671951:0:22698:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9394100ee000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789579251.671984:0:22698:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9393048ed880 x1876509277254784/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789579251.672059:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277254784:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789579251.672133:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579251.672233:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277254784 00000100:00100000:2.0:1789579251.672240:0:22685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277254784 00000100:00100000:2.0:1789579251.672279:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789579251.672286:0:22685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3614:x1876509277254784:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1789579251.672299:0:22685:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1789579251.675463:0:22698:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1789579251.675582:0:22698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789579251.675589:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579251.675591:0:22698:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1789579251.675594:0:22698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789579251.675606:0:22698:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1789579251.675608:0:22698:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789579251.675610:0:22698:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789579251.675611:0:22698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789579251.675614:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579251.675615:0:22698:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789579251.675618:0:22698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789579251.675623:0:22698:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789579251.675626:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579251.675627:0:22698:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789579251.675630:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789579251.675634:0:22698:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.137@tcp to nid 0x20000c0a8cb89 (192.168.203.137@tcp) 00000020:01000000:3.0:1789579251.675658:0:22698:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789579251.675661:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789579251.675675:0:22698:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff93943bbab380) 00000020:00000080:3.0:1789579251.675693:0:22698:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1789579251.675698:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789579251.675786:0:22698:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789579251.675791:0:22698:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789579251.675798:0:22698:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd90373d592f22799 00010000:00080000:3.0:1789579251.675835:0:22698:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939436233000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.137@tcp at head 00010000:00010000:3.0:1789579251.676059:0:22698:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1789579251.676918:0:22698:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789579251.677148:0:22698:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789579251.679499:0:22698:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789579251.679799:0:22698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1789579251.684567:0:22698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:1.0:1789579251.688224:0:22704:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789579251.688232:0:22704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1789579251.689796:0:22685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3614:x1876509277254784:12345-0@lo:38:llog_process_th.0 Request processed in 17504us (17657us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789579251.689809:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789579251.689922:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9394100ee000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789579251.689928:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789579251.689931:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277254784:0@lo:38:llog_process_th.0 00000020:00000080:3.0:1789579251.691254:0:22698:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789579251.691268:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789579251.691306:0:22698:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789579251.691323:0:22698:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd90373d592f227a0 00000100:00080000:3.0:1789579251.691331:0:22698:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789579251.691342:0:22698:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff939436233000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789579251.691598:0:22698:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9393048ee680 x1876509277254912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789579251.691624:0:22698:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789579251.691680:0:22698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789579251.691684:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579251.691686:0:22698:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789579251.691689:0:22698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789579251.691691:0:22698:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1789579251.691693:0:22698:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789579251.691694:0:22698:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789579251.691696:0:22698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789579251.691698:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579251.691700:0:22698:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789579251.691702:0:22698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789579251.691706:0:22698:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789579251.691709:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579251.691720:0:22698:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789579251.691723:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789579251.691727:0:22698:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.137@tcp to nid 0x20000c0a8cb89 (192.168.203.137@tcp) 00000020:01000000:3.0:1789579251.691745:0:22698:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789579251.691748:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789579251.691759:0:22698:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff93943bba8000) 00000020:00000080:3.0:1789579251.691771:0:22698:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1789579251.691774:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789579251.691837:0:22698:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789579251.691843:0:22698:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1789579251.691848:0:22698:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd90373d592f227ae 00010000:00080000:3.0:1789579251.691995:0:22698:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939302b53800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.137@tcp at head 00010000:00010000:3.0:1789579251.692231:0:22698:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1789579251.692294:0:22698:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789579251.692308:0:22698:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1789579251.693732:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277254912:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789579251.693784:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876509277254912 offset 0 length 520: 4 00000040:00080000:3.0:1789579251.694271:0:22698:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789579251.694565:0:22698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1789579251.694743:0:22698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:2.0:1789579251.695290:0:22706:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789579251.695295:0:22706:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789579251.696190:0:22698:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789579251.696202:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789579251.696239:0:22698:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789579251.696263:0:22698:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd90373d592f227b5 00000100:00080000:0.0:1789579251.696272:0:22698:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789579251.696281:0:22698:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff939302b53800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:0.0:1789579251.696321:0:22698:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93930350df80 x1876509277255040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789579251.696431:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277255040:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789579251.696475:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876509277255040 offset 0 length 520: 4 00000100:00080000:0.0:1789579251.696700:0:22698:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789579251.696786:0:22698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789579251.696791:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579251.696793:0:22698:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789579251.696796:0:22698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789579251.696800:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579251.696802:0:22698:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789579251.696805:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789579251.696807:0:22698:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789579251.696809:0:22698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789579251.696811:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579251.696813:0:22698:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789579251.696815:0:22698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789579251.696817:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579251.696819:0:22698:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789579251.696823:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789579251.696849:0:22698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39addb08-5233-4b30-82ca-229405d26fae:22698:1876509277255168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789579251.696907:0:22698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579251.696928:0:22698:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303ae89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789579251.696985:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277255168 00000100:00100000:3.0:1789579251.696993:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277255168 00000100:00100000:3.0:1789579251.697035:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789579251.697044:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+9:22698:x1876509277255168:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789579251.697167:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+9:22698:x1876509277255168:12345-0@lo:502:llog_process_th.0 Request processed in 124us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579251.697175:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789579251.697319:0:22698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39addb08-5233-4b30-82ca-229405d26fae:22698:1876509277255168:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789579251.697341:0:22698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789579251.697346:0:22698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579251.697347:0:22698:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789579251.697377:0:22698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1789579251.697664:0:22659:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1789579251.697683:0:22659:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789579251.697703:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363ae200/0xd90373d592f22729 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22730 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579251.697724:0:22659:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff9394363ae200/0xd90373d592f22729 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22730 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789579251.697731:0:22659:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff939435d8b800 from 1 10000000:01000000:3.0:1789579251.697734:0:22659:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789579251.697759:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f227bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579251.697768:0:22659:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f227bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579251.697777:0:22659:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f227bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579251.697791:0:22659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048eca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:22659:1876509277255296:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789579251.697820:0:22659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579251.697833:0:22659:0:(client.c:2716:ptlrpc_set_wait()) set ffff939406670480 going to sleep for 11 seconds 00000100:00100000:0.0:1789579251.697893:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277255296 00000100:00100000:0.0:1789579251.697902:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277255296 00000100:00100000:0.0:1789579251.697930:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789579251.697936:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+9:22659:x1876509277255296:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789579251.697945:0:22673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579251.697957:0:22673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939435d7be00/0xd90373d592f227c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f227bc expref: -99 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579251.697976:0:22673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939435d7be00/0xd90373d592f227c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f227bc expref: 10 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579251.697985:0:22673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939435d7be00/0xd90373d592f227c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f227bc expref: 10 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579251.697993:0:22673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939435d7be00, rc 0) 00000100:00100000:0.0:1789579251.698019:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+10:22659:x1876509277255296:12345-0@lo:101:mount.lustre.0 Request processed in 83us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579251.698025:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789579251.698144:0:22659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048eca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:22659:1876509277255296:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789579251.698155:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f227bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f227c3 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579251.698164:0:22659:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f227bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f227c3 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579251.698836:0:22659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048eca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:22659:1876509277255424:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789579251.698883:0:22659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579251.698903:0:22659:0:(client.c:2716:ptlrpc_set_wait()) set ffff939406670480 going to sleep for 11 seconds 00000100:00100000:3.0:1789579251.698929:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277255424 00000100:00100000:3.0:1789579251.698934:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277255424 00000100:00100000:3.0:1789579251.698961:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789579251.698967:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+10:22659:x1876509277255424:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1789579251.698980:0:22674:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789579251.698985:0:22674:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789579251.699044:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+10:22659:x1876509277255424:12345-0@lo:256:mount.lustre.0 Request processed in 76us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579251.699051:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789579251.699438:0:22659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048eca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:22659:1876509277255424:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789579251.700143:0:22659:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789579251.700160:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f227bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f227c3 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579251.700171:0:22659:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f227bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f227c3 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789579251.700179:0:22659:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff939435d8b800 from 1 10000000:01000000:3.0:1789579251.700181:0:22659:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789579251.700208:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2e600/0xd90373d592f227ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579251.700216:0:22659:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939302b2e600/0xd90373d592f227ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579251.700226:0:22659:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939302b2e600/0xd90373d592f227ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579251.700241:0:22659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048eca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:22659:1876509277255552:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789579251.700283:0:22659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579251.700322:0:22659:0:(client.c:2716:ptlrpc_set_wait()) set ffff939406670480 going to sleep for 11 seconds 00000100:00100000:2.0:1789579251.700521:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277255552 00000100:00100000:2.0:1789579251.700528:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277255552 00000100:00100000:2.0:1789579251.700558:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789579251.700566:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+10:22659:x1876509277255552:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789579251.700575:0:22675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579251.700588:0:22675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394363aec00/0xd90373d592f227d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f227ca expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579251.700620:0:22675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394363aec00/0xd90373d592f227d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f227ca expref: 11 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579251.700631:0:22675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394363aec00/0xd90373d592f227d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f227ca expref: 11 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579251.700639:0:22675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363aec00, rc 0) 00000100:00100000:2.0:1789579251.700680:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+11:22659:x1876509277255552:12345-0@lo:101:mount.lustre.0 Request processed in 115us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579251.700687:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789579251.700799:0:22659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048eca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:22659:1876509277255552:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789579251.700812:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939302b2e600/0xd90373d592f227ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f227d1 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579251.700822:0:22659:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939302b2e600/0xd90373d592f227ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f227d1 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579251.700884:0:22659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048eca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:22659:1876509277255680:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789579251.700908:0:22659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579251.700935:0:22659:0:(client.c:2716:ptlrpc_set_wait()) set ffff939406670480 going to sleep for 11 seconds 00000100:00100000:0.0:1789579251.700996:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277255680 00000100:00100000:0.0:1789579251.701001:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277255680 00000100:00100000:0.0:1789579251.701031:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789579251.701037:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+11:22659:x1876509277255680:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789579251.701166:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+11:22659:x1876509277255680:12345-0@lo:501:mount.lustre.0 Request processed in 129us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579251.701172:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789579251.701293:0:22659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048eca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:22659:1876509277255680:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789579251.701317:0:22659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048eca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:22659:1876509277255808:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789579251.701382:0:22659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579251.701396:0:22659:0:(client.c:2716:ptlrpc_set_wait()) set ffff939406670480 going to sleep for 11 seconds 00000100:00100000:2.0:1789579251.701504:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277255808 00000100:00100000:2.0:1789579251.701509:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277255808 00000100:00100000:2.0:1789579251.701538:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789579251.701546:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+11:22659:x1876509277255808:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789579251.701623:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+11:22659:x1876509277255808:12345-0@lo:503:mount.lustre.0 Request processed in 78us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579251.701630:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789579251.701757:0:22659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048eca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:22659:1876509277255808:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789579251.702128:0:22708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048eca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39addb08-5233-4b30-82ca-229405d26fae:22708:1876509277255936:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789579251.702166:0:22708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579251.702197:0:22708:0:(client.c:2716:ptlrpc_set_wait()) set ffff939406670000 going to sleep for 11 seconds 00000100:00100000:2.0:1789579251.702238:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277255936 00000100:00100000:2.0:1789579251.702242:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277255936 00000100:00100000:2.0:1789579251.702304:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789579251.702310:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+11:22708:x1876509277255936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789579251.702784:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+11:22708:x1876509277255936:12345-0@lo:502:llog_process_th.0 Request processed in 473us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579251.702791:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789579251.702948:0:22708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048eca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39addb08-5233-4b30-82ca-229405d26fae:22708:1876509277255936:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789579251.702974:0:22708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789579251.702982:0:22708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579251.702984:0:22708:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789579251.702996:0:22708:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff939435d8b800 00000020:00000080:0.0:1789579251.702998:0:22708:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789579251.703005:0:22708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789579251.703007:0:22708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579251.703009:0:22708:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789579251.703011:0:22708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789579251.703013:0:22708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579251.703014:0:22708:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789579251.703017:0:22708:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff939435d8b800 00000020:00000080:0.0:1789579251.703019:0:22708:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789579251.703081:0:22708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789579251.703085:0:22708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579251.703086:0:22708:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789579251.703088:0:22708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789579251.703090:0:22708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579251.703091:0:22708:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789579251.703095:0:22708:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff939435d8b800 00000020:00000080:0.0:1789579251.703096:0:22708:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789579251.703113:0:22708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789579251.703116:0:22708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579251.703117:0:22708:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789579251.703119:0:22708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789579251.703122:0:22708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579251.703123:0:22708:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789579251.703127:0:22708:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff939435d8b800 00000020:00000080:0.0:1789579251.703128:0:22708:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789579251.703165:0:22708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39addb08-5233-4b30-82ca-229405d26fae:22708:1876509277256064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789579251.703204:0:22708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579251.703596:0:22708:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303ae8600 going to sleep for 11 seconds 00000100:00100000:3.0:1789579251.703717:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277256064 00000100:00100000:3.0:1789579251.703723:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277256064 00000100:00100000:3.0:1789579251.703753:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789579251.703759:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+11:22708:x1876509277256064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789579251.703860:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+11:22708:x1876509277256064:12345-0@lo:502:llog_process_th.0 Request processed in 101us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579251.703883:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789579251.703975:0:22708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39addb08-5233-4b30-82ca-229405d26fae:22708:1876509277256064:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789579251.703998:0:22708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789579251.704007:0:22708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579251.704009:0:22708:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789579251.704013:0:22708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789579251.704217:0:22659:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789579251.704236:0:22659:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789579251.704254:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2e600/0xd90373d592f227ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f227d1 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579251.704265:0:22659:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939302b2e600/0xd90373d592f227ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f227d1 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789579251.704308:0:22659:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789579251.704310:0:22659:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff939435d8b800 10000000:01000000:3.0:1789579251.704313:0:22659:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff939435d8b800 10000000:01000000:3.0:1789579251.704317:0:22659:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789579251.704322:0:22659:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff939435d8b800 from 1 10000000:01000000:3.0:1789579251.704325:0:22659:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789579251.704372:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2fe00/0xd90373d592f227d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579251.704381:0:22659:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939302b2fe00/0xd90373d592f227d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579251.704391:0:22659:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939302b2fe00/0xd90373d592f227d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579251.704414:0:22659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:22659:1876509277256192:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789579251.704443:0:22659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579251.704459:0:22659:0:(client.c:2716:ptlrpc_set_wait()) set ffff939406670180 going to sleep for 11 seconds 00000100:00100000:3.0:1789579251.704474:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277256192 00000100:00100000:3.0:1789579251.704479:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277256192 00000100:00100000:3.0:1789579251.704547:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789579251.704553:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+11:22659:x1876509277256192:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789579251.704561:0:22675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579251.704572:0:22675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939302b2ea00/0xd90373d592f227df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f227d8 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579251.704591:0:22675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939302b2ea00/0xd90373d592f227df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f227d8 expref: 12 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579251.704612:0:22675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939302b2ea00/0xd90373d592f227df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f227d8 expref: 12 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579251.704621:0:22675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939302b2ea00, rc 0) 00000100:00100000:3.0:1789579251.704649:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+12:22659:x1876509277256192:12345-0@lo:101:mount.lustre.0 Request processed in 96us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579251.704655:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789579251.704683:0:22659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:22659:1876509277256192:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789579251.704695:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939302b2fe00/0xd90373d592f227d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f227df expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579251.704704:0:22659:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939302b2fe00/0xd90373d592f227d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f227df expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579251.704743:0:22659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:22659:1876509277256320:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789579251.704765:0:22659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579251.704776:0:22659:0:(client.c:2716:ptlrpc_set_wait()) set ffff939406670180 going to sleep for 11 seconds 00000100:00100000:3.0:1789579251.704788:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277256320 00000100:00100000:3.0:1789579251.704791:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277256320 00000100:00100000:3.0:1789579251.704814:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789579251.704819:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+12:22659:x1876509277256320:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789579251.704916:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+12:22659:x1876509277256320:12345-0@lo:501:mount.lustre.0 Request processed in 96us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579251.704922:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789579251.704950:0:22659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:22659:1876509277256320:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789579251.704972:0:22659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:22659:1876509277256448:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789579251.705002:0:22659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579251.705014:0:22659:0:(client.c:2716:ptlrpc_set_wait()) set ffff939406670180 going to sleep for 11 seconds 00000100:00100000:3.0:1789579251.705025:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277256448 00000100:00100000:3.0:1789579251.705029:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277256448 00000100:00100000:3.0:1789579251.705045:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789579251.705050:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+12:22659:x1876509277256448:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789579251.705297:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+12:22659:x1876509277256448:12345-0@lo:503:mount.lustre.0 Request processed in 246us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579251.705304:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789579251.705342:0:22659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:22659:1876509277256448:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789579251.705769:0:22709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39addb08-5233-4b30-82ca-229405d26fae:22709:1876509277256576:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789579251.705807:0:22709:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579251.705834:0:22709:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303ae8900 going to sleep for 11 seconds 00000100:00100000:3.0:1789579251.705883:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277256576 00000100:00100000:3.0:1789579251.705887:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277256576 00000100:00100000:3.0:1789579251.705907:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789579251.705913:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+12:22709:x1876509277256576:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789579251.705990:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+12:22709:x1876509277256576:12345-0@lo:502:llog_process_th.0 Request processed in 77us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579251.705998:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789579251.706071:0:22709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39addb08-5233-4b30-82ca-229405d26fae:22709:1876509277256576:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1789579251.706121:0:22709:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789579251.706135:0:22709:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff93943615cd40) 00000020:00000080:0.0:1789579251.706154:0:22709:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1789579251.706226:0:22709:0:(tgt_mount.c:153:server_get_mount()) get mount ffff939435d8b800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789579251.706229:0:22709:0:(tgt_mount.c:187:server_put_mount()) put mount ffff939435d8b800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789579251.706232:0:22709:0:(obd_mount.c:710:lustre_put_lsi()) put ffff939435d8b800 4 00010000:00080000:0.0:1789579251.706263:0:22709:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939303a22000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.137@tcp at head 00010000:00010000:0.0:1789579251.707826:0:22709:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1789579251.708017:0:22709:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789579251.708051:0:22709:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789579251.708063:0:22709:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xd90373d592f227ed 00000100:00080000:0.0:1789579251.708072:0:22709:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789579251.708082:0:22709:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff939303a22000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:0.0:1789579251.708113:0:22709:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93930350ce00 x1876509277256704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789579251.708159:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876509277256704:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789579251.708211:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789579251.708249:0:22709:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789579251.708488:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277256704 00000100:00100000:3.0:1789579251.708502:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277256704 00000100:00100000:3.0:1789579251.708533:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789579251.708540:0:22680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3614:x1876509277256704:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789579251.708589:0:22680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3614:x1876509277256704:12345-0@lo:38:llog_process_th.0 Request processed in 48us (376us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789579251.708595:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789579251.708728:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789579251.708735:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939303a22000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789579251.708739:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789579251.708742:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876509277256704:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789579251.710605:0:22709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39addb08-5233-4b30-82ca-229405d26fae:22709:1876509277256832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789579251.710673:0:22709:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579251.710708:0:22709:0:(client.c:2716:ptlrpc_set_wait()) set ffff939406670540 going to sleep for 11 seconds 00000100:00100000:3.0:1789579251.710729:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277256832 00000100:00100000:3.0:1789579251.710735:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277256832 00000100:00100000:3.0:1789579251.710771:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789579251.710779:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402b71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+12:22709:x1876509277256832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789579251.710897:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402b71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+12:22709:x1876509277256832:12345-0@lo:502:llog_process_th.0 Request processed in 118us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579251.710906:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789579251.710953:0:22709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39addb08-5233-4b30-82ca-229405d26fae:22709:1876509277256832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789579251.710989:0:22709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39addb08-5233-4b30-82ca-229405d26fae:22709:1876509277256960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789579251.711017:0:22709:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579251.711030:0:22709:0:(client.c:2716:ptlrpc_set_wait()) set ffff939406670540 going to sleep for 11 seconds 00000100:00100000:3.0:1789579251.711041:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277256960 00000100:00100000:3.0:1789579251.711050:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277256960 00000100:00100000:3.0:1789579251.711067:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789579251.711072:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402b73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+12:22709:x1876509277256960:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789579251.711130:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402b73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+12:22709:x1876509277256960:12345-0@lo:502:llog_process_th.0 Request processed in 57us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579251.711137:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789579251.711168:0:22709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39addb08-5233-4b30-82ca-229405d26fae:22709:1876509277256960:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789579251.711186:0:22709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789579251.711290:0:22659:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789579251.711312:0:22659:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789579251.711329:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2fe00/0xd90373d592f227d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f227df expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579251.711341:0:22659:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939302b2fe00/0xd90373d592f227d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f227df expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789579251.711480:0:22659:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789579251.711483:0:22659:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789579251.711485:0:22659:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789579251.711486:0:22659:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789579251.711487:0:22659:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789579251.711488:0:22659:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789579251.711490:0:22659:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789579251.711491:0:22659:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789579251.711493:0:22659:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789579251.711495:0:22659:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789579251.711498:0:22659:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1789579251.711500:0:22659:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789579251.711501:0:22659:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789579251.711502:0:22659:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789579251.711503:0:22659:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789579251.711504:0:22659:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789579251.711510:0:22659:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789579251.711511:0:22659:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789579251.711512:0:22659:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789579251.711513:0:22659:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789579251.711513:0:22659:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789579251.711527:0:22659:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789579251.711536:0:22659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:22659:1876509277257088:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789579251.711565:0:22659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579251.711580:0:22659:0:(client.c:2716:ptlrpc_set_wait()) set ffff939406670780 going to sleep for 11 seconds 00000100:00100000:3.0:1789579251.711602:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277257088 00000100:00100000:3.0:1789579251.711606:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277257088 00000100:00100000:3.0:1789579251.711622:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789579251.711627:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402b72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+12:22659:x1876509277257088:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789579251.711645:0:22675:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789579251.711657:0:22675:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789579251.715994:0:22675:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789579251.716007:0:22675:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1789579251.716280:0:22696:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789579251.716285:0:22696:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789579251.716306:0:22696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939401518e00/0xd90373d592f227f4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579251.716324:0:22696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939435d7be00/0xd90373d592f227c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f227bc expref: 12 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579251.716345:0:22696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff939401518e00/0xd90373d592f227f4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579251.716471:0:22696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939435d7be00/0xd90373d592f227c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f227bc expref: 12 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579251.716486:0:22696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939435d7be00/0xd90373d592f227c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f227bc expref: 12 pid: 22673 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579251.716499:0:22696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043ab800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22696:1876509277257216:0@lo:104: 00000100:00100000:1.0:1789579251.716560:0:22696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579251.716597:0:22696:0:(client.c:2716:ptlrpc_set_wait()) set ffff939441a2cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789579251.716632:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277257216 00000100:00100000:1.0:1789579251.716640:0:22663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277257216 00000100:00100000:1.0:1789579251.716674:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789579251.716683:0:22663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39addb08-5233-4b30-82ca-229405d26fae+3:22696:x1876509277257216:12345-0@lo:104: 00010000:00010000:1.0:1789579251.716694:0:22663:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f227bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f227c3 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579251.716739:0:22663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789579251.716745:0:22663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39addb08-5233-4b30-82ca-229405d26fae+3:22696:x1876509277257216:12345-0@lo:104: Request processed in 63us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579251.716751:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789579251.716787:0:22696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043ab800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22696:1876509277257216:0@lo:104: 00010000:00010000:1.0:1789579251.716804:0:22696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff939401518e00/0xd90373d592f227f4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579251.716898:0:22669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789579251.716905:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f227bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f227c3 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579251.716913:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939302b2e800 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1789579251.716917:0:22669:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f227bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f227c3 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579251.716927:0:22669:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f227bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f227c3 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789579251.716934:0:22669:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f227bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f227c3 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789579251.716941:0:22669:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789579251.716973:0:22669:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f227bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f227c3 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579251.716979:0:22669:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789579251.717010:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f227bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f227c3 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579251.717018:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f227bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f227c3 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579251.717035:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579251.717036:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579251.717038:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579251.717088:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402b72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+12:22659:x1876509277257088:12345-0@lo:253:mount.lustre.0 Request processed in 5460us (5522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579251.717096:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789579251.717135:0:22659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:22659:1876509277257088:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789579251.717145:0:22659:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789579251.717148:0:22659:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789579251.717150:0:22659:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789579251.717151:0:22659:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789579251.717153:0:22659:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789579251.717154:0:22659:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789579251.717155:0:22659:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789579251.717156:0:22659:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789579251.717158:0:22659:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789579251.717160:0:22659:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789579251.717161:0:22659:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789579251.717171:0:22659:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1789579251.717488:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789579251.717499:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39addb08-5233-4b30-82ca-229405d26fae:3617:1876509277257344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789579251.717529:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579251.717588:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277257344 00000100:00100000:2.0:1789579251.717593:0:22665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277257344 00010000:00010000:2.0:1789579251.717612:0:22665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939435d7be00/0xd90373d592f227c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f227bc expref: 12 pid: 22673 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579251.717634:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789579251.717641:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304885500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39addb08-5233-4b30-82ca-229405d26fae+12:3617:x1876509277257344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789579251.717652:0:22665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579251.717657:0:22665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939435d7be00/0xd90373d592f227c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f227bc expref: 12 pid: 22673 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579251.717668:0:22665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939435d7be00/0xd90373d592f227c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f227bc expref: 12 pid: 22673 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579251.717681:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939435d7be00/0xd90373d592f227c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f227bc expref: 12 pid: 22673 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579251.717695:0:22665:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff939401518e00/0xd90373d592f227f4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579251.717703:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939401518e00/0xd90373d592f227f4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789579251.717725:0:22665:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001440619s 00010000:00010000:2.0:1789579251.717730:0:22665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939401518e00/0xd90373d592f227f4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579251.717738:0:22665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939401518e00/0xd90373d592f227f4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579251.717745:0:22665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939401518e00/0xd90373d592f227f4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579251.717752:0:22665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939401518e00/0xd90373d592f227f4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579251.717759:0:22665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401518e00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579251.717763:0:22665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939401518e00/0xd90373d592f227f4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579251.717771:0:22665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939401518e00/0xd90373d592f227f4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579251.717786:0:22665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939401518e00/0xd90373d592f227f4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579251.717795:0:22665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789579251.717822:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304885500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39addb08-5233-4b30-82ca-229405d26fae+11:3617:x1876509277257344:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579251.717829:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789579251.717853:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39addb08-5233-4b30-82ca-229405d26fae:3617:1876509277257344:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789579251.719426:0:22696:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff939401518e00/0xd90373d592f227f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579251.719448:0:22696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939401518e00/0xd90373d592f227f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579251.719456:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939401518e00/0xd90373d592f227f4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789579251.747640:0:22659:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:2.0:1789579251.748007:0:22659:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1789579251.748149:0:22720:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:0.0:1789579251.748154:0:22720:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:1.0:1789579251.751390:0:22721:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789579251.751509:0:22659:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1789579251.751770:0:22721:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789579251.753853:0:22721:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789579251.753933:0:22721:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:3.0:1789579251.755854:0:22659:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789579251.755905:0:22659:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789579251.756343:0:22659:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789579251.756368:0:22659:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789579251.756405:0:22659:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789579251.757557:0:22659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00080000:2.0:1789579251.757574:0:22722:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff939304886680 x1876509277257472/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579251.757584:0:22722:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394290be300 going to sleep for 0 seconds 00000040:00080000:3.0:1789579251.758126:0:22659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789579251.758157:0:22659:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789579251.759593:0:22659:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:3.0:1789579251.760056:0:22659:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:3.0:1789579251.762023:0:22659:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1789579251.763592:0:22659:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789579251.763624:0:22659:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbd978194f988 00100000:10000000:3.0:1789579251.763632:0:22659:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789579251.764241:0:22659:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789579251.764257:0:22659:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.137@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789579251.764274:0:22659:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1789579251.764289:0:22659:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1789579251.772551:0:22659:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789579251.772774:0:22659:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789579252.454570:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579252.774080:0:22722:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394290be300 going to sleep for 0 seconds 00000040:00080000:2.0:1789579252.775044:0:22718:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789579252.775052:0:22718:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789579252.776829:0:22718:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789579252.776840:0:22718:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:3.0:1789579253.221766:0:22677:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789579253.221774:0:22677:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff939435d8b800 from 11 10000000:01000000:3.0:1789579253.221779:0:22677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789579253.221826:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f227fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579253.221838:0:22677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f227fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579253.221850:0:22677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f227fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579253.221885:0:22677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277257600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789579253.221956:0:22677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579253.222169:0:22677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091b0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789579253.222513:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277257600 00000100:00100000:1.0:1789579253.222522:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277257600 00000100:00100000:1.0:1789579253.222582:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789579253.222592:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402b70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+11:22677:x1876509277257600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789579253.222605:0:22673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579253.222621:0:22673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939401519400/0xd90373d592f22802 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f227fb expref: -99 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579253.222645:0:22673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939401519400/0xd90373d592f22802 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f227fb expref: 12 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579253.222655:0:22673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939401519400/0xd90373d592f22802 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f227fb expref: 12 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579253.222663:0:22673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401519400, rc 0) 00000100:00100000:1.0:1789579253.222716:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402b70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+12:22677:x1876509277257600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579253.222723:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789579253.222762:0:22677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277257600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789579253.222785:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f227fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22802 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579253.222795:0:22677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f227fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f22802 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579253.222847:0:22677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277257728:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789579253.227833:0:22677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579253.227894:0:22677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091b0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789579253.227946:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277257728 00000100:00100000:0.0:1789579253.227954:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277257728 00000100:00100000:0.0:1789579253.228043:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789579253.228057:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402b73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+12:22677:x1876509277257728:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789579253.228079:0:22674:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789579253.228094:0:22674:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789579253.228097:0:22674:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1789579253.228197:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402b73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+12:22677:x1876509277257728:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 143us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579253.228204:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789579253.228603:0:22677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277257728:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789579253.228652:0:22677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789579253.228661:0:22677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f227fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22802 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579253.228672:0:22677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f227fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22802 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579253.475658:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579253.796035:0:22722:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394290be300 going to sleep for 0 seconds 00000040:00080000:0.0:1789579253.796953:0:22718:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789579253.796958:0:22718:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789579253.798188:0:22718:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:1.0:1789579253.809927:0:22718:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789579253.810086:0:22718:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:0.0:1789579254.502485:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579254.823772:0:22722:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394290be300 going to sleep for 0 seconds 00010000:00010000:3.0:1789579255.523542:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579255.843515:0:22722:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394290be300 going to sleep for 0 seconds 00000001:02000400:1.0:1789579256.080102:0:22964:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg337-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789579256.550594:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579256.869547:0:22722:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394290be300 going to sleep for 0 seconds 00000020:00000004:2.0:1789579257.022569:0:23016:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789579257.022866:0:23016:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:3.0:1789579257.198889:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789579257.198895:0:14907:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789579257.198898:0:14907:0:(import.c:65:import_set_state_nolock()) ffff9394100ee000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789579257.198905:0:14907:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 606 00000100:00080000:3.0:1789579257.198910:0:14907:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789579257.198920:0:14907:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9394100ee000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789579257.199063:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789579257.199076:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39addb08-5233-4b30-82ca-229405d26fae:3616:1876509277257856:0@lo:400:kworker.0 00000100:00100000:3.0:1789579257.199135:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579257.199192:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277257856 00000100:00100000:3.0:1789579257.199199:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277257856 00000100:00100000:3.0:1789579257.199284:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789579257.200451:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402b73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+12:3616:x1876509277257856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579257.200526:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402b73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+12:3616:x1876509277257856:12345-0@lo:400:kworker.0 Request processed in 85us (1391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579257.200533:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789579257.200595:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39addb08-5233-4b30-82ca-229405d26fae:3616:1876509277257856:0@lo:400:kworker.0 00000100:00100000:3.0:1789579257.201452:0:14907:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9393048ef100 x1876509277257984/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789579257.201476:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579257.201480:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789579257.201483:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579257.201485:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789579257.201488:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789579257.201491:0:14907:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789579257.201493:0:14907:0:(import.c:65:import_set_state_nolock()) ffff939303a22000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789579257.201503:0:14907:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff939303a22000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789579257.201519:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277257984:0@lo:38:kworker.0 00000100:00100000:3.0:1789579257.201601:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579257.201677:0:22686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277257984 00000100:00100000:3.0:1789579257.201684:0:22686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277257984 00000100:00100000:3.0:1789579257.204807:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789579257.204821:0:22686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3614:x1876509277257984:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789579257.204874:0:22686:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789579257.204950:0:22686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3614:x1876509277257984:12345-0@lo:38:kworker.0 Request processed in 131us (3348us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789579257.204958:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789579257.217061:0:14907:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939304887800 x1876509277258112/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789579257.220133:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876509277258112:0@lo:38:kworker.0 00000100:00100000:2.0:1789579257.220204:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579257.220247:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277258112 00000100:00100000:0.0:1789579257.220254:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277258112 00000100:00080000:2.0:1789579257.220260:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9394100ee000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789579257.220264:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789579257.220268:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277257984:0@lo:38:kworker.0 00000100:00100000:0.0:1789579257.220286:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789579257.220292:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3614:x1876509277258112:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789579257.220317:0:22682:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 612 last 0 00000020:00000080:0.0:1789579257.220440:0:22682:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xd90373d592f22809 00000004:00100000:0.0:1789579257.220454:0:22682:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789579257.220610:0:22682:0:(import.c:65:import_set_state_nolock()) ffff939303bfb000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789579257.220658:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1876509277258112:12345-0@lo:38:kworker.0 Request processed in 364us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579257.220674:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789579257.220707:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff939304887800 x1876509277258112/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789579267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789579257.220727:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1789579257.220736:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789579257.220740:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789579257.220742:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939303a22000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789579257.220747:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876509277258112:0@lo:38:kworker.0 00010000:00010000:2.0:1789579257.574787:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579257.891520:0:22722:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394290be300 going to sleep for 0 seconds 00000020:00000004:1.0:1789579257.994272:0:23067:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789579257.994554:0:23067:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789579258.597277:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579258.916007:0:22722:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394290be300 going to sleep for 0 seconds 00010000:00010000:2.0:1789579259.619869:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579259.941042:0:22722:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394290be300 going to sleep for 0 seconds 00010000:00010000:1.0:1789579260.645616:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579260.963460:0:22722:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394290be300 going to sleep for 0 seconds 00000100:00100000:1.0:1789579261.349098:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789579251/real 1789579251] req@ffff93930350df80 x1876509277255040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579261 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579261.349139:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93930350df80 x1876509277255040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579261 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579261.349150:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789579251/real 1789579251] req@ffff9393048ee680 x1876509277254912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579261 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579261.349160:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9393048ee680 x1876509277254912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579261 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789579261.349178:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939302b53800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789579261.349200:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789579261.349203:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277255040:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789579261.349209:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939436233000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789579261.349213:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789579261.349215:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277254912:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789579261.350156:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789579261.350162:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789579261.350165:0:8:0:(import.c:65:import_set_state_nolock()) ffff9394100ee000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789579261.350171:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 612 00000100:00080000:3.0:1789579261.350177:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789579261.350187:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9394100ee000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789579261.350207:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9393048ef800 x1876509277258368/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789579261.350220:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579261.350223:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789579261.350224:0:8:0:(import.c:65:import_set_state_nolock()) ffff939436233000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789579261.350227:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 606 00000100:00080000:3.0:1789579261.350230:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789579261.350234:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff939436233000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789579261.350244:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9393048ec380 x1876509277258496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789579261.350264:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579261.350267:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789579261.350268:0:8:0:(import.c:65:import_set_state_nolock()) ffff939302b53800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789579261.350271:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 606 00000100:00080000:3.0:1789579261.350274:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789579261.350278:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff939302b53800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789579261.350290:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9393048ece00 x1876509277258624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789579261.350330:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39addb08-5233-4b30-82ca-229405d26fae:3616:1876509277258240:0@lo:400:kworker.0 00000100:00100000:3.0:1789579261.350408:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579261.350792:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277258368:0@lo:38:kworker.0 00000100:00100000:3.0:1789579261.350840:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579261.350865:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277258496:0@lo:8:kworker.0 00000400:00000100:3.0:1789579261.350888:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876509277258496 offset 0 length 520: 4 00000100:00100000:3.0:1789579261.350900:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277258624:0@lo:8:kworker.0 00000400:00000100:3.0:1789579261.350916:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876509277258624 offset 0 length 520: 4 00000100:00100000:3.0:1789579261.350939:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277258752:0@lo:400:kworker.0 00000100:00100000:3.0:1789579261.350973:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579261.351016:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277258240 00000100:00100000:3.0:1789579261.351023:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277258240 00000100:00100000:3.0:1789579261.351063:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789579261.351071:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303442c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+12:3616:x1876509277258240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579261.351113:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303442c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+12:3616:x1876509277258240:12345-0@lo:400:kworker.0 Request processed in 42us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579261.351129:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789579261.351158:0:22686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277258368 00000100:00100000:3.0:1789579261.351161:0:22686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277258368 00000100:00100000:3.0:1789579261.351178:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789579261.351182:0:22686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3614:x1876509277258368:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789579261.351197:0:22686:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789579261.351226:0:22686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3614:x1876509277258368:12345-0@lo:38:kworker.0 Request processed in 43us (387us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789579261.351232:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789579261.351263:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39addb08-5233-4b30-82ca-229405d26fae:3616:1876509277258240:0@lo:400:kworker.0 00000100:00080000:3.0:1789579261.351289:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9394100ee000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789579261.351293:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789579261.351296:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277258368:0@lo:38:kworker.0 00000100:00100000:0.0:1789579261.351867:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277258752 00000100:00100000:0.0:1789579261.351874:0:22681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277258752 00000100:00100000:0.0:1789579261.352073:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789579261.352082:0:22681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277258752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579261.352141:0:22681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277258752:12345-0@lo:400:kworker.0 Request processed in 60us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579261.352149:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789579261.352291:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9393048ee680 x1876509277258752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579261.352305:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277258752:0@lo:400:kworker.0 00010000:00010000:2.0:1789579261.668446:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579261.987832:0:22722:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394290be300 going to sleep for 0 seconds 00010000:00010000:1.0:1789579262.691895:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579263.014436:0:22722:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394290be300 going to sleep for 0 seconds 00000040:00080000:2.0:1789579263.020280:0:22718:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789579263.715437:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579264.036013:0:22722:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394290be300 going to sleep for 0 seconds 00000020:01000004:1.0:1789579264.649893:0:23412:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789579264.649897:0:23412:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1789579264.649898:0:23412:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1789579264.650008:0:23412:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93943f647000 00000020:01000004:1.0:1789579264.650025:0:23412:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1789579264.650038:0:23412:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789579264.650051:0:23412:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff93943bb3cd40) 00000020:00000080:1.0:1789579264.650066:0:23412:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00010000:00010000:1.0:1789579264.739883:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1789579264.780475:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1789579264.783053:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789579264.787912:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1789579264.791237:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1789579264.791520:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1789579264.791747:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1789579264.791934:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1789579264.792103:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1789579264.792271:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1789579264.792516:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1789579264.792699:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1789579264.792886:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1789579264.793389:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1789579264.793807:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1789579264.793990:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1789579264.797885:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1789579264.799841:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1789579264.800240:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1789579264.800522:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1789579264.800783:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1789579264.801035:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1789579264.801291:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1789579264.801781:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789579264.803096:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1789579264.803463:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1789579264.803683:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1789579264.803900:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1789579264.804107:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1789579264.804347:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1789579264.805038:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1789579264.805255:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789579264.805742:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1789579264.813284:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1789579264.813721:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1789579264.815571:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789579264.816043:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1789579264.816293:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1789579264.816570:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1789579264.816782:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789579264.817041:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1789579264.817898:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789579264.818143:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1789579264.821430:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1789579264.824986:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1789579264.825432:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1789579264.825834:0:23412:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00080000:01000000:0.0:1789579264.826815:0:23412:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789579264.827033:0:23412:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1789579264.827044:0:23412:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789579264.827055:0:23412:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd90373d592f22817 00000020:01000004:0.0:1789579264.827062:0:23412:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789579264.827083:0:23412:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.137@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789579264.827086:0:23412:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.137@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789579264.827092:0:23412:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1789579264.827119:0:23412:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1789579264.827123:0:23412:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.137@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1789579264.836984:0:23412:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.137@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789579264.837025:0:23412:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.137@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1789579264.837030:0:23412:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789579264.837031:0:23412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789579264.837032:0:23412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789579264.837033:0:23412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789579264.837035:0:23412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789579264.837036:0:23412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789579264.837037:0:23412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789579264.837039:0:23412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789579264.837040:0:23412:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789579264.837044:0:23412:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1789579264.837046:0:23412:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789579264.837048:0:23412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789579264.837049:0:23412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789579264.837051:0:23412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789579264.837052:0:23412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789579264.837053:0:23412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789579264.837054:0:23412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789579264.837055:0:23412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789579264.837056:0:23412:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789579264.837090:0:23412:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789579264.837111:0:23412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277258880:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789579264.837179:0:23412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579264.837274:0:23412:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394183ca600 going to sleep for 11 seconds 00000100:00100000:1.0:1789579264.837673:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277258880 00000100:00100000:1.0:1789579264.837681:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277258880 00000100:00100000:1.0:1789579264.837783:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789579264.837803:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303440050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+12:23412:x1876509277258880:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789579264.837836:0:22674:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789579264.837840:0:22674:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1789579264.837848:0:22674:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1789579264.838245:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303440050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+12:23412:x1876509277258880:12345-0@lo:253:mount.lustre.0 Request processed in 453us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579264.838261:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789579264.838342:0:23412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277258880:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789579264.838520:0:23412:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789579264.838523:0:23412:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789579264.838525:0:23412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789579264.838527:0:23412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789579264.838528:0:23412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789579264.838529:0:23412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789579264.838530:0:23412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789579264.838532:0:23412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789579264.838533:0:23412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789579264.838535:0:23412:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789579264.838611:0:23412:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93943f647000 from lustre-MDT0001 10000000:01000000:0.0:1789579264.838639:0:23412:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1789579264.838642:0:23412:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789579264.838649:0:23412:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff939405a9b380 local copy 00010000:00010000:0.0:1789579264.838658:0:23412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f2270d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22714 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579264.838748:0:23412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277259008:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789579264.838792:0:23412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579264.839046:0:23412:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394183ca300 going to sleep for 11 seconds 00000100:00100000:3.0:1789579264.839402:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277259008 00000100:00100000:3.0:1789579264.839409:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277259008 00000100:00100000:3.0:1789579264.839442:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789579264.839450:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303441450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+12:23412:x1876509277259008:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789579264.839527:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303441450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+12:23412:x1876509277259008:12345-0@lo:501:mount.lustre.0 Request processed in 77us (736us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789579264.839534:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789579264.839631:0:23412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277259008:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789579264.839645:0:23412:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.137@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789579264.839663:0:23412:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.137@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789579264.839669:0:23412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f2270d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22714 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579264.839678:0:23412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f2270d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22714 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789579264.839703:0:23412:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93943f647000 10000000:01000000:0.0:1789579264.839715:0:23412:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789579264.839720:0:23412:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff939405a9b380 10000000:01000000:0.0:1789579264.839723:0:23412:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789579264.839726:0:23412:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff939405a9b380 from 1 10000000:01000000:0.0:1789579264.839729:0:23412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789579264.839756:0:23412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939435d7b800/0xd90373d592f2281e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579264.839763:0:23412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939435d7b800/0xd90373d592f2281e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579264.839782:0:23412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939435d7b800/0xd90373d592f2281e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579264.839806:0:23412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277259136:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789579264.839834:0:23412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579264.839853:0:23412:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394183ca300 going to sleep for 11 seconds 00000100:00100000:3.0:1789579264.839948:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277259136 00000100:00100000:3.0:1789579264.839958:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277259136 00000100:00100000:3.0:1789579264.839978:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789579264.839985:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303443450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+12:23412:x1876509277259136:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789579264.839993:0:22675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579264.840005:0:22675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939302b2f200/0xd90373d592f22825 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f2281e expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579264.840026:0:22675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939302b2f200/0xd90373d592f22825 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f2281e expref: 13 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579264.840036:0:22675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939302b2f200/0xd90373d592f22825 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f2281e expref: 13 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579264.840045:0:22675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939302b2f200, rc 0) 00000100:00100000:3.0:1789579264.840084:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303443450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+13:23412:x1876509277259136:12345-0@lo:101:mount.lustre.0 Request processed in 99us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579264.840091:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789579264.840249:0:23412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277259136:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789579264.840262:0:23412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939435d7b800/0xd90373d592f2281e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22825 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579264.840271:0:23412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939435d7b800/0xd90373d592f2281e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f22825 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789579264.840286:0:23412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789579264.840309:0:23412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939435d7b800/0xd90373d592f2281e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22825 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579264.840318:0:23412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939435d7b800/0xd90373d592f2281e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22825 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789579264.840338:0:23412:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93943f647000 10000000:01000000:0.0:1789579264.840341:0:23412:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789579264.840345:0:23412:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff93943f647000 from 1 10000000:01000000:0.0:1789579264.840348:0:23412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789579264.840383:0:23412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939435d7b600/0xd90373d592f2282c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579264.840391:0:23412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939435d7b600/0xd90373d592f2282c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579264.840399:0:23412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939435d7b600/0xd90373d592f2282c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579264.840412:0:23412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277259264:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789579264.840438:0:23412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579264.840456:0:23412:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394183ca300 going to sleep for 11 seconds 00000100:00100000:1.0:1789579264.840561:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277259264 00000100:00100000:1.0:1789579264.840566:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277259264 00000100:00100000:1.0:1789579264.840591:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789579264.840598:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303441850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+13:23412:x1876509277259264:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789579264.840605:0:22674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579264.840614:0:22674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939401518200/0xd90373d592f22833 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f2282c expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579264.840629:0:22674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939401518200/0xd90373d592f22833 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f2282c expref: 14 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579264.840637:0:22674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939401518200/0xd90373d592f22833 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f2282c expref: 14 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579264.840643:0:22674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401518200, rc 0) 00000100:00100000:1.0:1789579264.840683:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303441850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+14:23412:x1876509277259264:12345-0@lo:101:mount.lustre.0 Request processed in 85us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579264.840690:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789579264.840816:0:23412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277259264:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789579264.840827:0:23412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939435d7b600/0xd90373d592f2282c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22833 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579264.840835:0:23412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939435d7b600/0xd90373d592f2282c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f22833 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789579264.840846:0:23412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789579264.840860:0:23412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939435d7b600/0xd90373d592f2282c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22833 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579264.840868:0:23412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939435d7b600/0xd90373d592f2282c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22833 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789579264.840881:0:23412:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789579264.840885:0:23412:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789579264.840889:0:23412:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93943f647000 10000000:01000000:0.0:1789579264.840892:0:23412:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789579264.840895:0:23412:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1789579264.840897:0:23412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789579264.840912:0:23412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939435d7be00/0xd90373d592f2283a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579264.840920:0:23412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939435d7be00/0xd90373d592f2283a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579264.840928:0:23412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939435d7be00/0xd90373d592f2283a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579264.840941:0:23412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277259392:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789579264.840965:0:23412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579264.840987:0:23412:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394183ca300 going to sleep for 11 seconds 00000100:00100000:1.0:1789579264.841113:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277259392 00000100:00100000:1.0:1789579264.841118:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277259392 00000100:00100000:1.0:1789579264.841160:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789579264.841167:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303442450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+14:23412:x1876509277259392:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789579264.841174:0:22674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579264.841182:0:22674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939401519200/0xd90373d592f22841 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f2283a expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579264.841196:0:22674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939401519200/0xd90373d592f22841 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f2283a expref: 15 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579264.841211:0:22674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939401519200/0xd90373d592f22841 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f2283a expref: 15 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579264.841218:0:22674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401519200, rc 0) 00000100:00100000:1.0:1789579264.841245:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303442450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+15:23412:x1876509277259392:12345-0@lo:101:mount.lustre.0 Request processed in 79us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579264.841251:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789579264.841532:0:23412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277259392:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789579264.841545:0:23412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939435d7be00/0xd90373d592f2283a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22841 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579264.841553:0:23412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939435d7be00/0xd90373d592f2283a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f22841 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789579264.843398:0:23412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:0.0:1789579264.845546:0:23412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789579264.857721:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1789579264.857788:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:1.0:1789579264.857816:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:1.0:1789579264.857832:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:1.0:1789579264.857845:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:1.0:1789579264.857857:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:1.0:1789579264.857869:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:1.0:1789579264.857880:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:1.0:1789579264.857892:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:1.0:1789579264.857905:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:1.0:1789579264.857920:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:1.0:1789579264.857935:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:1.0:1789579264.857947:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:1.0:1789579264.857960:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:1.0:1789579264.857971:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:1.0:1789579264.857982:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:1.0:1789579264.857993:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:1.0:1789579264.858004:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:1.0:1789579264.858015:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:1.0:1789579264.858026:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:1.0:1789579264.858039:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:1.0:1789579264.858052:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:1.0:1789579264.858066:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:1.0:1789579264.858093:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:1.0:1789579264.858107:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:1.0:1789579264.858121:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:1.0:1789579264.858135:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:1.0:1789579264.858150:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:1.0:1789579264.858164:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:1.0:1789579264.858178:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:1.0:1789579264.858192:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:1.0:1789579264.858204:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:1.0:1789579264.858217:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:1.0:1789579264.858230:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:1.0:1789579264.858244:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:1.0:1789579264.858256:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:1.0:1789579264.858272:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:1.0:1789579264.858285:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:1.0:1789579264.858298:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:1.0:1789579264.858312:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:1.0:1789579264.858325:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:1.0:1789579264.858338:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:1.0:1789579264.860436:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:1.0:1789579264.860492:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:1.0:1789579264.860524:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:1.0:1789579264.860530:0:23412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:1.0:1789579264.860645:0:23412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277259520:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789579264.860710:0:23412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579264.860759:0:23412:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394013776c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789579264.860870:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277259520 00000100:00100000:3.0:1789579264.860878:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277259520 00000100:00100000:3.0:1789579264.860922:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789579264.860932:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303443850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+15:23412:x1876509277259520:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789579264.861074:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303443850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+15:23412:x1876509277259520:12345-0@lo:501:mount.lustre.0 Request processed in 143us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579264.861082:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789579264.861215:0:23412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277259520:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789579264.861247:0:23412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277259648:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789579264.861289:0:23412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579264.861305:0:23412:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394013776c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789579264.861381:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277259648 00000100:00100000:2.0:1789579264.861386:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277259648 00000100:00100000:2.0:1789579264.861413:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789579264.861420:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303440450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+15:23412:x1876509277259648:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789579264.862478:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303440450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+15:23412:x1876509277259648:12345-0@lo:503:mount.lustre.0 Request processed in 1053us (1183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579264.862494:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789579264.865172:0:23412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277259648:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789579264.865868:0:23412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789579264.865951:0:23412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277259776:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789579264.866025:0:23412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579264.866107:0:23412:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405a33b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789579264.870548:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277259776 00000100:00100000:0.0:1789579264.870582:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277259776 00000100:00100000:0.0:1789579264.870893:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789579264.870905:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303442050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+15:23412:x1876509277259776:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789579264.872596:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303442050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+15:23412:x1876509277259776:12345-0@lo:502:mount.lustre.0 Request processed in 1688us (6565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579264.872608:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789579264.878974:0:23412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277259776:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789579264.879387:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1789579264.879421:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:2.0:1789579264.879435:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:2.0:1789579264.879445:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:2.0:1789579264.879456:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:2.0:1789579264.879467:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:2.0:1789579264.879489:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:2.0:1789579264.879503:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:2.0:1789579264.879515:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:2.0:1789579264.879525:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:2.0:1789579264.879538:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:2.0:1789579264.879548:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:2.0:1789579264.879558:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:2.0:1789579264.879568:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:2.0:1789579264.879578:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:2.0:1789579264.879588:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:2.0:1789579264.879598:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:2.0:1789579264.879608:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:2.0:1789579264.879618:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:2.0:1789579264.879628:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:2.0:1789579264.879638:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:2.0:1789579264.879647:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:2.0:1789579264.879657:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:2.0:1789579264.879667:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:2.0:1789579264.879678:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:2.0:1789579264.879688:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:2.0:1789579264.879698:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:2.0:1789579264.879710:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:2.0:1789579264.879720:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:2.0:1789579264.879730:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:2.0:1789579264.879752:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:2.0:1789579264.879762:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:2.0:1789579264.879787:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:2.0:1789579264.879800:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:2.0:1789579264.879823:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:2.0:1789579264.879837:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:2.0:1789579264.879850:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:2.0:1789579264.879862:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:2.0:1789579264.879874:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:2.0:1789579264.879886:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:2.0:1789579264.879896:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:2.0:1789579264.879906:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:2.0:1789579264.879917:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:2.0:1789579264.879927:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:2.0:1789579264.879965:0:23412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304887800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277259904:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789579264.880192:0:23412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579264.880295:0:23412:0:(client.c:2716:ptlrpc_set_wait()) set ffff939441b27900 going to sleep for 11 seconds 00000100:00100000:3.0:1789579264.882101:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277259904 00000100:00100000:3.0:1789579264.882114:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277259904 00000100:00100000:3.0:1789579264.882167:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789579264.882176:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303442850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+15:23412:x1876509277259904:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789579264.882642:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303442850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+15:23412:x1876509277259904:12345-0@lo:502:mount.lustre.0 Request processed in 465us (2449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579264.882650:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789579264.890151:0:23412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304887800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277259904:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789579264.890262:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:2.0:1789579264.890275:0:23412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1789579264.898158:0:23416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789579264.898173:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579264.898176:0:23416:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789579264.898184:0:23416:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1789579264.898187:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789579264.898203:0:23416:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff93943615b380) 00000020:00000080:0.0:1789579264.898223:0:23416:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1789579264.898230:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789579264.898322:0:23416:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789579264.898330:0:23416:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd90373d592f2284f 00000020:00000080:0.0:1789579264.899213:0:23416:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1789579264.899221:0:23416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789579264.899226:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579264.899228:0:23416:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789579264.899231:0:23416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789579264.899235:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579264.899237:0:23416:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1789579264.899240:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789579264.899249:0:23416:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff939410088000) 00000020:00000080:0.0:1789579264.899262:0:23416:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1789579264.899266:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789579264.899268:0:23416:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1789579264.899271:0:23416:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1789579264.899277:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789579264.899328:0:23416:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93943f647000 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1789579264.899341:0:23416:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff93941008b380) 00000020:00000080:0.0:1789579264.899802:0:23416:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1789579264.899890:0:23416:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789579264.899897:0:23416:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd90373d592f22864 00000020:00000080:0.0:1789579264.900005:0:23416:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1789579264.900013:0:23416:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789579264.900018:0:23416:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xd90373d592f2286b 00080000:01000000:0.0:1789579264.900026:0:23416:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789579264.900030:0:23416:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd90373d592f22872 00010000:00010000:2.0:1789579265.018848:0:23416:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1789579265.023637:0:23416:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:1.0:1789579265.024110:0:23416:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789579265.027270:0:23416:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1789579265.027283:0:23416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789579265.027432:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789579265.027435:0:23416:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1789579265.027440:0:23416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789579265.027447:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789579265.027448:0:23416:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1789579265.027451:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789579265.027456:0:23416:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.137@tcp to nid 0x20000c0a8cb89 (192.168.203.137@tcp) 00000020:00000080:3.0:1789579265.028508:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789579265.028528:0:23416:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9394071a3380) 00000020:00000080:3.0:1789579265.028553:0:23416:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1789579265.028560:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789579265.028674:0:23416:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1789579265.028693:0:23416:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789579265.028702:0:23416:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd90373d592f22880 00010000:00080000:3.0:1789579265.028737:0:23416:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939302084000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.137@tcp at head 00010000:00010000:3.0:1789579265.030445:0:23416:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1789579265.043424:0:23416:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789579265.043441:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789579265.043481:0:23416:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789579265.043503:0:23416:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd90373d592f22887 00000100:00080000:3.0:1789579265.043513:0:23416:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789579265.043524:0:23416:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff939302084000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789579265.043559:0:23416:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9393048ee680 x1876509277260032/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789579265.043586:0:23416:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1789579265.043639:0:23416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789579265.043644:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579265.043646:0:23416:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1789579265.043649:0:23416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789579265.043653:0:23416:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789579265.043654:0:23416:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789579265.043656:0:23416:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789579265.043657:0:23416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789579265.043666:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579265.043668:0:23416:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789579265.043671:0:23416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789579265.043676:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579265.043678:0:23416:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000100:00080000:1.0:1789579265.043914:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789579265.043919:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789579265.043922:0:8:0:(import.c:65:import_set_state_nolock()) ffff9394100ee000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789579265.043926:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 616 00000100:00080000:1.0:1789579265.043931:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789579265.043938:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9394100ee000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:1.0:1789579265.043955:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9393043ab800 x1876509277260160/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789579265.043965:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789579265.043968:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789579265.043971:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789579265.043973:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789579265.044019:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789579265.044033:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277260288:0@lo:400:kworker.0 00000100:00100000:1.0:1789579265.044099:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579265.044167:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277260288 00000100:00100000:1.0:1789579265.044175:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277260288 00000100:00100000:1.0:1789579265.044217:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789579265.044226:0:22680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277260288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579265.044275:0:22680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277260288:12345-0@lo:400:kworker.0 Request processed in 49us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579265.044282:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789579265.044316:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9393043aa680 x1876509277260288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579265.044330:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277260288:0@lo:400:kworker.0 00000020:00000080:3.0:1789579265.044537:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789579265.044585:0:23416:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789579265.044606:0:23416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789579265.044610:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579265.044611:0:23416:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1789579265.044614:0:23416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789579265.044616:0:23416:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1789579265.044617:0:23416:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789579265.044619:0:23416:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789579265.044621:0:23416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789579265.044623:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579265.044624:0:23416:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789579265.044626:0:23416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789579265.044630:0:23416:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789579265.044633:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579265.044634:0:23416:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789579265.044637:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789579265.044641:0:23416:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.137@tcp to nid 0x20000c0a8cb89 (192.168.203.137@tcp) 00000020:01000000:3.0:1789579265.044660:0:23416:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789579265.044663:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789579265.044676:0:23416:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9394071a19c0) 00000020:00000080:3.0:1789579265.044761:0:23416:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1789579265.044779:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789579265.044935:0:23416:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1789579265.044943:0:23416:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789579265.044950:0:23416:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd90373d592f22895 00010000:00080000:3.0:1789579265.044978:0:23416:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939302b56000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.137@tcp at head 00010000:00010000:3.0:1789579265.046071:0:23416:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:0.0:1789579265.046878:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277260032:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789579265.046948:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579265.047004:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277260160:0@lo:38:kworker.0 00000100:00100000:0.0:1789579265.047028:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579265.047185:0:22686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277260032 00000100:00100000:2.0:1789579265.047200:0:22686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277260032 00000100:00100000:2.0:1789579265.047223:0:22686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277260160 00000100:00100000:2.0:1789579265.047225:0:22686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277260160 00000100:00100000:2.0:1789579265.047235:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789579265.047242:0:22686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3614:x1876509277260032:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789579265.047278:0:22686:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 620 last 0 00000020:00000080:2.0:1789579265.047331:0:22686:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd90373d592f2289c 00000004:00100000:2.0:1789579265.047345:0:22686:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789579265.047368:0:22686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000040:01000000:3.0:1789579265.049507:0:23416:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789579265.049788:0:23416:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1789579265.056277:0:23416:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789579265.060988:0:22722:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394290be300 going to sleep for 0 seconds 00000040:00080000:3.0:1789579265.061504:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1789579265.064125:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1789579265.064539:0:23421:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1789579265.064545:0:23421:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789579265.065233:0:23416:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789579265.065246:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789579265.065282:0:23416:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789579265.065304:0:23416:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd90373d592f228a3 00000100:00080000:3.0:1789579265.065314:0:23416:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789579265.065325:0:23416:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff939302b56000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789579265.065393:0:23416:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9393048ef800 x1876509277260416/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789579265.065416:0:23416:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789579265.065471:0:23416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789579265.065476:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579265.065478:0:23416:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789579265.065481:0:23416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789579265.065484:0:23416:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1789579265.065485:0:23416:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789579265.065487:0:23416:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789579265.065488:0:23416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789579265.065491:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579265.065492:0:23416:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789579265.065494:0:23416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789579265.065498:0:23416:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789579265.065501:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579265.065502:0:23416:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789579265.065505:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789579265.065509:0:23416:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.137@tcp to nid 0x20000c0a8cb89 (192.168.203.137@tcp) 00000020:01000000:3.0:1789579265.065531:0:23416:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789579265.065533:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789579265.065550:0:23416:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9394071a4d40) 00000020:00000080:3.0:1789579265.065562:0:23416:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1789579265.065568:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789579265.065619:0:23416:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1789579265.065624:0:23416:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789579265.065629:0:23416:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd90373d592f228b1 00010000:00080000:3.0:1789579265.065656:0:23416:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939404134800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.137@tcp at head 00000100:00100000:0.0:1789579265.065827:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277260416:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789579265.065893:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876509277260416 offset 0 length 520: 4 00010000:00010000:3.0:1789579265.067059:0:23416:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1789579265.067135:0:23416:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789579265.067152:0:23416:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:1.0:1789579265.067491:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789579265.067497:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789579265.067500:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789579265.067503:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789579265.075235:0:22686:0:(import.c:65:import_set_state_nolock()) ffff9394069de000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789579265.075335:0:22686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3614:x1876509277260032:12345-0@lo:38:llog_process_th.0 Request processed in 28091us (28385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579265.075345:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789579265.075387:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789579265.075393:0:22686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3614:x1876509277260160:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1789579265.075438:0:22686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3614:x1876509277260160:12345-0@lo:38:kworker.0 Request processed in 44us (28408us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789579265.075444:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789579265.075864:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789579265.075875:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1789579265.075884:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789579265.075889:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789579265.075892:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939302084000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789579265.075913:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277260032:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789579265.075925:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789579265.075929:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9394100ee000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789579265.075933:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789579265.075936:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277260160:0@lo:38:kworker.0 00000100:00100000:0.0:1789579265.080469:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789579265.080500:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277260544:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789579265.080577:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579265.080741:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277260544 00000100:00100000:2.0:1789579265.080750:0:22685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277260544 00000100:00100000:2.0:1789579265.080824:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789579265.080832:0:22686:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1789579265.080833:0:22685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3616:x1876509277260544:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789579265.080840:0:22686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000004:00000024:2.0:1789579265.080868:0:22685:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789579265.080926:0:22685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3616:x1876509277260544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579265.080934:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789579265.081474:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277260544:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1789579265.083112:0:23416:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789579265.083506:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1789579265.083625:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:3.0:1789579265.084497:0:23424:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789579265.084503:0:23424:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789579265.085193:0:23416:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789579265.085207:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789579265.085248:0:23416:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789579265.085272:0:23416:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd90373d592f228b8 00000100:00080000:0.0:1789579265.085282:0:23416:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789579265.085293:0:23416:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff939404134800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:0.0:1789579265.085343:0:23416:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93930350e300 x1876509277260672/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789579265.085400:0:23416:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789579265.085455:0:23416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789579265.085459:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579265.085461:0:23416:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789579265.085464:0:23416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789579265.085468:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579265.085469:0:23416:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789579265.085472:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789579265.085473:0:23416:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789579265.085475:0:23416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789579265.085478:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579265.085479:0:23416:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789579265.085481:0:23416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789579265.085483:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579265.085484:0:23416:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789579265.085488:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789579265.085517:0:23416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789579265.085519:0:23416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579265.085520:0:23416:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789579265.085524:0:23416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:2.0:1789579265.085577:0:23412:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1789579265.085616:0:23412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789579265.085634:0:23412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939435d7be00/0xd90373d592f2283a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22841 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579265.085646:0:23412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939435d7be00/0xd90373d592f2283a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22841 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789579265.085654:0:23412:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93943f647000 from 1 10000000:01000000:2.0:1789579265.085656:0:23412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789579265.085683:0:23412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363af200/0xd90373d592f228bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579265.085691:0:23412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff9394363af200/0xd90373d592f228bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579265.085703:0:23412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff9394363af200/0xd90373d592f228bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579265.085722:0:23412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304885f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277260800:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789579265.085791:0:23412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579265.085794:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277260672:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1789579265.085851:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277260800 00000100:00100000:0.0:1789579265.085858:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277260800 00000100:00080000:1.0:1789579265.085875:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789579265.085880:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789579265.085883:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789579265.085886:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789579265.085895:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789579265.085904:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303440850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+15:23412:x1876509277260800:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789579265.085916:0:22675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579265.085928:0:22675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939435d7b200/0xd90373d592f228c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f228bf expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579265.085954:0:22675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939435d7b200/0xd90373d592f228c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f228bf expref: 16 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579265.085964:0:22675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939435d7b200/0xd90373d592f228c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f228bf expref: 16 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579265.085971:0:22675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939435d7b200, rc 0) 00000100:00100000:2.0:1789579265.086022:0:23412:0:(client.c:2716:ptlrpc_set_wait()) set ffff939441b27600 going to sleep for 11 seconds 00000400:00000100:2.0:1789579265.090579:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876509277260672 offset 0 length 520: 4 00000100:00100000:1.0:1789579265.095080:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303440850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+16:23412:x1876509277260800:12345-0@lo:101:mount.lustre.0 Request processed in 9167us (9279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579265.095093:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789579265.097012:0:23412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304885f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277260800:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789579265.097041:0:23412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff9394363af200/0xd90373d592f228bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f228c6 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.097053:0:23412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff9394363af200/0xd90373d592f228bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f228c6 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579265.097910:0:23412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277260928:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789579265.097980:0:23412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579265.098033:0:23412:0:(client.c:2716:ptlrpc_set_wait()) set ffff939409139480 going to sleep for 11 seconds 00000100:00100000:2.0:1789579265.098834:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277260928 00000100:00100000:2.0:1789579265.098844:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277260928 00000100:00100000:2.0:1789579265.098890:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789579265.098900:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303441c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+16:23412:x1876509277260928:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789579265.098921:0:22673:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789579265.098941:0:22673:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789579265.098945:0:22673:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1789579265.099058:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303441c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+16:23412:x1876509277260928:12345-0@lo:256:mount.lustre.0 Request processed in 160us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579265.099067:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789579265.099902:0:23412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277260928:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789579265.100530:0:23412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789579265.100558:0:23412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363af200/0xd90373d592f228bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f228c6 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.100570:0:23412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff9394363af200/0xd90373d592f228bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f228c6 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789579265.100578:0:23412:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93943f647000 from 1 10000000:01000000:3.0:1789579265.100581:0:23412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789579265.100613:0:23412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2ec00/0xd90373d592f228cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.100621:0:23412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939302b2ec00/0xd90373d592f228cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.100630:0:23412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939302b2ec00/0xd90373d592f228cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579265.100650:0:23412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277261056:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789579265.100883:0:23412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579265.100969:0:23412:0:(client.c:2716:ptlrpc_set_wait()) set ffff939409139480 going to sleep for 11 seconds 00000100:00100000:1.0:1789579265.107743:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277261056 00000100:00100000:1.0:1789579265.107763:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277261056 00000100:00100000:1.0:1789579265.107976:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789579265.107999:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303443050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+16:23412:x1876509277261056:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789579265.108017:0:22675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579265.108035:0:22675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939401518c00/0xd90373d592f228d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f228cd expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579265.108062:0:22675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939401518c00/0xd90373d592f228d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f228cd expref: 17 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579265.108074:0:22675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939401518c00/0xd90373d592f228d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f228cd expref: 17 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579265.108081:0:22675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401518c00, rc 0) 00000100:00100000:1.0:1789579265.108161:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303443050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+17:23412:x1876509277261056:12345-0@lo:101:mount.lustre.0 Request processed in 163us (7277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579265.108168:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789579265.108229:0:23412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277261056:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789579265.108249:0:23412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939302b2ec00/0xd90373d592f228cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f228d4 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579265.108259:0:23412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939302b2ec00/0xd90373d592f228cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f228d4 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789579265.109740:0:23412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:0.0:1789579265.110060:0:23412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789579265.110222:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1789579265.110243:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:0.0:1789579265.110261:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:0.0:1789579265.110272:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:0.0:1789579265.110282:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:0.0:1789579265.110292:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:0.0:1789579265.110430:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:0.0:1789579265.110444:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:0.0:1789579265.110455:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1789579265.110465:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:0.0:1789579265.110537:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:0.0:1789579265.110555:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:0.0:1789579265.110559:0:23412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:0.0:1789579265.110626:0:23412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277261184:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789579265.110680:0:23412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579265.110709:0:23412:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091a4480 going to sleep for 11 seconds 00000100:00100000:1.0:1789579265.115975:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277261184 00000100:00100000:1.0:1789579265.115990:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277261184 00000100:00100000:1.0:1789579265.116064:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789579265.116075:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303443c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+17:23412:x1876509277261184:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789579265.116245:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303443c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+17:23412:x1876509277261184:12345-0@lo:501:mount.lustre.0 Request processed in 172us (5563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579265.116253:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789579265.116279:0:23412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277261184:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789579265.116343:0:23412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277261312:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789579265.116429:0:23412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579265.116513:0:23412:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091a4480 going to sleep for 11 seconds 00000100:00100000:3.0:1789579265.117743:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277261312 00000100:00100000:3.0:1789579265.117754:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277261312 00000100:00100000:0.0:1789579265.117960:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789579265.117969:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393042f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+17:23412:x1876509277261312:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789579265.118103:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393042f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+17:23412:x1876509277261312:12345-0@lo:503:mount.lustre.0 Request processed in 135us (1674us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579265.118111:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789579265.118550:0:23412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277261312:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789579265.119080:0:23412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789579265.119621:0:23412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048eca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277261440:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789579265.119682:0:23412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579265.119767:0:23412:0:(client.c:2716:ptlrpc_set_wait()) set ffff939409139780 going to sleep for 11 seconds 00000100:00100000:1.0:1789579265.127290:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277261440 00000100:00100000:1.0:1789579265.127306:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277261440 00000100:00100000:1.0:1789579265.127619:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789579265.127630:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393042f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+17:23412:x1876509277261440:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789579265.128373:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393042f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+17:23412:x1876509277261440:12345-0@lo:502:mount.lustre.0 Request processed in 723us (8668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579265.128392:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789579265.128427:0:23412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048eca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277261440:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789579265.128649:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1789579265.128692:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:0.0:1789579265.128707:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:0.0:1789579265.128730:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:0.0:1789579265.128741:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:0.0:1789579265.128752:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:0.0:1789579265.128763:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:0.0:1789579265.128787:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:0.0:1789579265.128800:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1789579265.128811:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:0.0:1789579265.128845:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:0.0:1789579265.128879:0:23412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277261568:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789579265.128919:0:23412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579265.128951:0:23412:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091a4240 going to sleep for 11 seconds 00000100:00100000:1.0:1789579265.129639:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277261568 00000100:00100000:1.0:1789579265.129647:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277261568 00000100:00100000:1.0:1789579265.129688:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789579265.129696:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393042f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+17:23412:x1876509277261568:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789579265.129896:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393042f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+17:23412:x1876509277261568:12345-0@lo:502:mount.lustre.0 Request processed in 200us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579265.129903:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789579265.133650:0:23412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277261568:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789579265.133795:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:0.0:1789579265.133811:0:23412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1789579265.136094:0:23426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789579265.136106:0:23426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789579265.136108:0:23426:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789579265.136115:0:23426:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93943f647000 00000020:00000080:2.0:1789579265.136118:0:23426:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789579265.136125:0:23426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789579265.136128:0:23426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789579265.136129:0:23426:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789579265.136131:0:23426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789579265.136133:0:23426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789579265.136135:0:23426:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789579265.136138:0:23426:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93943f647000 00000020:00000080:2.0:1789579265.136140:0:23426:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789579265.136210:0:23426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789579265.136213:0:23426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789579265.136214:0:23426:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789579265.136216:0:23426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789579265.136218:0:23426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789579265.136219:0:23426:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789579265.136222:0:23426:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93943f647000 00000020:00000080:2.0:1789579265.136224:0:23426:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789579265.136239:0:23426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789579265.136241:0:23426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789579265.136242:0:23426:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789579265.136245:0:23426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789579265.136247:0:23426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789579265.136248:0:23426:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789579265.136251:0:23426:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93943f647000 00000020:00000080:2.0:1789579265.136253:0:23426:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789579265.136270:0:23426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789579265.136285:0:23426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789579265.136286:0:23426:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789579265.136289:0:23426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:3.0:1789579265.136462:0:23412:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789579265.136503:0:23412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789579265.136525:0:23412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2ec00/0xd90373d592f228cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f228d4 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.136537:0:23412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939302b2ec00/0xd90373d592f228cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f228d4 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789579265.136588:0:23412:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789579265.136590:0:23412:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93943f647000 10000000:01000000:3.0:1789579265.136593:0:23412:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93943f647000 10000000:01000000:3.0:1789579265.136597:0:23412:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789579265.136602:0:23412:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93943f647000 from 1 10000000:01000000:3.0:1789579265.136605:0:23412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789579265.136638:0:23412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2e400/0xd90373d592f228db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.136647:0:23412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939302b2e400/0xd90373d592f228db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.136658:0:23412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939302b2e400/0xd90373d592f228db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579265.136679:0:23412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277261696:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789579265.136736:0:23412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579265.136789:0:23412:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091393c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789579265.139610:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277261696 00000100:00100000:2.0:1789579265.139625:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277261696 00000100:00100000:2.0:1789579265.139679:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789579265.139689:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393042fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+17:23412:x1876509277261696:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789579265.139705:0:22675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579265.139723:0:22675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394363af600/0xd90373d592f228e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f228db expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579265.139751:0:22675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394363af600/0xd90373d592f228e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f228db expref: 18 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579265.139761:0:22675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394363af600/0xd90373d592f228e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f228db expref: 18 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579265.139778:0:22675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363af600, rc 0) 00000100:00100000:2.0:1789579265.139846:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393042fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+18:23412:x1876509277261696:12345-0@lo:101:mount.lustre.0 Request processed in 159us (3109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579265.139853:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789579265.139955:0:23412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277261696:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789579265.139973:0:23412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939302b2e400/0xd90373d592f228db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f228e2 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.139983:0:23412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939302b2e400/0xd90373d592f228db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f228e2 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789579265.148562:0:23412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:3.0:1789579265.148868:0:23412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789579265.149057:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1789579265.149081:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:3.0:1789579265.149092:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:3.0:1789579265.149104:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:3.0:1789579265.149131:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:3.0:1789579265.149144:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:3.0:1789579265.149572:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:3.0:1789579265.149584:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:3.0:1789579265.149596:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:3.0:1789579265.149608:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:3.0:1789579265.149619:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:3.0:1789579265.149630:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:3.0:1789579265.149641:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:3.0:1789579265.149653:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:3.0:1789579265.149664:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:3.0:1789579265.149676:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:3.0:1789579265.149689:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:3.0:1789579265.149703:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:3.0:1789579265.149717:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:3.0:1789579265.149732:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:3.0:1789579265.149765:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:3.0:1789579265.149798:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:3.0:1789579265.149812:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:3.0:1789579265.149825:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:3.0:1789579265.149839:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:3.0:1789579265.149851:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:3.0:1789579265.149863:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:3.0:1789579265.149877:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:3.0:1789579265.149890:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:3.0:1789579265.149917:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:3.0:1789579265.149931:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:3.0:1789579265.149945:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:3.0:1789579265.149958:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:3.0:1789579265.149971:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:3.0:1789579265.149986:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:3.0:1789579265.150000:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:3.0:1789579265.150028:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:3.0:1789579265.150045:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:3.0:1789579265.150058:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:3.0:1789579265.150072:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:3.0:1789579265.150086:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:3.0:1789579265.150100:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:3.0:1789579265.150113:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:3.0:1789579265.150126:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:3.0:1789579265.150141:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:3.0:1789579265.152502:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:3.0:1789579265.152530:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:3.0:1789579265.152546:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:3.0:1789579265.154107:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:3.0:1789579265.154280:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:3.0:1789579265.154319:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:3.0:1789579265.154325:0:23412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:3.0:1789579265.155406:0:23412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277261824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789579265.155471:0:23412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579265.155513:0:23412:0:(client.c:2716:ptlrpc_set_wait()) set ffff939409139780 going to sleep for 11 seconds 00000100:00100000:1.0:1789579265.155661:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277261824 00000100:00100000:1.0:1789579265.155669:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277261824 00000100:00100000:1.0:1789579265.155726:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789579265.155736:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393042fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+18:23412:x1876509277261824:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789579265.155874:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393042fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+18:23412:x1876509277261824:12345-0@lo:501:mount.lustre.0 Request processed in 139us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579265.155882:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789579265.159720:0:23412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277261824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789579265.159790:0:23412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277261952:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789579265.159858:0:23412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579265.159901:0:23412:0:(client.c:2716:ptlrpc_set_wait()) set ffff939409139780 going to sleep for 11 seconds 00000100:00100000:3.0:1789579265.159928:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277261952 00000100:00100000:3.0:1789579265.159934:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277261952 00000100:00100000:3.0:1789579265.159984:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789579265.159993:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393042f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+18:23412:x1876509277261952:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789579265.160097:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393042f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+18:23412:x1876509277261952:12345-0@lo:503:mount.lustre.0 Request processed in 105us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579265.160105:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789579265.160148:0:23412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277261952:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789579265.160568:0:23412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789579265.160638:0:23412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277262080:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789579265.160673:0:23412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579265.160697:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277262080 00000100:00100000:3.0:1789579265.160701:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277262080 00000100:00100000:3.0:1789579265.160719:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789579265.160725:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393042fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+18:23412:x1876509277262080:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789579265.171007:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393042fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+18:23412:x1876509277262080:12345-0@lo:502:mount.lustre.0 Request processed in 10274us (10326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579265.171023:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789579265.171100:0:23412:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091393c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789579265.171124:0:23412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277262080:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789579265.171381:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1789579265.171414:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:3.0:1789579265.171427:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:3.0:1789579265.171438:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:3.0:1789579265.171450:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:3.0:1789579265.171461:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:3.0:1789579265.171472:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:3.0:1789579265.171495:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:3.0:1789579265.171508:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:3.0:1789579265.171520:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:3.0:1789579265.171533:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:3.0:1789579265.171547:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:3.0:1789579265.171559:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:3.0:1789579265.171572:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:3.0:1789579265.171600:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:3.0:1789579265.171617:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:3.0:1789579265.171630:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:3.0:1789579265.171644:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:3.0:1789579265.171656:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:3.0:1789579265.171669:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:3.0:1789579265.171682:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:3.0:1789579265.171697:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:3.0:1789579265.171709:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:3.0:1789579265.171720:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:3.0:1789579265.171732:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:3.0:1789579265.171745:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:3.0:1789579265.171758:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:3.0:1789579265.171779:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:3.0:1789579265.171795:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:3.0:1789579265.171808:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:3.0:1789579265.171835:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:3.0:1789579265.171849:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:3.0:1789579265.171861:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:3.0:1789579265.171874:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:3.0:1789579265.171887:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:3.0:1789579265.171900:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:3.0:1789579265.171914:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:3.0:1789579265.171928:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:3.0:1789579265.171942:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:3.0:1789579265.171955:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:3.0:1789579265.171980:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:3.0:1789579265.171992:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:3.0:1789579265.172003:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:3.0:1789579265.172014:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:3.0:1789579265.172027:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:3.0:1789579265.172039:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:3.0:1789579265.172065:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:3.0:1789579265.172080:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:3.0:1789579265.172129:0:23412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277262208:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789579265.172181:0:23412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579265.172220:0:23412:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091393c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789579265.172247:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277262208 00000100:00100000:3.0:1789579265.172254:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277262208 00000100:00100000:3.0:1789579265.172294:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789579265.172301:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393042fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+18:23412:x1876509277262208:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789579265.172424:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393042fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+18:23412:x1876509277262208:12345-0@lo:502:mount.lustre.0 Request processed in 122us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579265.172431:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789579265.172479:0:23412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277262208:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789579265.172618:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:3.0:1789579265.172640:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:3.0:1789579265.172660:0:23412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277262336:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789579265.172693:0:23412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579265.172715:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277262336 00000100:00100000:3.0:1789579265.172719:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277262336 00000100:00100000:3.0:1789579265.172741:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789579265.172747:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393042f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+18:23412:x1876509277262336:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789579265.172828:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393042f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+18:23412:x1876509277262336:12345-0@lo:502:mount.lustre.0 Request processed in 80us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579265.172835:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789579265.172865:0:23412:0:(client.c:2716:ptlrpc_set_wait()) set ffff939406988000 going to sleep for 11 seconds 00000100:00100000:3.0:1789579265.172877:0:23412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277262336:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789579265.172912:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:3.0:1789579265.172919:0:23412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789579265.179659:0:23431:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1789579265.179677:0:23431:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9393037c4d40) 00000020:00000080:2.0:1789579265.179701:0:23431:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1789579265.179816:0:23431:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93943f647000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789579265.179821:0:23431:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93943f647000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789579265.179823:0:23431:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93943f647000 3 00010000:00080000:2.0:1789579265.179856:0:23431:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9394042e3000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.137@tcp at head 00010000:00010000:2.0:1789579265.181520:0:23431:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1789579265.181715:0:23431:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1789579265.181765:0:23431:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789579265.181790:0:23431:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xd90373d592f228f0 00000100:00080000:2.0:1789579265.181803:0:23431:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789579265.181817:0:23431:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9394042e3000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:2.0:1789579265.181860:0:23431:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939304885c00 x1876509277262464/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789579265.181888:0:23431:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789579265.182018:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876509277262464:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789579265.182085:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579265.182142:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277262464 00000100:00100000:3.0:1789579265.182148:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277262464 00000100:00100000:3.0:1789579265.182177:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789579265.182183:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3614:x1876509277262464:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789579265.182207:0:22682:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 620 last 0 00000020:00000080:3.0:1789579265.182240:0:22682:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xd90373d592f228f7 00000004:00100000:3.0:1789579265.182254:0:22682:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789579265.182279:0:22682:0:(import.c:65:import_set_state_nolock()) ffff93940428a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789579265.182322:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1876509277262464:12345-0@lo:38:llog_process_th.0 Request processed in 137us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579265.182328:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789579265.185132:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789579265.185141:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:2.0:1789579265.185376:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff939304885c00 x1876509277262464/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789579275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579265.185391:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789579265.185401:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1789579265.185411:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789579265.185416:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789579265.185420:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9394042e3000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789579265.185427:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876509277262464:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1789579265.185566:0:23431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:3.0:1789579265.185848:0:23412:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789579265.185878:0:23412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789579265.185895:0:23412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2e400/0xd90373d592f228db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f228e2 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.185907:0:23412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939302b2e400/0xd90373d592f228db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f228e2 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789579265.185970:0:23412:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789579265.185972:0:23412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789579265.185973:0:23412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789579265.185975:0:23412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789579265.185976:0:23412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789579265.185977:0:23412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789579265.185978:0:23412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789579265.185980:0:23412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789579265.185981:0:23412:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789579265.185985:0:23412:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1789579265.185988:0:23412:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789579265.185989:0:23412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789579265.185990:0:23412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789579265.185991:0:23412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789579265.185992:0:23412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789579265.185993:0:23412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789579265.185994:0:23412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789579265.185995:0:23412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789579265.185996:0:23412:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789579265.186019:0:23412:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1789579265.186035:0:23412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277262592:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789579265.186092:0:23412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579265.186125:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277262592 00000100:00100000:3.0:1789579265.186132:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277262592 00000100:00100000:3.0:1789579265.186181:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789579265.186189:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393042fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+18:23412:x1876509277262592:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789579265.186217:0:22674:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789579265.186231:0:22674:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1789579265.186462:0:23412:0:(client.c:2716:ptlrpc_set_wait()) set ffff939406988000 going to sleep for 11 seconds 00000100:00080000:1.0:1789579265.187236:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789579265.187244:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000001:00100000:1.0:1789579265.188788:0:22660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1789579265.192726:0:22674:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789579265.192748:0:22674:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1789579265.192839:0:22696:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789579265.192843:0:22696:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789579265.192877:0:22696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939302b2f400/0xd90373d592f228fe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.192895:0:22696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939401519400/0xd90373d592f22802 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f227fb expref: 18 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.192902:0:22696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939435d7b200/0xd90373d592f228c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f228bf expref: 18 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.192908:0:22696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff939302b2f400/0xd90373d592f228fe lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.192946:0:22696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939435d7b200/0xd90373d592f228c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f228bf expref: 18 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.192961:0:22696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939435d7b200/0xd90373d592f228c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f228bf expref: 18 pid: 22675 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579265.192973:0:22696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ee300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22696:1876509277262720:0@lo:104: 00000100:00100000:3.0:1789579265.193030:0:22696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789579265.193067:0:22696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939401519400/0xd90373d592f22802 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f227fb expref: 18 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.193074:0:22696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939401519400/0xd90373d592f22802 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f227fb expref: 18 pid: 22673 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579265.193082:0:22696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ec000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22696:1876509277262848:0@lo:104: 00000100:00100000:3.0:1789579265.193099:0:22696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579265.193112:0:22696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394069883c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789579265.199695:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277262720 00000100:00100000:3.0:1789579265.199709:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277262720 00000100:00100000:3.0:1789579265.199757:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277262848 00000100:00100000:3.0:1789579265.199760:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277262848 00000100:00100000:3.0:1789579265.199788:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789579265.199798:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39addb08-5233-4b30-82ca-229405d26fae+4:22696:x1876509277262720:12345-0@lo:104: 00010000:00010000:3.0:1789579265.199816:0:22664:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff9394363af200/0xd90373d592f228bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f228c6 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.199909:0:22664:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789579265.199915:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39addb08-5233-4b30-82ca-229405d26fae+4:22696:x1876509277262720:12345-0@lo:104: Request processed in 120us (6884us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579265.199922:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789579265.199941:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789579265.199948:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39addb08-5233-4b30-82ca-229405d26fae+3:22696:x1876509277262848:12345-0@lo:104: 00010000:00010000:3.0:1789579265.199956:0:22664:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f227fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f22802 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.199992:0:22664:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789579265.199998:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39addb08-5233-4b30-82ca-229405d26fae+3:22696:x1876509277262848:12345-0@lo:104: Request processed in 51us (6898us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579265.200003:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789579265.200066:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393042fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+18:23412:x1876509277262592:12345-0@lo:253:mount.lustre.0 Request processed in 13877us (13973us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579265.200073:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789579265.200126:0:22696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ee300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22696:1876509277262720:0@lo:104: 00000100:00100000:3.0:1789579265.200136:0:22696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ec000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22696:1876509277262848:0@lo:104: 00010000:00010000:3.0:1789579265.200170:0:22696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff939302b2f400/0xd90373d592f228fe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.200200:0:22669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789579265.200206:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff9394363af200/0xd90373d592f228bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f228c6 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.200214:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af200 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1789579265.200218:0:22669:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff9394363af200/0xd90373d592f228bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f228c6 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.200227:0:22669:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff9394363af200/0xd90373d592f228bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f228c6 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789579265.200234:0:22669:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff9394363af200/0xd90373d592f228bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f228c6 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789579265.200241:0:22669:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789579265.200274:0:22669:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff9394363af200/0xd90373d592f228bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f228c6 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.200281:0:22669:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789579265.207751:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff9394363af200/0xd90373d592f228bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f228c6 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.207766:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff9394363af200/0xd90373d592f228bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f228c6 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.207790:0:22669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789579265.207795:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f227fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f22802 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.207816:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939302b2e800 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1789579265.207821:0:22669:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f227fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f22802 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.207830:0:22669:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f227fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f22802 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789579265.207836:0:22669:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f227fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f22802 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789579265.207841:0:22669:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789579265.207875:0:22669:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f227fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f22802 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.207881:0:22669:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789579265.207908:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f227fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f22802 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.207915:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f227fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f22802 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.207928:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579265.207930:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579265.207931:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579265.207938:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579265.207965:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39addb08-5233-4b30-82ca-229405d26fae:3616:1876509277262976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789579265.208025:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579265.208081:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789579265.208089:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39addb08-5233-4b30-82ca-229405d26fae:3618:1876509277263104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789579265.208119:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579265.208382:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277262976 00000100:00100000:3.0:1789579265.208389:0:22665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277262976 00010000:00010000:3.0:1789579265.208416:0:22665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939435d7b200/0xd90373d592f228c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f228bf expref: 18 pid: 22675 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579265.208441:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277263104 00000100:00100000:3.0:1789579265.208443:0:22665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277263104 00010000:00010000:3.0:1789579265.208454:0:22665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939401519400/0xd90373d592f22802 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f227fb expref: 19 pid: 22673 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579265.208468:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789579265.208475:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39addb08-5233-4b30-82ca-229405d26fae+19:3616:x1876509277262976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789579265.208486:0:22665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789579265.208491:0:22665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939435d7b200/0xd90373d592f228c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f228bf expref: 19 pid: 22675 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.208501:0:22665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939435d7b200/0xd90373d592f228c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f228bf expref: 19 pid: 22675 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.208514:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939435d7b200/0xd90373d592f228c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f228bf expref: 19 pid: 22675 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.208526:0:22665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789579265.208561:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39addb08-5233-4b30-82ca-229405d26fae+18:3616:x1876509277262976:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579265.208568:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789579265.208583:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789579265.208589:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39addb08-5233-4b30-82ca-229405d26fae+17:3618:x1876509277263104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789579265.208605:0:22665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789579265.208610:0:22665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939401519400/0xd90373d592f22802 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f227fb expref: 17 pid: 22673 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.208619:0:22665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939401519400/0xd90373d592f22802 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f227fb expref: 17 pid: 22673 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.208629:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939401519400/0xd90373d592f22802 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f227fb expref: 17 pid: 22673 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.208639:0:22665:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff939302b2f400/0xd90373d592f228fe lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.208647:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939302b2f400/0xd90373d592f228fe lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789579265.208661:0:22665:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015818013s 00010000:00010000:3.0:1789579265.208665:0:22665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939302b2f400/0xd90373d592f228fe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.208672:0:22665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939302b2f400/0xd90373d592f228fe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.208679:0:22665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939302b2f400/0xd90373d592f228fe lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.208685:0:22665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939302b2f400/0xd90373d592f228fe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.208691:0:22665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939302b2f400 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579265.208695:0:22665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939302b2f400/0xd90373d592f228fe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.208709:0:22665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939302b2f400/0xd90373d592f228fe lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.208724:0:22665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939302b2f400/0xd90373d592f228fe lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.208734:0:22665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789579265.208762:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39addb08-5233-4b30-82ca-229405d26fae+16:3618:x1876509277263104:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579265.208779:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789579265.208819:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39addb08-5233-4b30-82ca-229405d26fae:3618:1876509277263104:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789579265.208841:0:22696:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff939302b2f400/0xd90373d592f228fe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.208849:0:22696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939302b2f400/0xd90373d592f228fe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579265.208855:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939302b2f400/0xd90373d592f228fe lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579265.208880:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39addb08-5233-4b30-82ca-229405d26fae:3616:1876509277262976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789579265.208907:0:23412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:23412:1876509277262592:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789579265.208918:0:23412:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1789579265.208921:0:23412:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789579265.208923:0:23412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789579265.208924:0:23412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789579265.208925:0:23412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789579265.208927:0:23412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789579265.208934:0:23412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789579265.208935:0:23412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789579265.208936:0:23412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789579265.208938:0:23412:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789579265.208948:0:23412:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:3.0:1789579265.228643:0:23412:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1789579265.228922:0:23438:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789579265.229156:0:23412:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:3.0:1789579265.229604:0:23438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1789579265.230270:0:23437:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1789579265.230277:0:23437:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:00080000:3.0:1789579265.238234:0:23438:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789579265.238318:0:23438:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1789579265.241921:0:23439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ed80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23439:1876509277263232:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789579265.241988:0:23439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579265.242025:0:23439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091a43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789579265.242076:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277263232 00000100:00100000:1.0:1789579265.242084:0:22685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277263232 00000100:00100000:1.0:1789579265.242125:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789579265.242133:0:22685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23439:x1876509277263232:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789579265.242226:0:22685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23439:x1876509277263232:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 94us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579265.242233:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789579265.242298:0:23439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ed80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23439:1876509277263232:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1789579265.242332:0:23439:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789579265.242525:0:23439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ed80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23439:1876509277263360:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789579265.242553:0:23439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579265.242570:0:23439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091a43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789579265.243037:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277263360 00000100:00100000:1.0:1789579265.243042:0:23423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277263360 00000100:00100000:1.0:1789579265.243068:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789579265.243074:0:23423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23439:x1876509277263360:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789579265.243292:0:23423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23439:x1876509277263360:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 217us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579265.243306:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000040:01000000:2.0:1789579265.243539:0:23412:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1789579265.243576:0:23412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789579265.244058:0:23412:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789579265.244066:0:23412:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1789579265.244102:0:23412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789579265.247466:0:23412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789579265.248102:0:23412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789579265.248133:0:23412:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1789579265.248685:0:23412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789579265.249447:0:23439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ed80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23439:1876509277263360:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789579265.249530:0:23439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ed80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23439:1876509277263488:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789579265.249593:0:23439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579265.249618:0:23439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091a4840 going to sleep for 11 seconds 00000100:00100000:3.0:1789579265.249698:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277263488 00000100:00100000:3.0:1789579265.249706:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277263488 00000100:00100000:3.0:1789579265.249745:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789579265.249754:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23439:x1876509277263488:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1789579265.249820:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23439:x1876509277263488:12345-0@lo:900:lod0001_rec0000.0 Request processed in 66us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579265.249827:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789579265.249893:0:23439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93930350ed80 x1876509277263488/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789579281 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579265.249904:0:23439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ed80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23439:1876509277263488:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789579265.249950:0:23439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ed80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23439:1876509277263616:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789579265.249975:0:23439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579265.249995:0:22686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277263616 00000100:00100000:0.0:1789579265.249998:0:22686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277263616 00000100:00100000:0.0:1789579265.250022:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789579265.250027:0:22686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23439:x1876509277263616:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789579265.250074:0:22686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23439:x1876509277263616:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 46us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579265.250080:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789579265.250096:0:23439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091a43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789579265.250106:0:23439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ed80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23439:1876509277263616:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1789579265.250143:0:23439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1789579265.253088:0:23412:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:3.0:1789579265.261617:0:23412:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000040:00080000:0.0:1789579265.262282:0:23439:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789579265.262497:0:23439:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789579265.262502:0:23439:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:3.0:1789579265.279281:0:23412:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789579265.279337:0:23412:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbd978192f988 00100000:10000000:3.0:1789579265.279346:0:23412:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1789579265.279920:0:23412:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789579265.279954:0:23412:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.137@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789579265.279975:0:23412:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789579265.279999:0:23412:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1789579265.293176:0:23412:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789579265.293590:0:23412:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789579265.767922:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579266.089313:0:22722:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394290be300 going to sleep for 0 seconds 00000040:00080000:2.0:1789579266.277725:0:23440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789579266.791093:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789579266.919691:0:22677:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789579266.919699:0:22677:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93943f647000 from 12 10000000:01000000:3.0:1789579266.919704:0:22677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789579266.919771:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f22905 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579266.919783:0:22677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f22905 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579266.919794:0:22677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f22905 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579266.919819:0:22677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277263744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789579266.919885:0:22677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579266.919934:0:22677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394071d2600 going to sleep for 11 seconds 00000100:00100000:2.0:1789579266.920481:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277263744 00000100:00100000:2.0:1789579266.920497:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277263744 00000100:00100000:2.0:1789579266.920562:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789579266.920573:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393042f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+16:22677:x1876509277263744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789579266.920824:0:22673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579266.920849:0:22673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394363aee00/0xd90373d592f2290c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f22905 expref: -99 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579266.920883:0:22673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394363aee00/0xd90373d592f2290c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f22905 expref: 17 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579266.920898:0:22673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394363aee00/0xd90373d592f2290c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f22905 expref: 17 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579266.920908:0:22673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363aee00, rc 0) 00000100:00100000:2.0:1789579266.921001:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393042f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+17:22677:x1876509277263744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 429us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579266.921010:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789579266.921290:0:22677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277263744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789579266.921312:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f22905 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f2290c expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579266.921324:0:22677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f22905 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f2290c expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579266.921424:0:22677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277263872:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789579266.921467:0:22677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579266.921507:0:22677:0:(client.c:2716:ptlrpc_set_wait()) set ffff939409505e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789579266.921545:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277263872 00000100:00100000:3.0:1789579266.921557:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277263872 00000100:00100000:3.0:1789579266.921624:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789579266.921648:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393042fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+17:22677:x1876509277263872:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789579266.921678:0:22674:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789579266.921699:0:22674:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789579266.921702:0:22674:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1789579266.921871:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393042fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+17:22677:x1876509277263872:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 229us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579266.921880:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789579266.922614:0:22677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277263872:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789579266.922688:0:22677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789579266.922700:0:22677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f22905 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f2290c expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579266.922713:0:22677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f22905 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f2290c expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789579266.922733:0:22677:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789579266.922736:0:22677:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff939435d8b800 from 12 10000000:01000000:1.0:1789579266.922740:0:22677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789579266.922783:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401519c00/0xd90373d592f22913 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579266.922792:0:22677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939401519c00/0xd90373d592f22913 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579266.922801:0:22677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939401519c00/0xd90373d592f22913 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579266.922825:0:22677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277264000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789579266.922880:0:22677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579266.922920:0:22677:0:(client.c:2716:ptlrpc_set_wait()) set ffff939409505e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789579266.923195:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277264000 00000100:00100000:2.0:1789579266.923204:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277264000 00000100:00100000:2.0:1789579266.923254:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789579266.923263:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393042f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+17:22677:x1876509277264000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789579266.923276:0:22673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579266.923299:0:22673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394363aea00/0xd90373d592f2291a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f22913 expref: -99 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579266.923325:0:22673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394363aea00/0xd90373d592f2291a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f22913 expref: 18 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579266.923346:0:22673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394363aea00/0xd90373d592f2291a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f22913 expref: 18 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579266.923377:0:22673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363aea00, rc 0) 00000100:00100000:2.0:1789579266.923425:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393042f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+18:22677:x1876509277264000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579266.923433:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789579266.925182:0:22677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277264000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789579266.925214:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939401519c00/0xd90373d592f22913 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f2291a expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579266.925229:0:22677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939401519c00/0xd90373d592f22913 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f2291a expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579266.925337:0:22677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277264128:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789579266.925426:0:22677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579266.925475:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277264128 00000100:00100000:3.0:1789579266.925481:0:22677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394071d2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789579266.925491:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277264128 00000100:00100000:0.0:1789579266.925561:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789579266.925572:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393042fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+18:22677:x1876509277264128:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789579266.925776:0:22674:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789579266.925809:0:22674:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789579266.925812:0:22674:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1789579266.925953:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393042fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+18:22677:x1876509277264128:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 381us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579266.925962:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789579266.926913:0:22677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277264128:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789579266.926980:0:22677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789579266.926989:0:22677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401519c00/0xd90373d592f22913 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f2291a expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579266.927000:0:22677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939401519c00/0xd90373d592f22913 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f2291a expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579267.107503:0:22722:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394290be300 going to sleep for 0 seconds 00000040:00080000:3.0:1789579267.301410:0:23440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789579267.814127:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579268.137829:0:22722:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394290be300 going to sleep for 0 seconds 00010000:00010000:3.0:1789579268.837876:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579269.156852:0:22722:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394290be300 going to sleep for 0 seconds 00000001:02000400:3.0:1789579269.448987:0:23682:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg337-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789579269.859702:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579270.179531:0:22722:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394290be300 going to sleep for 0 seconds 00000020:00000004:3.0:1789579270.389672:0:23734:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789579270.389916:0:23734:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:3.0:1789579270.501971:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789579270.501978:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789579270.501983:0:36:0:(import.c:65:import_set_state_nolock()) ffff9394100ee000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789579270.501999:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9394100ee000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789579270.502022:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9393048ee300 x1876509277264384/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789579270.502044:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579270.502061:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789579270.502064:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579270.502067:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789579270.502096:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579270.502099:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789579270.502102:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579270.502104:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789579270.502278:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277264384:0@lo:38:kworker.0 00000100:00100000:3.0:1789579270.502767:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579270.502853:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277264512:0@lo:400:kworker.0 00000100:00100000:3.0:1789579270.502882:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579270.502901:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789579270.502907:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277264640:0@lo:400:kworker.0 00000100:00100000:3.0:1789579270.502933:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579270.502961:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277264384 00000100:00100000:3.0:1789579270.502967:0:22685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277264384 00000100:00100000:3.0:1789579270.503034:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277264640 00000100:00100000:3.0:1789579270.503038:0:22685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277264640 00000100:00100000:3.0:1789579270.503062:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789579270.503068:0:22685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3614:x1876509277264384:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789579270.503094:0:22685:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 625 last 0 00000020:00000080:3.0:1789579270.503128:0:22685:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd90373d592f22921 00000004:00100000:3.0:1789579270.503142:0:22685:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1789579270.503150:0:22685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:1.0:1789579270.503334:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39addb08-5233-4b30-82ca-229405d26fae:3618:1876509277264256:0@lo:400:kworker.0 00000100:00100000:1.0:1789579270.503397:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579270.503425:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789579270.503430:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277264768:0@lo:400:kworker.0 00000100:00100000:1.0:1789579270.503455:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579270.503639:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277264256 00000100:00100000:3.0:1789579270.503644:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277264256 00000100:00100000:3.0:1789579270.503675:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789579270.503682:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+18:3618:x1876509277264256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579270.503742:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+18:3618:x1876509277264256:12345-0@lo:400:kworker.0 Request processed in 47us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579270.503748:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789579270.503780:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277264512 00000100:00100000:3.0:1789579270.503783:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277264512 00000100:00100000:3.0:1789579270.503805:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277264768 00000100:00100000:3.0:1789579270.503807:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277264768 00000100:00100000:3.0:1789579270.503820:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789579270.503825:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277264512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579270.503861:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277264512:12345-0@lo:400:kworker.0 Request processed in 34us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579270.503867:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789579270.503884:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789579270.503893:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277264768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579270.503928:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277264768:12345-0@lo:400:kworker.0 Request processed in 37us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579270.503933:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789579270.503974:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9393048ed180 x1876509277264512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579270.503987:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277264512:0@lo:400:kworker.0 00010000:00080000:1.0:1789579270.504207:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9393048eca80 x1876509277264768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579270.504216:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277264768:0@lo:400:kworker.0 00000100:00100000:1.0:1789579270.504224:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39addb08-5233-4b30-82ca-229405d26fae:3618:1876509277264256:0@lo:400:kworker.0 00000100:00100000:1.0:1789579270.507426:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789579270.507446:0:22686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277264640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579270.507541:0:22686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277264640:12345-0@lo:400:kworker.0 Request processed in 102us (4607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579270.507547:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789579270.507645:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277264640:0@lo:400:kworker.0 00000100:00100000:1.0:1789579270.510946:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277264896:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789579270.511019:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579270.511093:0:22686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277264896 00000100:00100000:0.0:1789579270.511101:0:22686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277264896 00000100:00100000:0.0:1789579270.511157:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789579270.511166:0:22686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277264896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789579270.511207:0:22686:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789579270.516568:0:22686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277264896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5393us (5539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579270.516581:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789579270.523155:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277264896:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1789579270.525614:0:22685:0:(import.c:65:import_set_state_nolock()) ffff939404212000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789579270.525720:0:22685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3614:x1876509277264384:12345-0@lo:38:kworker.0 Request processed in 22649us (22952us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579270.525740:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1789579270.525792:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1789579270.525803:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1789579270.525809:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789579270.525812:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9394100ee000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1789579270.525836:0:3614:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000703e96af): req@ffff939304886680 x1876509277257472/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579270.525858:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277264384:0@lo:38:kworker.0 00000100:00100000:3.0:1789579270.527486:0:22722:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579270.527522:0:22722:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394290be300 going to sleep for 11 seconds 00000100:00100000:3.0:1789579270.527536:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789579270.527548:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277265024:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789579270.527568:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579270.537459:0:22686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277257472 00000100:00100000:0.0:1789579270.537473:0:22686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277257472 00000100:00100000:0.0:1789579270.537511:0:22686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277265024 00000100:00100000:0.0:1789579270.537515:0:22686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277265024 00000100:00100000:0.0:1789579270.537533:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789579270.537542:0:22686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22722:x1876509277257472:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789579270.537657:0:22686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22722:x1876509277257472:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 115us (10173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579270.537664:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789579270.537682:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789579270.537688:0:22686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3616:x1876509277265024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789579270.537710:0:22686:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789579270.537760:0:22686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3616:x1876509277265024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (10191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579270.537776:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789579270.537880:0:22722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304886680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22722:1876509277257472:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1789579270.537929:0:22722:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789579270.537972:0:22722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22722:1876509277265152:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789579270.538013:0:22722:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579270.538052:0:22722:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394071d23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789579270.538080:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277265024:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789579270.538103:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277265152 00000100:00100000:3.0:1789579270.538106:0:22685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277265152 00000100:00100000:3.0:1789579270.538125:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789579270.538131:0:22685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22722:x1876509277265152:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789579270.538235:0:22685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22722:x1876509277265152:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 104us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579270.538242:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789579270.538263:0:22722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22722:1876509277265152:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789579270.538333:0:22722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22722:1876509277265280:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789579270.538389:0:22722:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579270.538400:0:22722:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394071d23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789579270.538430:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277265280 00000100:00100000:3.0:1789579270.538434:0:22685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277265280 00000100:00100000:3.0:1789579270.538451:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789579270.538456:0:22685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22722:x1876509277265280:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789579270.538503:0:22685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22722:x1876509277265280:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 46us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579270.538509:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789579270.538531:0:22722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22722:1876509277265280:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1789579270.538567:0:22722:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789579270.540645:0:22722:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789579270.540727:0:22722:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:3.0:1789579270.546096:0:22722:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1789579270.886788:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789579271.261948:0:23784:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789579271.267743:0:23784:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789579271.911854:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789579272.440870:0:23833:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd37c6ba40 20000000:00000080:0.0:1789579272.440890:0:23833:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff939431996000 uarg=0000000000000000 20000000:01000000:0.0:1789579272.440933:0:23833:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789579272.440939:0:23833:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789579272.440945:0:23833:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789579272.453413:0:23834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1789579272.453853:0:23833:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789579272.467119:0:23833:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789579272.471832:0:23833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939435d7a800/0xd90373d592f22928 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579272.471858:0:23833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9394363aec00/0xd90373d592f227d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f227ca expref: 17 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579272.471866:0:23833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939401518c00/0xd90373d592f228d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f228cd expref: 17 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579272.471874:0:23833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff939435d7a800/0xd90373d592f22928 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579272.471916:0:23833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939401518c00/0xd90373d592f228d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f228cd expref: 17 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579272.471932:0:23833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939401518c00/0xd90373d592f228d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f228cd expref: 17 pid: 22675 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579272.471947:0:23833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23833:1876509277265408:0@lo:104: 00000100:00100000:0.0:1789579272.472012:0:23833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579272.472618:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277265408 00000100:00100000:3.0:1789579272.472626:0:22663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277265408 00010000:00010000:0.0:1789579272.472761:0:23833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9394363aec00/0xd90373d592f227d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f227ca expref: 17 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579272.472789:0:23833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9394363aec00/0xd90373d592f227d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f227ca expref: 17 pid: 22675 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579272.472799:0:23833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23833:1876509277265536:0@lo:104: 00000100:00100000:0.0:1789579272.472831:0:23833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579272.476146:0:23833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091a4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789579272.481020:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277265536 00000100:00100000:3.0:1789579272.481035:0:22663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277265536 00000100:00100000:2.0:1789579272.481669:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789579272.481679:0:22663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39addb08-5233-4b30-82ca-229405d26fae+4:23833:x1876509277265408:12345-0@lo:104: 00010000:00010000:2.0:1789579272.481699:0:22663:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939302b2ec00/0xd90373d592f228cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f228d4 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579272.481865:0:22663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789579272.481871:0:23833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23833:1876509277265408:0@lo:104: 00000100:00100000:2.0:1789579272.481874:0:22663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39addb08-5233-4b30-82ca-229405d26fae+4:23833:x1876509277265408:12345-0@lo:104: Request processed in 195us (9862us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579272.481886:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789579272.481906:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789579272.481926:0:22663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39addb08-5233-4b30-82ca-229405d26fae+3:23833:x1876509277265536:12345-0@lo:104: 00010000:00010000:2.0:1789579272.481935:0:22663:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939302b2e600/0xd90373d592f227ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f227d1 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579272.482012:0:22668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1789579272.482020:0:23833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23833:1876509277265536:0@lo:104: 00010000:00010000:3.0:1789579272.482022:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939302b2ec00/0xd90373d592f228cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f228d4 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579272.482032:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939302b2ec00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1789579272.482036:0:22668:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939302b2ec00/0xd90373d592f228cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f228d4 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579272.482045:0:22668:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939302b2ec00/0xd90373d592f228cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f228d4 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789579272.482060:0:22668:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939302b2ec00/0xd90373d592f228cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f228d4 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579272.482063:0:23833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff939435d7a800/0xd90373d592f22928 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789579272.482069:0:22668:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789579272.482109:0:22668:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939302b2ec00/0xd90373d592f228cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f228d4 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579272.482116:0:22668:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789579272.482145:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939302b2ec00/0xd90373d592f228cd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f228d4 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579272.482153:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939302b2ec00/0xd90373d592f228cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f228d4 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579272.482166:0:22668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789579272.482169:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939302b2e600/0xd90373d592f227ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f227d1 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579272.482174:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939302b2e600 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1789579272.482177:0:22668:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939302b2e600/0xd90373d592f227ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f227d1 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579272.482184:0:22668:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939302b2e600/0xd90373d592f227ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f227d1 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789579272.482191:0:22668:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939302b2e600/0xd90373d592f227ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f227d1 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789579272.482196:0:22668:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789579272.482221:0:22668:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939302b2e600/0xd90373d592f227ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f227d1 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579272.482227:0:22668:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789579272.482246:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939302b2e600/0xd90373d592f227ca lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f227d1 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579272.482253:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939302b2e600/0xd90373d592f227ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f227d1 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579272.482265:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579272.482267:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579272.482269:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579272.482284:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789579272.482297:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39addb08-5233-4b30-82ca-229405d26fae:3615:1876509277265664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789579272.482336:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579272.482410:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277265664 00000100:00100000:3.0:1789579272.482415:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277265664 00010000:00010000:3.0:1789579272.482434:0:22666:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939401518c00/0xd90373d592f228d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f228cd expref: 18 pid: 22675 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579272.482454:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789579272.482539:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304398a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39addb08-5233-4b30-82ca-229405d26fae+18:3615:x1876509277265664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789579272.482550:0:22666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789579272.482555:0:22666:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939401518c00/0xd90373d592f228d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f228cd expref: 18 pid: 22675 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579272.482566:0:22666:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939401518c00/0xd90373d592f228d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f228cd expref: 18 pid: 22675 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579272.482579:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939401518c00/0xd90373d592f228d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f228cd expref: 18 pid: 22675 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579272.482598:0:22666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789579272.482618:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39addb08-5233-4b30-82ca-229405d26fae:3617:1876509277265792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789579272.482632:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304398a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39addb08-5233-4b30-82ca-229405d26fae+17:3615:x1876509277265664:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579272.482639:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789579272.482653:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579272.482698:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277265792 00000100:00100000:3.0:1789579272.482702:0:22667:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277265792 00010000:00010000:3.0:1789579272.482727:0:22667:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9394363aec00/0xd90373d592f227d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f227ca expref: 17 pid: 22675 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579272.482753:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789579272.482759:0:22667:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39addb08-5233-4b30-82ca-229405d26fae+17:3617:x1876509277265792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789579272.482766:0:22667:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789579272.482770:0:22667:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9394363aec00/0xd90373d592f227d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f227ca expref: 17 pid: 22675 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579272.482777:0:22667:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9394363aec00/0xd90373d592f227d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f227ca expref: 17 pid: 22675 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579272.482788:0:22667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394363aec00/0xd90373d592f227d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f227ca expref: 17 pid: 22675 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579272.482798:0:22667:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff939435d7a800/0xd90373d592f22928 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579272.482805:0:22667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939435d7a800/0xd90373d592f22928 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579272.482819:0:22667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939435d7a800/0xd90373d592f22928 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579272.482835:0:22667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939435d7a800/0xd90373d592f22928 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579272.482842:0:22667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939435d7a800/0xd90373d592f22928 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579272.482848:0:22667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939435d7a800/0xd90373d592f22928 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579272.482854:0:22667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939435d7a800 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579272.482858:0:22667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939435d7a800/0xd90373d592f22928 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579272.482865:0:22667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939435d7a800/0xd90373d592f22928 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579272.482883:0:22667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939435d7a800/0xd90373d592f22928 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579272.482893:0:22667:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789579272.482921:0:22667:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39addb08-5233-4b30-82ca-229405d26fae+16:3617:x1876509277265792:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579272.482927:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789579272.482953:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39addb08-5233-4b30-82ca-229405d26fae:3615:1876509277265664:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789579272.483016:0:22663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1789579272.483024:0:22663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39addb08-5233-4b30-82ca-229405d26fae+3:23833:x1876509277265536:12345-0@lo:104: Request processed in 1098us (10192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579272.483030:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1789579272.483083:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579272.483679:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39addb08-5233-4b30-82ca-229405d26fae:3617:1876509277265792:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789579272.483708:0:23833:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff939435d7a800/0xd90373d592f22928 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579272.483729:0:23833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939435d7a800/0xd90373d592f22928 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579272.483736:0:23833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939435d7a800/0xd90373d592f22928 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579272.931549:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789579273.251973:0:22718:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789579273.956293:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789579274.275820:0:22677:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789579274.275827:0:22677:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93943f647000 from 13 10000000:01000000:3.0:1789579274.275849:0:22677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789579274.275896:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2e600/0xd90373d592f2292f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579274.275909:0:22677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939302b2e600/0xd90373d592f2292f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579274.275921:0:22677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939302b2e600/0xd90373d592f2292f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579274.275947:0:22677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277265920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789579274.276016:0:22677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579274.276061:0:22677:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408f64540 going to sleep for 11 seconds 00000100:00100000:0.0:1789579274.276123:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277265920 00000100:00100000:0.0:1789579274.276132:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277265920 00000100:00100000:0.0:1789579274.276197:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789579274.276213:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+16:22677:x1876509277265920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789579274.276228:0:22674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579274.276241:0:22674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939435d7ac00/0xd90373d592f22936 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f2292f expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579274.276265:0:22674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939435d7ac00/0xd90373d592f22936 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f2292f expref: 17 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579274.276277:0:22674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939435d7ac00/0xd90373d592f22936 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f2292f expref: 17 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579274.276286:0:22674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939435d7ac00, rc 0) 00000100:00100000:0.0:1789579274.276371:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+17:22677:x1876509277265920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579274.276378:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789579274.276522:0:22677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277265920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789579274.276538:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939302b2e600/0xd90373d592f2292f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22936 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579274.276547:0:22677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939302b2e600/0xd90373d592f2292f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f22936 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579274.276615:0:22677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304884700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277266048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789579274.276641:0:22677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579274.276673:0:22677:0:(client.c:2716:ptlrpc_set_wait()) set ffff939403defc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789579274.276731:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277266048 00000100:00100000:0.0:1789579274.276735:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277266048 00000100:00100000:0.0:1789579274.276766:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789579274.276774:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939436de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+17:22677:x1876509277266048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789579274.276883:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939436de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+17:22677:x1876509277266048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579274.276890:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789579274.276927:0:22677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304884700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277266048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789579274.276957:0:22677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277266176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789579274.276998:0:22677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579274.277012:0:22677:0:(client.c:2716:ptlrpc_set_wait()) set ffff93940844a600 going to sleep for 11 seconds 00000100:00100000:0.0:1789579274.277024:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277266176 00000100:00100000:0.0:1789579274.277033:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277266176 00000100:00100000:0.0:1789579274.277057:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789579274.277067:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939436de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+17:22677:x1876509277266176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789579274.277152:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939436de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+17:22677:x1876509277266176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579274.277161:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789579274.277205:0:22677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277266176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789579274.277907:0:23912:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789579274.277964:0:22677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789579274.277985:0:22677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789579274.277993:0:22677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2e600/0xd90373d592f2292f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22936 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579274.278003:0:22677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939302b2e600/0xd90373d592f2292f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22936 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789579274.278013:0:22677:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789579274.278015:0:22677:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff939435d8b800 from 13 10000000:01000000:0.0:1789579274.278017:0:22677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789579274.278041:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939435d7a000/0xd90373d592f2293d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579274.278049:0:22677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939435d7a000/0xd90373d592f2293d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579274.278057:0:22677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939435d7a000/0xd90373d592f2293d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579274.278072:0:22677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277266304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789579274.278115:0:22677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579274.278139:0:22677:0:(client.c:2716:ptlrpc_set_wait()) set ffff93940844a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789579274.278152:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277266304 00000100:00100000:0.0:1789579274.278156:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277266304 00000100:00100000:0.0:1789579274.278179:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789579274.278185:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939436de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+17:22677:x1876509277266304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789579274.278194:0:22673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579274.278205:0:22673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939435d7b000/0xd90373d592f22944 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f2293d expref: -99 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579274.278222:0:22673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939435d7b000/0xd90373d592f22944 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f2293d expref: 18 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579274.278232:0:22673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939435d7b000/0xd90373d592f22944 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f2293d expref: 18 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579274.278240:0:22673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939435d7b000, rc 0) 00000100:00100000:0.0:1789579274.278269:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939436de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+18:22677:x1876509277266304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579274.278275:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789579274.278308:0:22677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277266304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789579274.285929:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939435d7a000/0xd90373d592f2293d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22944 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579274.285949:0:22677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939435d7a000/0xd90373d592f2293d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f22944 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579274.286051:0:22677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277266432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789579274.286129:0:22677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579274.288803:0:22677:0:(client.c:2716:ptlrpc_set_wait()) set ffff93940844a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789579274.292959:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277266432 00000100:00100000:1.0:1789579274.292973:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277266432 00000100:00100000:1.0:1789579274.293042:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789579274.293053:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939436de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+18:22677:x1876509277266432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789579274.293858:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939436de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+18:22677:x1876509277266432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 805us (7727us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579274.293867:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789579274.294494:0:22677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277266432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789579274.294551:0:22677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277266560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789579274.294602:0:22677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579274.294634:0:22677:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408f64900 going to sleep for 11 seconds 00000100:00100000:3.0:1789579274.294652:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277266560 00000100:00100000:3.0:1789579274.294657:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277266560 00000100:00100000:3.0:1789579274.294692:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789579274.294713:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939436de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+18:22677:x1876509277266560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789579274.294818:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939436de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+18:22677:x1876509277266560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579274.294825:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789579274.294868:0:22677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277266560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789579274.297540:0:23914:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789579274.297605:0:22677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789579274.297638:0:22677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789579274.297649:0:22677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939435d7a000/0xd90373d592f2293d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22944 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579274.297660:0:22677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939435d7a000/0xd90373d592f2293d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22944 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579274.979888:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579275.620106:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789579265/real 1789579265] req@ffff93930350e300 x1876509277260672/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579275 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579275.620133:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93930350e300 x1876509277260672/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579275 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579275.620145:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789579265/real 1789579265] req@ffff9393048ef800 x1876509277260416/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579275 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579275.620155:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9393048ef800 x1876509277260416/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579275 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789579275.620179:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939404134800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789579275.620206:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789579275.620210:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277260672:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789579275.620215:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939302b56000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789579275.620268:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789579275.620272:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277260416:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789579275.620501:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579275.620506:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789579275.620508:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579275.620511:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789579275.620523:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579275.620526:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789579275.620528:0:36:0:(import.c:65:import_set_state_nolock()) ffff939302b56000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789579275.620532:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 620 00000100:00080000:3.0:1789579275.620548:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789579275.620558:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff939302b56000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789579275.620576:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93930439aa00 x1876509277267200/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789579275.620589:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579275.620591:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789579275.620593:0:36:0:(import.c:65:import_set_state_nolock()) ffff939404134800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789579275.620595:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 620 00000100:00080000:3.0:1789579275.620598:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789579275.620610:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff939404134800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789579275.620621:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939304399c00 x1876509277267328/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789579275.620673:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39addb08-5233-4b30-82ca-229405d26fae:3618:1876509277266688:0@lo:400:kworker.0 00000100:00100000:3.0:1789579275.620740:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579275.620772:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277267456:0@lo:400:kworker.0 00000100:00100000:3.0:1789579275.620797:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579275.620816:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789579275.620822:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277267072:0@lo:400:kworker.0 00000100:00100000:3.0:1789579275.623785:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579275.623928:0:22686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277267072 00000100:00100000:1.0:1789579275.623937:0:22686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277267072 00000100:00100000:1.0:1789579275.623990:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789579275.624000:0:22686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277267072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579275.624064:0:22686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277267072:12345-0@lo:400:kworker.0 Request processed in 66us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579275.624071:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789579275.624143:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277266816:0@lo:400:kworker.0 00000100:00100000:3.0:1789579275.624178:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579275.624206:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277267584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789579275.624225:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579275.624246:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789579275.624252:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277266944:0@lo:400:kworker.0 00000100:00100000:3.0:1789579275.624274:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579275.624291:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277267712:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789579275.624311:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579275.624335:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277266688 00000100:00100000:3.0:1789579275.624339:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277266688 00000100:00100000:3.0:1789579275.624489:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789579275.624496:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939436de0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+18:3618:x1876509277266688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579275.624545:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939436de0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+18:3618:x1876509277266688:12345-0@lo:400:kworker.0 Request processed in 49us (3804us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579275.624564:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789579275.624594:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277267456 00000100:00100000:3.0:1789579275.624598:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277267456 00000100:00100000:3.0:1789579275.624623:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277266944 00000100:00100000:3.0:1789579275.624626:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277266944 00000100:00100000:3.0:1789579275.624639:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789579275.624645:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277267456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579275.624677:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277267456:12345-0@lo:400:kworker.0 Request processed in 31us (3878us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579275.624682:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789579275.624709:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789579275.624714:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277266944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579275.624744:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277266944:12345-0@lo:400:kworker.0 Request processed in 30us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579275.624750:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789579275.624819:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93930439b480 x1876509277266944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579275.624834:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277266944:0@lo:400:kworker.0 00000100:00100000:1.0:1789579275.625213:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277266816 00000100:00100000:1.0:1789579275.625219:0:22685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277266816 00000100:00100000:1.0:1789579275.625248:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277267584 00000100:00100000:1.0:1789579275.625251:0:22685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277267584 00000100:00100000:1.0:1789579275.625261:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277267712 00000100:00100000:1.0:1789579275.625263:0:22685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277267712 00000100:00100000:1.0:1789579275.625274:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789579275.625280:0:22685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3615:x1876509277266816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579275.625322:0:22685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3615:x1876509277266816:12345-0@lo:400:kworker.0 Request processed in 41us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579275.625328:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789579275.625341:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789579275.625346:0:22685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3615:x1876509277267584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789579275.625385:0:22685:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789579275.625421:0:22685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3615:x1876509277267584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579275.625426:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789579275.625438:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789579275.625443:0:22685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277267712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789579275.625458:0:22685:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789579275.625520:0:22685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277267712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579275.625526:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000001:00100000:1.0:1789579275.625950:0:23413:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789579275.626210:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277267712:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789579275.626222:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277266816:0@lo:400:kworker.0 00000100:00100000:3.0:1789579275.626233:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277267584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789579275.626288:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277267200:0@lo:8:kworker.0 00000400:00000100:3.0:1789579275.626320:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876509277267200 offset 0 length 520: 4 00000100:00100000:3.0:1789579275.626371:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277267328:0@lo:8:kworker.0 00000400:00000100:3.0:1789579275.626390:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876509277267328 offset 0 length 520: 4 00000100:00100000:3.0:1789579275.626427:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277267072:0@lo:400:kworker.0 00000100:00100000:3.0:1789579275.626439:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39addb08-5233-4b30-82ca-229405d26fae:3618:1876509277266688:0@lo:400:kworker.0 00010000:00080000:3.0:1789579275.626451:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93930439a300 x1876509277267456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579275.626461:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277267456:0@lo:400:kworker.0 00010000:00010000:3.0:1789579276.007303:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579276.644003:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789579261/real 1789579261] req@ffff9393048ec380 x1876509277258496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579276 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579276.644036:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9393048ec380 x1876509277258496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579276 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579276.644046:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789579261/real 1789579261] req@ffff9393048ece00 x1876509277258624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579276 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579276.644059:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9393048ece00 x1876509277258624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579276 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789579276.644078:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939436233000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789579276.644110:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789579276.644115:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277258496:0@lo:8:kworker.0 00000100:00080000:2.0:1789579276.644121:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939302b53800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789579276.644126:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789579276.644129:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277258624:0@lo:8:kworker.0 00000100:00080000:3.0:1789579276.644414:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579276.644419:0:14907:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789579276.644422:0:14907:0:(import.c:65:import_set_state_nolock()) ffff939436233000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789579276.644434:0:14907:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 616 00000100:00080000:3.0:1789579276.644440:0:14907:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789579276.644450:0:14907:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff939436233000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789579276.644475:0:14907:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9393048ec000 x1876509277268096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789579276.644492:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579276.644495:0:14907:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789579276.644496:0:14907:0:(import.c:65:import_set_state_nolock()) ffff939302b53800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789579276.644500:0:14907:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 616 00000100:00080000:3.0:1789579276.644502:0:14907:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789579276.644506:0:14907:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff939302b53800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789579276.644529:0:14907:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9393048eca80 x1876509277268224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789579276.644572:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579276.644576:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789579276.644578:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579276.644581:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789579276.644604:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277268352:0@lo:400:kworker.0 00000100:00100000:3.0:1789579276.644666:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579276.644709:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789579276.644715:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277268480:0@lo:400:kworker.0 00000100:00100000:3.0:1789579276.644738:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579276.644769:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277268352 00000100:00100000:3.0:1789579276.644776:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277268352 00000100:00100000:2.0:1789579276.644982:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277267968:0@lo:400:kworker.0 00000100:00100000:2.0:1789579276.645017:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579276.645037:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789579276.645042:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39addb08-5233-4b30-82ca-229405d26fae:3618:1876509277267840:0@lo:400:kworker.0 00000100:00100000:2.0:1789579276.645064:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579276.645088:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277268608:0@lo:400:kworker.0 00000100:00100000:2.0:1789579276.645121:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579276.645148:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277268096:0@lo:8:kworker.0 00000400:00000100:2.0:1789579276.645167:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876509277268096 offset 0 length 520: 4 00000100:00100000:2.0:1789579276.645178:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277268224:0@lo:8:kworker.0 00000400:00000100:2.0:1789579276.645193:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876509277268224 offset 0 length 520: 4 00000100:00100000:3.0:1789579276.645436:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277268608 00000100:00100000:3.0:1789579276.645440:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277268608 00000100:00100000:3.0:1789579276.645458:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789579276.645466:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277268352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579276.645585:0:22686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277268480 00000100:00100000:2.0:1789579276.645590:0:22686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277268480 00000100:00100000:2.0:1789579276.645616:0:22686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277267968 00000100:00100000:2.0:1789579276.645619:0:22686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277267968 00000100:00100000:2.0:1789579276.645633:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789579276.645638:0:22686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277268480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579276.645672:0:22686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277268480:12345-0@lo:400:kworker.0 Request processed in 33us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579276.645678:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789579276.645704:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789579276.645710:0:22686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277267968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579276.645741:0:22686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277267968:12345-0@lo:400:kworker.0 Request processed in 32us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579276.645747:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789579276.645766:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277267840 00000100:00100000:2.0:1789579276.645776:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277267840 00000100:00100000:2.0:1789579276.645802:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789579276.645808:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939436de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+18:3618:x1876509277267840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579276.645838:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939436de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+18:3618:x1876509277267840:12345-0@lo:400:kworker.0 Request processed in 30us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579276.645842:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789579276.645873:0:22680:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789579276.645881:0:22680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789579276.645909:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39addb08-5233-4b30-82ca-229405d26fae:3618:1876509277267840:0@lo:400:kworker.0 00000100:00100000:2.0:1789579276.645920:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277267968:0@lo:400:kworker.0 00000100:00100000:2.0:1789579276.646022:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789579276.646029:0:22680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277268608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579276.646061:0:22680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277268608:12345-0@lo:400:kworker.0 Request processed in 33us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579276.646066:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789579276.646090:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9393048ec380 x1876509277268608/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579276.646100:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277268608:0@lo:400:kworker.0 00000100:00100000:3.0:1789579276.647545:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277268352:12345-0@lo:400:kworker.0 Request processed in 2072us (2872us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579276.647557:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789579276.647621:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277268480:0@lo:400:kworker.0 00010000:00080000:3.0:1789579276.647635:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9393048ed180 x1876509277268352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579276.647644:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277268352:0@lo:400:kworker.0 00010000:00010000:0.0:1789579277.035056:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789579277.548262:0:23440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789579278.051476:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789579278.983250:0:24182:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789579278.983256:0:24182:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789579278.983258:0:24182:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789579278.983439:0:24182:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff939403daf000 00000020:01000004:3.0:1789579278.983460:0:24182:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789579278.983478:0:24182:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789579278.983495:0:24182:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9394071a0000) 00000020:00000080:3.0:1789579278.983518:0:24182:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789579279.078244:0:24182:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00010000:00010000:0.0:1789579279.078567:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1789579279.081583:0:24182:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789579279.082384:0:24182:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789579279.082638:0:24182:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789579279.083024:0:24182:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1789579279.083281:0:24182:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1789579279.083629:0:24182:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:2.0:1789579279.084630:0:24182:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789579279.085020:0:24182:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789579279.085040:0:24182:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789579279.085059:0:24182:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd90373d592f22952 00000020:01000004:2.0:1789579279.085069:0:24182:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789579279.085095:0:24182:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.137@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789579279.085100:0:24182:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.137@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789579279.085107:0:24182:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789579279.085113:0:24182:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789579279.085128:0:24182:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9393037c0000) 00000020:00000080:2.0:1789579279.085142:0:24182:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1789579279.089899:0:24182:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789579279.090171:0:24182:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789579279.091952:0:24182:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789579279.092986:0:24182:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789579279.092997:0:24182:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789579279.093774:0:24182:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1789579279.093785:0:24182:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789579279.096069:0:24182:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789579279.100997:0:24182:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789579279.101006:0:24182:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789579279.101819:0:24182:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789579279.101828:0:24182:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789579279.133549:0:24182:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789579279.134785:0:24182:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789579279.134795:0:24182:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789579279.136463:0:24182:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789579279.136477:0:24182:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789579279.140469:0:24182:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789579279.140484:0:24182:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789579279.143021:0:24182:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789579279.143341:0:24182:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789579279.143408:0:24182:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789579279.144325:0:24182:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789579279.144333:0:24182:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1789579279.208372:0:24182:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789579279.209720:0:24182:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1789579279.209730:0:24182:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789579279.217619:0:24182:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789579279.217639:0:24182:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789579279.218927:0:24182:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789579279.218959:0:24182:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1789579279.218965:0:24182:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.137@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789579279.239754:0:24182:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.137@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789579279.239799:0:24182:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.137@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1789579279.239803:0:24182:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789579279.239805:0:24182:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789579279.239806:0:24182:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789579279.239807:0:24182:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789579279.239808:0:24182:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789579279.239810:0:24182:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789579279.239811:0:24182:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789579279.239813:0:24182:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789579279.239814:0:24182:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789579279.239818:0:24182:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1789579279.239820:0:24182:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789579279.239821:0:24182:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789579279.239822:0:24182:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789579279.239823:0:24182:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789579279.239824:0:24182:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789579279.239826:0:24182:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789579279.239827:0:24182:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789579279.239828:0:24182:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789579279.239829:0:24182:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789579279.239853:0:24182:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789579279.239873:0:24182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277268736:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789579279.239940:0:24182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579279.240038:0:24182:0:(client.c:2716:ptlrpc_set_wait()) set ffff93940844a300 going to sleep for 11 seconds 00000100:00100000:0.0:1789579279.245848:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277268736 00000100:00100000:0.0:1789579279.245863:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277268736 00000100:00100000:0.0:1789579279.245931:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789579279.245941:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394360e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+18:24182:x1876509277268736:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789579279.245975:0:22673:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789579279.245978:0:22673:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1789579279.245982:0:22673:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789579279.249921:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394360e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+18:24182:x1876509277268736:12345-0@lo:253:mount.lustre.0 Request processed in 3970us (9968us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579279.249936:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789579279.251173:0:24182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277268736:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789579279.251336:0:24182:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789579279.251339:0:24182:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789579279.251341:0:24182:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789579279.251342:0:24182:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789579279.251344:0:24182:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789579279.251345:0:24182:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789579279.251347:0:24182:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789579279.251364:0:24182:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789579279.251374:0:24182:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789579279.251376:0:24182:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789579279.251424:0:24182:0:(tgt_mount.c:101:server_register_mount()) register mount ffff939403daf000 from lustre-OST0000 10000000:01000000:3.0:1789579279.251454:0:24182:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789579279.251457:0:24182:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789579279.251464:0:24182:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff939405a9b380 local copy 00010000:00010000:3.0:1789579279.251476:0:24182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f2270d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22714 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579279.251831:0:24182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277268864:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789579279.251882:0:24182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579279.252063:0:24182:0:(client.c:2716:ptlrpc_set_wait()) set ffff93940844a600 going to sleep for 11 seconds 00000100:00100000:0.0:1789579279.252219:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277268864 00000100:00100000:0.0:1789579279.252227:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277268864 00000100:00100000:0.0:1789579279.252277:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789579279.252286:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394360eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+18:24182:x1876509277268864:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789579279.252387:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394360eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+18:24182:x1876509277268864:12345-0@lo:501:mount.lustre.0 Request processed in 102us (504us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789579279.252395:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789579279.252433:0:24182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277268864:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789579279.252449:0:24182:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.137@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789579279.252468:0:24182:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.137@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789579279.252475:0:24182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f2270d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22714 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579279.252486:0:24182:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f2270d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22714 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789579279.252525:0:24182:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff939403daf000 10000000:01000000:3.0:1789579279.252530:0:24182:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789579279.252535:0:24182:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789579279.252538:0:24182:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789579279.252552:0:24182:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789579279.252555:0:24182:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789579279.252579:0:24182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f22960 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579279.252587:0:24182:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f22960 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579279.252597:0:24182:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f22960 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579279.252610:0:24182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277268992:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789579279.252637:0:24182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579279.252673:0:24182:0:(client.c:2716:ptlrpc_set_wait()) set ffff93940844a600 going to sleep for 11 seconds 00000100:00100000:2.0:1789579279.253278:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277268992 00000100:00100000:2.0:1789579279.253285:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277268992 00000100:00100000:2.0:1789579279.253332:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789579279.253340:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394360e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+18:24182:x1876509277268992:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789579279.253372:0:22674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579279.253387:0:22674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394363af400/0xd90373d592f22967 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f22960 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579279.253424:0:22674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394363af400/0xd90373d592f22967 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f22960 expref: 19 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579279.253435:0:22674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394363af400/0xd90373d592f22967 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f22960 expref: 19 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579279.253443:0:22674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363af400, rc 0) 00000100:00100000:2.0:1789579279.253484:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394360e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+19:24182:x1876509277268992:12345-0@lo:101:mount.lustre.0 Request processed in 145us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579279.253490:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789579279.253505:0:24182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277268992:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789579279.253519:0:24182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f22960 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22967 expref: -99 pid: 24182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579279.253528:0:24182:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f22960 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f22967 expref: -99 pid: 24182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789579279.255472:0:24182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1789579279.255970:0:24182:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789579279.259276:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1789579279.259334:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1789579279.259472:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1789579279.259493:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1789579279.259507:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1789579279.259520:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1789579279.259533:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1789579279.259548:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1789579279.259563:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1789579279.259576:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1789579279.259589:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1789579279.259601:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1789579279.259648:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1789579279.259655:0:24182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1789579279.259776:0:24182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304884700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277269120:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789579279.259847:0:24182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579279.259881:0:24182:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091b0900 going to sleep for 11 seconds 00000100:00100000:0.0:1789579279.260017:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277269120 00000100:00100000:0.0:1789579279.260025:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277269120 00000100:00100000:0.0:1789579279.260081:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789579279.260091:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394360e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+19:24182:x1876509277269120:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789579279.260256:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394360e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+19:24182:x1876509277269120:12345-0@lo:501:mount.lustre.0 Request processed in 166us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579279.260264:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789579279.260457:0:24182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304884700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277269120:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789579279.260491:0:24182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304884700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277269248:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789579279.260530:0:24182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579279.260547:0:24182:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091b0900 going to sleep for 11 seconds 00000100:00100000:0.0:1789579279.260596:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277269248 00000100:00100000:0.0:1789579279.260601:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277269248 00000100:00100000:0.0:1789579279.260632:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789579279.260640:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394360e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+19:24182:x1876509277269248:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789579279.261328:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394360e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+19:24182:x1876509277269248:12345-0@lo:503:mount.lustre.0 Request processed in 687us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579279.261336:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789579279.261590:0:24182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304884700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277269248:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789579279.262008:0:24182:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789579279.262083:0:24182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304884700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277269376:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789579279.262130:0:24182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579279.262222:0:24182:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091b0900 going to sleep for 11 seconds 00000100:00100000:3.0:1789579279.262502:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277269376 00000100:00100000:3.0:1789579279.262509:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277269376 00000100:00100000:3.0:1789579279.262551:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789579279.262560:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394360eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+19:24182:x1876509277269376:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789579279.262997:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394360eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+19:24182:x1876509277269376:12345-0@lo:502:mount.lustre.0 Request processed in 437us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579279.263005:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789579279.263090:0:24182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304884700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277269376:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789579279.263275:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1789579279.263304:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1789579279.263320:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1789579279.263332:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1789579279.263346:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1789579279.263383:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1789579279.263398:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1789579279.263411:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1789579279.263426:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:2.0:1789579279.263440:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:2.0:1789579279.263452:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:2.0:1789579279.263464:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:2.0:1789579279.263491:0:24182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304884700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277269504:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789579279.263532:0:24182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579279.263569:0:24182:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091b0900 going to sleep for 11 seconds 00000100:00100000:0.0:1789579279.263624:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277269504 00000100:00100000:0.0:1789579279.263630:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277269504 00000100:00100000:0.0:1789579279.263675:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789579279.263683:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394360ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+19:24182:x1876509277269504:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789579279.263774:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394360ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+19:24182:x1876509277269504:12345-0@lo:502:mount.lustre.0 Request processed in 92us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579279.263781:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789579279.263874:0:24182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304884700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277269504:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789579279.263917:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:3.0:1789579279.263933:0:24182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1789579279.264704:0:24199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789579279.264711:0:24199:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1789579279.264718:0:24199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579279.264721:0:24199:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789579279.264726:0:24199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789579279.264742:0:24199:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9393020dcd40) 00000020:00000080:3.0:1789579279.264773:0:24199:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789579279.264780:0:24199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789579279.264845:0:24199:0:(tgt_mount.c:153:server_get_mount()) get mount ffff939403daf000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789579279.264854:0:24199:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789579279.264861:0:24199:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd90373d592f22975 00010000:00010000:3.0:1789579279.268853:0:24199:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1789579279.269484:0:24199:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:3.0:1789579279.271019:0:24199:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1789579279.272398:0:24199:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789579279.272408:0:24199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789579279.272414:0:24199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579279.272416:0:24199:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789579279.272420:0:24199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789579279.272422:0:24199:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1789579279.272424:0:24199:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789579279.272426:0:24199:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789579279.272427:0:24199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789579279.272429:0:24199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579279.272431:0:24199:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789579279.272433:0:24199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789579279.272436:0:24199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579279.272437:0:24199:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789579279.272440:0:24199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789579279.272442:0:24199:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789579279.272444:0:24199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789579279.272446:0:24199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579279.272454:0:24199:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789579279.272459:0:24199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789579279.272461:0:24199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579279.272463:0:24199:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789579279.272466:0:24199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789579279.272490:0:24199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789579279.272493:0:24199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579279.272495:0:24199:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789579279.272498:0:24199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:0.0:1789579279.274287:0:24182:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1789579279.274328:0:24182:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789579279.274412:0:24182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f22960 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22967 expref: -99 pid: 24182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579279.274425:0:24182:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f22960 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22967 expref: -99 pid: 24182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789579279.274432:0:24182:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff939403daf000 from 1 10000000:01000000:0.0:1789579279.274435:0:24182:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789579279.274477:0:24182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939435d7ae00/0xd90373d592f2297c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579279.274486:0:24182:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939435d7ae00/0xd90373d592f2297c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579279.274496:0:24182:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939435d7ae00/0xd90373d592f2297c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579279.274521:0:24182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277269632:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789579279.274585:0:24182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579279.274633:0:24182:0:(client.c:2716:ptlrpc_set_wait()) set ffff93943b607c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789579279.275337:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277269632 00000100:00100000:2.0:1789579279.275346:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277269632 00000100:00100000:2.0:1789579279.275413:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789579279.275421:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+19:24182:x1876509277269632:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789579279.275435:0:22675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579279.275448:0:22675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394363afc00/0xd90373d592f22983 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f2297c expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579279.275473:0:22675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394363afc00/0xd90373d592f22983 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f2297c expref: 20 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579279.275484:0:22675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394363afc00/0xd90373d592f22983 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f2297c expref: 20 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579279.275492:0:22675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363afc00, rc 0) 00000100:00100000:2.0:1789579279.275532:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+20:24182:x1876509277269632:12345-0@lo:101:mount.lustre.0 Request processed in 112us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579279.275538:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789579279.275795:0:24182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277269632:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789579279.275811:0:24182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939435d7ae00/0xd90373d592f2297c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22983 expref: -99 pid: 24182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579279.275821:0:24182:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939435d7ae00/0xd90373d592f2297c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f22983 expref: -99 pid: 24182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789579279.281600:0:24182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1789579279.281889:0:24182:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789579279.282066:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1789579279.282091:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1789579279.282103:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1789579279.282116:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1789579279.282129:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1789579279.282142:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1789579279.282154:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1789579279.282167:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1789579279.282202:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1789579279.282218:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1789579279.282229:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1789579279.282247:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1789579279.282252:0:24182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1789579279.282330:0:24182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304886680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277269760:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789579279.282421:0:24182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579279.282456:0:24182:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091b0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789579279.282647:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277269760 00000100:00100000:0.0:1789579279.282655:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277269760 00000100:00100000:0.0:1789579279.282709:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789579279.282719:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+20:24182:x1876509277269760:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789579279.282823:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+20:24182:x1876509277269760:12345-0@lo:501:mount.lustre.0 Request processed in 105us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579279.282831:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789579279.282969:0:24182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304886680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277269760:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789579279.283007:0:24182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304886680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277269888:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789579279.283044:0:24182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579279.283100:0:24182:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091b0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789579279.283784:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277269888 00000100:00100000:0.0:1789579279.283791:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277269888 00000100:00100000:0.0:1789579279.283856:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789579279.283872:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+20:24182:x1876509277269888:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789579279.284019:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+20:24182:x1876509277269888:12345-0@lo:503:mount.lustre.0 Request processed in 148us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579279.284027:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789579279.284091:0:24182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304886680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277269888:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789579279.284603:0:24182:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789579279.284682:0:24182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277270016:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789579279.284727:0:24182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579279.284757:0:24182:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303bec900 going to sleep for 11 seconds 00000100:00100000:2.0:1789579279.284823:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277270016 00000100:00100000:2.0:1789579279.284828:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277270016 00000100:00100000:2.0:1789579279.284863:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789579279.284871:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+20:24182:x1876509277270016:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789579279.284957:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+20:24182:x1876509277270016:12345-0@lo:502:mount.lustre.0 Request processed in 86us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579279.284964:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789579279.285062:0:24182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277270016:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789579279.285271:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1789579279.285297:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1789579279.285310:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1789579279.285322:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1789579279.285335:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1789579279.285376:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1789579279.285395:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1789579279.285410:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1789579279.285440:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1789579279.285457:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1789579279.285471:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1789579279.285494:0:24182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277270144:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789579279.285529:0:24182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579279.285554:0:24182:0:(client.c:2716:ptlrpc_set_wait()) set ffff93940832ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1789579279.285657:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277270144 00000100:00100000:2.0:1789579279.285672:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277270144 00000100:00100000:2.0:1789579279.285694:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789579279.285700:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+20:24182:x1876509277270144:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789579279.285772:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+20:24182:x1876509277270144:12345-0@lo:502:mount.lustre.0 Request processed in 71us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579279.285779:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789579279.288607:0:24182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277270144:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789579279.288733:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1789579279.288749:0:24182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789579279.289705:0:24203:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789579279.289724:0:24203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789579279.289726:0:24203:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789579279.289733:0:24203:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff939403daf000 00000020:00000080:1.0:1789579279.289736:0:24203:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789579279.289744:0:24203:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789579279.289746:0:24203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789579279.289748:0:24203:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789579279.289750:0:24203:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789579279.289753:0:24203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789579279.289754:0:24203:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789579279.289757:0:24203:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff939403daf000 00000020:00000080:1.0:1789579279.289759:0:24203:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789579279.289817:0:24203:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789579279.289821:0:24203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789579279.289823:0:24203:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789579279.289825:0:24203:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789579279.289828:0:24203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789579279.289829:0:24203:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789579279.289833:0:24203:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff939403daf000 00000020:00000080:1.0:1789579279.289835:0:24203:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789579279.289853:0:24203:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789579279.289856:0:24203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789579279.289857:0:24203:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789579279.289860:0:24203:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789579279.289862:0:24203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789579279.289863:0:24203:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789579279.289866:0:24203:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff939403daf000 00000020:00000080:1.0:1789579279.289868:0:24203:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789579279.289889:0:24203:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789579279.289897:0:24203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789579279.289899:0:24203:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789579279.289901:0:24203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1789579279.290045:0:24182:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789579279.290070:0:24182:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789579279.290094:0:24182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939435d7ae00/0xd90373d592f2297c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22983 expref: -99 pid: 24182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579279.290106:0:24182:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939435d7ae00/0xd90373d592f2297c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22983 expref: -99 pid: 24182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789579279.290159:0:24182:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789579279.290162:0:24182:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff939403daf000 10000000:01000000:0.0:1789579279.290166:0:24182:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff939403daf000 10000000:01000000:0.0:1789579279.290170:0:24182:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789579279.290175:0:24182:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff939403daf000 from 1 10000000:01000000:0.0:1789579279.290178:0:24182:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789579279.290221:0:24182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939435d7a200/0xd90373d592f2298a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579279.290230:0:24182:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939435d7a200/0xd90373d592f2298a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579279.290241:0:24182:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939435d7a200/0xd90373d592f2298a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579279.290264:0:24182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277270272:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789579279.290328:0:24182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579279.290409:0:24182:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394095053c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789579279.292314:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277270272 00000100:00100000:2.0:1789579279.292326:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277270272 00000100:00100000:2.0:1789579279.292407:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789579279.292418:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+20:24182:x1876509277270272:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789579279.292433:0:22675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579279.292456:0:22675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394363aec00/0xd90373d592f22991 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f2298a expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579279.292485:0:22675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394363aec00/0xd90373d592f22991 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f2298a expref: 21 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579279.292495:0:22675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394363aec00/0xd90373d592f22991 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f2298a expref: 21 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579279.292504:0:22675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363aec00, rc 0) 00000100:00100000:2.0:1789579279.292566:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+21:24182:x1876509277270272:12345-0@lo:101:mount.lustre.0 Request processed in 150us (2237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579279.292573:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789579279.292858:0:24182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277270272:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789579279.292877:0:24182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939435d7a200/0xd90373d592f2298a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22991 expref: -99 pid: 24182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579279.292886:0:24182:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939435d7a200/0xd90373d592f2298a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f22991 expref: -99 pid: 24182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789579279.296661:0:24182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1789579279.296936:0:24182:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789579279.297148:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1789579279.297172:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1789579279.297184:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1789579279.299288:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1789579279.299339:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1789579279.299381:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1789579279.299398:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1789579279.299412:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1789579279.299427:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1789579279.299441:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1789579279.299456:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1789579279.299487:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1789579279.299500:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1789579279.299513:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1789579279.299526:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1789579279.299539:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1789579279.299553:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1789579279.299566:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1789579279.299579:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1789579279.299592:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1789579279.299607:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1789579279.299620:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1789579279.299646:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1789579279.299673:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1789579279.299691:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1789579279.299704:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1789579279.299717:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1789579279.299745:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1789579279.299762:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1789579279.299774:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1789579279.299786:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1789579279.299798:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1789579279.299810:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1789579279.299824:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1789579279.299838:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1789579279.299861:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1789579279.299876:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1789579279.299889:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1789579279.299903:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1789579279.299918:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1789579279.299930:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1789579279.299943:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1789579279.299956:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1789579279.299983:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1789579279.299999:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1789579279.300013:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1789579279.300027:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1789579279.300043:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1789579279.300196:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1789579279.300219:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1789579279.300236:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1789579279.300242:0:24182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1789579279.300342:0:24182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277270400:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789579279.300431:0:24182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579279.300484:0:24182:0:(client.c:2716:ptlrpc_set_wait()) set ffff939409505540 going to sleep for 11 seconds 00000100:00100000:1.0:1789579279.304822:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277270400 00000100:00100000:1.0:1789579279.304838:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277270400 00000100:00100000:1.0:1789579279.304900:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789579279.304911:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+21:24182:x1876509277270400:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789579279.306188:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+21:24182:x1876509277270400:12345-0@lo:501:mount.lustre.0 Request processed in 1274us (5751us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579279.306211:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789579279.311301:0:24182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277270400:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789579279.311378:0:24182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277270528:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789579279.311442:0:24182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579279.311478:0:24182:0:(client.c:2716:ptlrpc_set_wait()) set ffff939409505540 going to sleep for 11 seconds 00000100:00100000:0.0:1789579279.312426:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277270528 00000100:00100000:0.0:1789579279.312437:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277270528 00000100:00100000:0.0:1789579279.312486:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789579279.312495:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+21:24182:x1876509277270528:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789579279.312654:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+21:24182:x1876509277270528:12345-0@lo:503:mount.lustre.0 Request processed in 159us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579279.312661:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789579279.312733:0:24182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277270528:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789579279.313928:0:24182:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789579279.314104:0:24182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277270656:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789579279.316079:0:24182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579279.316140:0:24182:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394095053c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789579279.316226:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277270656 00000100:00100000:3.0:1789579279.316235:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277270656 00000100:00100000:3.0:1789579279.316277:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789579279.316286:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+21:24182:x1876509277270656:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789579279.316437:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+21:24182:x1876509277270656:12345-0@lo:502:mount.lustre.0 Request processed in 151us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579279.316446:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789579279.316810:0:24182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277270656:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789579279.318157:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1789579279.318483:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1789579279.318503:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1789579279.318519:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1789579279.318553:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1789579279.318570:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1789579279.318586:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1789579279.318615:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1789579279.319770:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1789579279.319786:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1789579279.319800:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1789579279.319814:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1789579279.319827:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1789579279.319841:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1789579279.319856:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1789579279.319869:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1789579279.319882:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1789579279.319894:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1789579279.319906:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1789579279.319918:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1789579279.321052:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1789579279.321090:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1789579279.321106:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1789579279.321135:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1789579279.321151:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1789579279.321168:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1789579279.321187:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1789579279.321541:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1789579279.321554:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1789579279.321565:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1789579279.321575:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1789579279.321585:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1789579279.321608:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1789579279.322050:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1789579279.322071:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1789579279.322082:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1789579279.322106:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1789579279.322274:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1789579279.322291:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1789579279.322302:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1789579279.322420:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1789579279.322442:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1789579279.322453:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1789579279.322464:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1789579279.322474:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1789579279.322485:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1789579279.322495:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1789579279.322505:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1789579279.322556:0:24182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277270784:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789579279.323101:0:24182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579279.323177:0:24182:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394095053c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789579279.330113:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277270784 00000100:00100000:2.0:1789579279.330128:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277270784 00000100:00100000:2.0:1789579279.330492:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789579279.330504:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+21:24182:x1876509277270784:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789579279.330700:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+21:24182:x1876509277270784:12345-0@lo:502:mount.lustre.0 Request processed in 199us (7600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579279.330707:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789579279.331017:0:24182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277270784:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789579279.331243:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1789579279.331273:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1789579279.331318:0:24182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277270912:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789579279.331390:0:24182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579279.331423:0:24182:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394095053c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789579279.331503:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277270912 00000100:00100000:2.0:1789579279.331509:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277270912 00000100:00100000:2.0:1789579279.331546:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789579279.331553:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+21:24182:x1876509277270912:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789579279.331653:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+21:24182:x1876509277270912:12345-0@lo:502:mount.lustre.0 Request processed in 99us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579279.331660:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789579279.331677:0:24182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277270912:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789579279.331725:0:24182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1789579279.331732:0:24182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789579279.332300:0:24209:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789579279.332320:0:24209:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9393037c3380) 00000020:00000080:2.0:1789579279.332341:0:24209:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1789579279.332447:0:24209:0:(tgt_mount.c:153:server_get_mount()) get mount ffff939403daf000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789579279.332451:0:24209:0:(tgt_mount.c:187:server_put_mount()) put mount ffff939403daf000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789579279.332454:0:24209:0:(obd_mount.c:710:lustre_put_lsi()) put ffff939403daf000 3 00010000:00080000:2.0:1789579279.332491:0:24209:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9393010c2000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.137@tcp at head 00010000:00010000:2.0:1789579279.339606:0:24209:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1789579279.339860:0:24209:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789579279.339908:0:24209:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789579279.339921:0:24209:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xd90373d592f2299f 00000100:00080000:2.0:1789579279.339933:0:24209:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789579279.339944:0:24209:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9393010c2000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:2.0:1789579279.339985:0:24209:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939304885c00 x1876509277271040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789579279.340025:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3614:1876509277271040:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789579279.340087:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789579279.340144:0:24209:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789579279.343480:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277271040 00000100:00100000:0.0:1789579279.343497:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277271040 00000100:00100000:0.0:1789579279.343535:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789579279.343544:0:22680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3614:x1876509277271040:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789579279.343574:0:22680:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 634 last 0 00000020:00000080:0.0:1789579279.343761:0:22680:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xd90373d592f229a6 00000004:00100000:0.0:1789579279.343779:0:22680:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789579279.343815:0:22680:0:(import.c:65:import_set_state_nolock()) ffff9393038bb000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789579279.343920:0:22680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1876509277271040:12345-0@lo:38:llog_process_th.0 Request processed in 364us (3821us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579279.343929:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1789579279.343989:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789579279.343993:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789579279.343996:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789579279.343999:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789579279.344023:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789579279.344026:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789579279.344028:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789579279.344031:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789579279.344061:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277271168:0@lo:400:kworker.0 00000100:00100000:0.0:1789579279.344095:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579279.344237:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789579279.344244:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277271552:0@lo:400:kworker.0 00000100:00100000:0.0:1789579279.344272:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579279.344309:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277271296:0@lo:400:kworker.0 00000100:00100000:0.0:1789579279.344331:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579279.344347:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789579279.344371:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277271424:0@lo:400:kworker.0 00000100:00100000:0.0:1789579279.344392:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579279.344426:0:22686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277271168 00000100:00100000:0.0:1789579279.344431:0:22686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277271168 00000100:00100000:0.0:1789579279.344456:0:22686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277271424 00000100:00100000:0.0:1789579279.344466:0:22686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277271424 00000100:00100000:0.0:1789579279.344485:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789579279.344491:0:22686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277271168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579279.344532:0:22686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277271168:12345-0@lo:400:kworker.0 Request processed in 40us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579279.344537:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789579279.344549:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789579279.344554:0:22686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277271424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579279.344581:0:22686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277271424:12345-0@lo:400:kworker.0 Request processed in 27us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579279.344586:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789579279.344857:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277271552 00000100:00100000:0.0:1789579279.344863:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277271552 00000100:00100000:0.0:1789579279.344887:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277271296 00000100:00100000:0.0:1789579279.344890:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277271296 00000100:00100000:0.0:1789579279.344901:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789579279.344967:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277271552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579279.345000:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277271552:12345-0@lo:400:kworker.0 Request processed in 93us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579279.345007:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789579279.345019:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789579279.345025:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277271296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579279.345051:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277271296:12345-0@lo:400:kworker.0 Request processed in 26us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579279.345057:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789579279.345100:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277271424:0@lo:400:kworker.0 00010000:00080000:0.0:1789579279.345807:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93930350fb80 x1876509277271296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579279.345820:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277271296:0@lo:400:kworker.0 00010000:00080000:0.0:1789579279.345861:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff939304885c00 x1876509277271040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789579289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579279.345869:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789579279.345877:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1789579279.345884:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789579279.345889:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789579279.345892:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9393010c2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789579279.345897:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3614:1876509277271040:0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789579279.345923:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93930350e300 x1876509277271552/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579279.345932:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277271552:0@lo:400:kworker.0 00000100:00100000:0.0:1789579279.345942:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277271168:0@lo:400:kworker.0 00000020:01000004:1.0:1789579279.346510:0:24209:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789579279.346526:0:24209:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff93943bb3b380) 00000020:00000080:1.0:1789579279.346548:0:24209:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1789579279.346992:0:24209:0:(tgt_mount.c:153:server_get_mount()) get mount ffff939403daf000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789579279.346997:0:24209:0:(tgt_mount.c:187:server_put_mount()) put mount ffff939403daf000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789579279.346999:0:24209:0:(obd_mount.c:710:lustre_put_lsi()) put ffff939403daf000 3 00010000:00080000:1.0:1789579279.347029:0:24209:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939304a4b000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.137@tcp at head 00010000:00010000:1.0:1789579279.354306:0:24209:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1789579279.354521:0:24209:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1789579279.354566:0:24209:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789579279.354593:0:24209:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xd90373d592f229b4 00000100:00080000:1.0:1789579279.354603:0:24209:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789579279.354614:0:24209:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff939304a4b000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:1.0:1789579279.355816:0:24209:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9393043ab100 x1876509277271680/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789579279.355847:0:24209:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1789579279.356426:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3614:1876509277271680:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789579279.356497:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579279.356753:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277271680 00000100:00100000:1.0:1789579279.356762:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277271680 00000100:00100000:1.0:1789579279.356806:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789579279.356821:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3614:x1876509277271680:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789579279.356851:0:22682:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 634 last 0 00000020:00000080:1.0:1789579279.356898:0:22682:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xd90373d592f229bb 00000004:00100000:1.0:1789579279.356913:0:22682:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789579279.356944:0:22682:0:(import.c:65:import_set_state_nolock()) ffff93930407b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789579279.357000:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1876509277271680:12345-0@lo:38:llog_process_th.0 Request processed in 179us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579279.357010:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789579279.357054:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9393043ab100 x1876509277271680/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789579289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579279.357065:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789579279.357073:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1789579279.357081:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789579279.357086:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789579279.357088:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939304a4b000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789579279.357095:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3614:1876509277271680:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789579279.357391:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789579279.357397:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789579279.357399:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789579279.357402:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789579279.357406:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789579279.357409:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789579279.357417:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789579279.357420:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1789579279.358087:0:24209:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1789579279.360440:0:24182:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789579279.360484:0:24182:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789579279.360504:0:24182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939435d7a200/0xd90373d592f2298a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22991 expref: -99 pid: 24182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579279.360515:0:24182:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939435d7a200/0xd90373d592f2298a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22991 expref: -99 pid: 24182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789579279.360572:0:24182:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789579279.360574:0:24182:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789579279.360576:0:24182:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789579279.360577:0:24182:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789579279.360578:0:24182:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789579279.360579:0:24182:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789579279.360581:0:24182:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789579279.360583:0:24182:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789579279.360584:0:24182:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789579279.360588:0:24182:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1789579279.360590:0:24182:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789579279.360592:0:24182:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789579279.360593:0:24182:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789579279.360594:0:24182:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789579279.360595:0:24182:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789579279.360596:0:24182:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789579279.360597:0:24182:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789579279.360598:0:24182:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789579279.360599:0:24182:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789579279.360625:0:24182:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789579279.360643:0:24182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277271808:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789579279.360720:0:24182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579279.360757:0:24182:0:(client.c:2716:ptlrpc_set_wait()) set ffff93942ef58480 going to sleep for 11 seconds 00000100:00100000:2.0:1789579279.365560:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277271808 00000100:00100000:2.0:1789579279.365573:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277271808 00000100:00100000:2.0:1789579279.365633:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789579279.365642:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+21:24182:x1876509277271808:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789579279.365686:0:22674:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789579279.365700:0:22674:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789579279.371954:0:22674:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789579279.371978:0:22674:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789579279.372454:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+21:24182:x1876509277271808:12345-0@lo:253:mount.lustre.0 Request processed in 6809us (11729us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579279.372465:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789579279.372468:0:24182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:24182:1876509277271808:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789579279.372482:0:24182:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789579279.372485:0:24182:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789579279.372486:0:24182:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789579279.372487:0:24182:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789579279.372489:0:24182:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789579279.372490:0:24182:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789579279.372491:0:24182:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789579279.372492:0:24182:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789579279.372494:0:24182:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789579279.372495:0:24182:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789579279.372513:0:24182:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1789579279.372722:0:22696:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789579279.372727:0:22696:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789579279.372749:0:22696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939435d7bc00/0xd90373d592f229c2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579279.372764:0:22696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9394363aee00/0xd90373d592f2290c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f22905 expref: 20 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579279.372773:0:22696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9394363aea00/0xd90373d592f2291a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f22913 expref: 20 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579279.372780:0:22696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff939435d7bc00/0xd90373d592f229c2 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579279.372818:0:22696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9394363aea00/0xd90373d592f2291a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f22913 expref: 20 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579279.372835:0:22696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9394363aea00/0xd90373d592f2291a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f22913 expref: 20 pid: 22673 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579279.372848:0:22696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22696:1876509277271936:0@lo:104: 00000100:00100000:0.0:1789579279.372889:0:22696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789579279.372946:0:22696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9394363aee00/0xd90373d592f2290c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f22905 expref: 20 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579279.372956:0:22696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9394363aee00/0xd90373d592f2290c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f22905 expref: 20 pid: 22673 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579279.372978:0:22696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22696:1876509277272064:0@lo:104: 00000100:00100000:0.0:1789579279.373011:0:22696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579279.373031:0:22696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394095053c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789579279.373059:0:22663:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789579279.373074:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277271936 00000100:00100000:0.0:1789579279.373080:0:22663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277271936 00000100:00100000:0.0:1789579279.373104:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277272064 00000100:00100000:0.0:1789579279.373106:0:22663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277272064 00000100:00100000:0.0:1789579279.373120:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789579279.373127:0:22663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39addb08-5233-4b30-82ca-229405d26fae+4:22696:x1876509277271936:12345-0@lo:104: 00010000:00010000:0.0:1789579279.373139:0:22663:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939401519c00/0xd90373d592f22913 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f2291a expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579279.373204:0:22663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789579279.373210:0:22663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39addb08-5233-4b30-82ca-229405d26fae+4:22696:x1876509277271936:12345-0@lo:104: Request processed in 84us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579279.373217:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789579279.373231:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789579279.373237:0:22663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942ead1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39addb08-5233-4b30-82ca-229405d26fae+3:22696:x1876509277272064:12345-0@lo:104: 00010000:00010000:0.0:1789579279.373245:0:22663:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f22905 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f2290c expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579279.373278:0:22663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789579279.373283:0:22663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942ead1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39addb08-5233-4b30-82ca-229405d26fae+3:22696:x1876509277272064:12345-0@lo:104: Request processed in 47us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579279.373288:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789579279.373323:0:22669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789579279.373335:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939401519c00/0xd90373d592f22913 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f2291a expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579279.373343:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401519c00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:0.0:1789579279.373347:0:22669:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939401519c00/0xd90373d592f22913 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f2291a expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579279.373374:0:22669:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939401519c00/0xd90373d592f22913 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f2291a expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789579279.373381:0:22669:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939401519c00/0xd90373d592f22913 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f2291a expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789579279.373387:0:22669:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789579279.373417:0:22669:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939401519c00/0xd90373d592f22913 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f2291a expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579279.373424:0:22669:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789579279.373452:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939401519c00/0xd90373d592f22913 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f2291a expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579279.373459:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939401519c00/0xd90373d592f22913 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f2291a expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579279.373470:0:22669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789579279.373474:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f22905 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f2290c expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579279.373479:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939302b2f400 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:0.0:1789579279.373483:0:22669:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f22905 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f2290c expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579279.373485:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39addb08-5233-4b30-82ca-229405d26fae:3618:1876509277272192:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789579279.373505:0:22669:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f22905 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f2290c expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789579279.373512:0:22669:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f22905 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f2290c expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789579279.373518:0:22669:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1789579279.373523:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789579279.373535:0:22669:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f22905 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f2290c expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579279.373543:0:22669:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789579279.373563:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f22905 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f2290c expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579279.373571:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1789579279.373572:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f22905 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f2290c expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579279.373583:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39addb08-5233-4b30-82ca-229405d26fae:3616:1876509277272320:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789579279.373588:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579279.373591:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579279.373594:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579279.373602:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579279.373615:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579279.373647:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277272192 00000100:00100000:2.0:1789579279.373652:0:22667:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277272192 00010000:00010000:2.0:1789579279.373681:0:22667:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9394363aea00/0xd90373d592f2291a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f22913 expref: 21 pid: 22673 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579279.373700:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277272320 00000100:00100000:2.0:1789579279.373703:0:22667:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277272320 00010000:00010000:2.0:1789579279.373911:0:22667:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9394363aee00/0xd90373d592f2290c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f22905 expref: 22 pid: 22673 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579279.373928:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789579279.373935:0:22667:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304887800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39addb08-5233-4b30-82ca-229405d26fae+22:3618:x1876509277272192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789579279.373945:0:22667:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579279.373949:0:22667:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9394363aea00/0xd90373d592f2291a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f22913 expref: 22 pid: 22673 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579279.373960:0:22667:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9394363aea00/0xd90373d592f2291a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f22913 expref: 22 pid: 22673 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579279.373973:0:22667:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789579279.374049:0:22667:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304887800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39addb08-5233-4b30-82ca-229405d26fae+22:3618:x1876509277272192:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579279.374057:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789579279.374071:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789579279.374078:0:22667:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393037ca050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39addb08-5233-4b30-82ca-229405d26fae+21:3616:x1876509277272320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789579279.374111:0:22667:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579279.374116:0:22667:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9394363aee00/0xd90373d592f2290c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f22905 expref: 21 pid: 22673 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579279.374125:0:22667:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9394363aee00/0xd90373d592f2290c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f22905 expref: 21 pid: 22673 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579279.374138:0:22667:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff939435d7bc00/0xd90373d592f229c2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579279.374147:0:22667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939435d7bc00/0xd90373d592f229c2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789579279.374169:0:22667:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015818013s 00010000:00010000:2.0:1789579279.374174:0:22667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939435d7bc00/0xd90373d592f229c2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579279.374181:0:22667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939435d7bc00/0xd90373d592f229c2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579279.374188:0:22667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939435d7bc00/0xd90373d592f229c2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579279.374203:0:22667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939435d7bc00/0xd90373d592f229c2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579279.374208:0:22667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939435d7bc00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579279.374213:0:22667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939435d7bc00/0xd90373d592f229c2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579279.374220:0:22667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939435d7bc00/0xd90373d592f229c2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579279.374233:0:22667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939435d7bc00/0xd90373d592f229c2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579279.374242:0:22667:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789579279.374269:0:22667:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393037ca050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39addb08-5233-4b30-82ca-229405d26fae+21:3616:x1876509277272320:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579279.374276:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789579279.374325:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39addb08-5233-4b30-82ca-229405d26fae:3616:1876509277272320:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789579279.379473:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394363aea00/0xd90373d592f2291a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f22913 expref: 20 pid: 22673 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579279.379495:0:22696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22696:1876509277271936:0@lo:104: 00010000:00010000:2.0:1789579279.379512:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394363aee00/0xd90373d592f2290c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f22905 expref: 19 pid: 22673 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579279.379520:0:22696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22696:1876509277272064:0@lo:104: 00010000:00010000:2.0:1789579279.379546:0:22696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff939435d7bc00/0xd90373d592f229c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579279.379556:0:22696:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff939435d7bc00/0xd90373d592f229c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579279.379562:0:22696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939435d7bc00/0xd90373d592f229c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579279.379569:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939435d7bc00/0xd90373d592f229c2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1789579279.381482:0:24182:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1789579279.381499:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39addb08-5233-4b30-82ca-229405d26fae:3618:1876509277272192:0@lo:103:ldlm_bl.0 00002000:00080000:1.0:1789579279.385440:0:24182:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789579279.385449:0:24182:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789579279.385486:0:24182:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789579279.385526:0:24182:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.137@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789579279.385545:0:24182:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789579279.385567:0:24182:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1789579279.386733:0:24182:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789579279.386933:0:24182:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789579280.100217:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789579280.306266:0:24262:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789579280.306487:0:24262:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789579280.739638:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789579280.739677:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304885500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277272448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789579280.739771:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579280.739847:0:22686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277272448 00000100:00100000:2.0:1789579280.739857:0:22686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277272448 00000100:00100000:2.0:1789579280.739917:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789579280.739928:0:22686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277272448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789579280.739974:0:22686:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789579280.740027:0:22686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277272448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579280.740035:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789579280.740091:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304885500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277272448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789579280.740564:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277272576:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789579280.740605:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579280.742016:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277272576 00000100:00100000:0.0:1789579280.742030:0:22685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277272576 00000100:00100000:0.0:1789579280.742095:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789579280.742105:0:22685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277272576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789579280.742140:0:22685:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789579280.748189:0:22685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277272576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6074us (7572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579280.748221:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789579280.751032:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277272576:0@lo:41:osp-pre-1-0.0 10000000:01000000:1.0:1789579280.999956:0:22677:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789579280.999968:0:22677:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93943f647000 from 13 10000000:01000000:1.0:1789579280.999976:0:22677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789579281.000039:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401518e00/0xd90373d592f229c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579281.000054:0:22677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939401518e00/0xd90373d592f229c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579281.000078:0:22677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939401518e00/0xd90373d592f229c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579281.000219:0:22677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277272704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789579281.000311:0:22677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579281.000457:0:22677:0:(client.c:2716:ptlrpc_set_wait()) set ffff93940832a0c0 going to sleep for 10 seconds 00000100:00100000:1.0:1789579281.000484:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277272704 00000100:00100000:1.0:1789579281.000494:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277272704 00000100:00100000:1.0:1789579281.000561:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789579281.000571:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+19:22677:x1876509277272704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789579281.000599:0:22675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579281.000616:0:22675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939401519800/0xd90373d592f229d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f229c9 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579281.000670:0:22675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939401519800/0xd90373d592f229d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f229c9 expref: 20 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579281.000683:0:22675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939401519800/0xd90373d592f229d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f229c9 expref: 20 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579281.000761:0:22675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401519800, rc 0) 00000100:00100000:1.0:1789579281.000814:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+20:22677:x1876509277272704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 243us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579281.000822:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789579281.001017:0:22677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277272704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789579281.001036:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939401518e00/0xd90373d592f229c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f229d0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579281.001046:0:22677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939401518e00/0xd90373d592f229c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f229d0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579281.001234:0:22677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277272832:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789579281.001274:0:22677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579281.001298:0:22677:0:(client.c:2716:ptlrpc_set_wait()) set ffff93940832a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789579281.001708:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277272832 00000100:00100000:3.0:1789579281.001716:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277272832 00000100:00100000:3.0:1789579281.001763:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789579281.001771:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+20:22677:x1876509277272832:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789579281.001800:0:22674:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789579281.001821:0:22674:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789579281.001824:0:22674:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1789579281.001923:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+20:22677:x1876509277272832:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 152us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579281.001931:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789579281.001972:0:22677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277272832:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789579281.002043:0:22677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789579281.002053:0:22677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401518e00/0xd90373d592f229c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f229d0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579281.002065:0:22677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939401518e00/0xd90373d592f229c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f229d0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789579281.002077:0:22677:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789579281.002079:0:22677:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff939435d8b800 from 13 10000000:01000000:3.0:1789579281.002083:0:22677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789579281.002108:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2f000/0xd90373d592f229d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579281.002117:0:22677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939302b2f000/0xd90373d592f229d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579281.002127:0:22677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939302b2f000/0xd90373d592f229d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579281.002143:0:22677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277272960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789579281.002170:0:22677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579281.002201:0:22677:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408e596c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789579281.002215:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277272960 00000100:00100000:3.0:1789579281.002220:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277272960 00000100:00100000:3.0:1789579281.002243:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789579281.002249:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402b71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+20:22677:x1876509277272960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789579281.002258:0:22673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579281.002269:0:22673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939302b2ec00/0xd90373d592f229de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f229d7 expref: -99 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579281.002290:0:22673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939302b2ec00/0xd90373d592f229de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f229d7 expref: 21 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579281.002301:0:22673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939302b2ec00/0xd90373d592f229de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f229d7 expref: 21 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579281.002310:0:22673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939302b2ec00, rc 0) 00000100:00100000:3.0:1789579281.002335:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402b71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+21:22677:x1876509277272960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579281.002341:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789579281.002405:0:22677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277272960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789579281.002418:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939302b2f000/0xd90373d592f229d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f229de expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579281.002428:0:22677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939302b2f000/0xd90373d592f229d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f229de expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579281.002467:0:22677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277273088:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789579281.002494:0:22677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579281.002515:0:22677:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408e596c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789579281.002527:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277273088 00000100:00100000:3.0:1789579281.002531:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277273088 00000100:00100000:3.0:1789579281.002547:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789579281.002553:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402b73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+21:22677:x1876509277273088:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789579281.002563:0:22673:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789579281.002575:0:22673:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789579281.002578:0:22673:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1789579281.002638:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402b73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+21:22677:x1876509277273088:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 84us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579281.002646:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789579281.002689:0:22677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277273088:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789579281.002725:0:22677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789579281.002731:0:22677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2f000/0xd90373d592f229d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f229de expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579281.002740:0:22677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939302b2f000/0xd90373d592f229d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f229de expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579281.127312:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579282.148766:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579283.176249:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789579283.494443:0:22718:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789579284.195828:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789579284.836112:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789579284.836120:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789579284.836124:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789579284.836128:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789579284.836155:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789579284.836159:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789579284.836162:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789579284.836165:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789579284.836269:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39addb08-5233-4b30-82ca-229405d26fae:3618:1876509277273216:0@lo:400:kworker.0 00000100:00100000:0.0:1789579284.836383:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579284.836429:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277273728:0@lo:400:kworker.0 00000100:00100000:0.0:1789579284.836459:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579284.836502:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789579284.836508:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277273600:0@lo:400:kworker.0 00000100:00100000:0.0:1789579284.836533:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579284.837226:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277273344:0@lo:400:kworker.0 00000100:00100000:0.0:1789579284.837271:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579284.837299:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277273856:0@lo:400:kworker.0 00000100:00100000:0.0:1789579284.837321:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579284.837392:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789579284.837400:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277273472:0@lo:400:kworker.0 00000100:00100000:0.0:1789579284.837426:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579284.837448:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277273984:0@lo:400:kworker.0 00000100:00100000:0.0:1789579284.837543:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579284.837792:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277273600 00000100:00100000:3.0:1789579284.837815:0:23423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277273600 00000100:00100000:3.0:1789579284.837863:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277273344 00000100:00100000:3.0:1789579284.837867:0:23423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277273344 00000100:00100000:3.0:1789579284.837887:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789579284.837896:0:23423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277273600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579284.838043:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789579284.838052:0:22686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277273344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579284.838253:0:23423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277273600:12345-0@lo:400:kworker.0 Request processed in 356us (1717us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579284.838271:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789579284.838299:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277273728 00000100:00100000:3.0:1789579284.838305:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277273728 00000100:00100000:3.0:1789579284.838327:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277273856 00000100:00100000:3.0:1789579284.838330:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277273856 00000100:00100000:3.0:1789579284.838404:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277273472 00000100:00100000:3.0:1789579284.838408:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277273472 00000100:00100000:3.0:1789579284.838420:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277273984 00000100:00100000:3.0:1789579284.838423:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277273984 00000100:00100000:3.0:1789579284.838440:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789579284.838445:0:22680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277273728:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789579284.840794:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789579284.840819:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789579284.844409:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789579284.844436:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876509277273856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579284.846657:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277273216 00000100:00100000:2.0:1789579284.847293:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277273216 00000100:00100000:2.0:1789579284.847897:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789579284.847915:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402b72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+21:3618:x1876509277273216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579284.848105:0:22686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277273344:12345-0@lo:400:kworker.0 Request processed in 10052us (10831us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579284.848117:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789579284.848953:0:24054:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1789579284.848974:0:24054:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1789579284.849003:0:22681:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1789579284.849088:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789579284.849102:0:22681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277273472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579284.850317:0:22681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277273472:12345-0@lo:400:kworker.0 Request processed in 1164us (12834us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579284.850333:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789579284.850396:0:22681:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1789579284.850408:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789579284.850420:0:22681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277273984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579284.850467:0:22681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277273984:12345-0@lo:400:kworker.0 Request processed in 52us (12924us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579284.850474:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789579284.850749:0:22680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277273728:12345-0@lo:400:kworker.0 Request processed in 12301us (14287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579284.850758:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789579284.850946:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277273600:0@lo:400:kworker.0 00010000:00080000:3.0:1789579284.850967:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939302b4c380 x1876509277273728/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579284.850979:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277273728:0@lo:400:kworker.0 00010000:00080000:3.0:1789579284.851027:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939302b4c000 x1876509277273472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579284.851038:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277273472:0@lo:400:kworker.0 00010000:00080000:3.0:1789579284.851051:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939302b4d880 x1876509277273984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579284.851059:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277273984:0@lo:400:kworker.0 00000100:00100000:3.0:1789579284.851072:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277273344:0@lo:400:kworker.0 00000100:00100000:1.0:1789579284.852988:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876509277273856:12345-0@lo:400:kworker.0 Request processed in 8554us (15654us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579284.853006:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1789579284.853789:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939302b4dc00 x1876509277273856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579284.853817:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277273856:0@lo:400:kworker.0 00000100:00100000:2.0:1789579284.862146:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402b72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+21:3618:x1876509277273216:12345-0@lo:400:kworker.0 Request processed in 14224us (25749us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579284.862164:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789579284.870107:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39addb08-5233-4b30-82ca-229405d26fae:3618:1876509277273216:0@lo:400:kworker.0 00010000:00010000:3.0:1789579285.220552:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579285.867298:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789579285.867329:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277274112:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789579285.867456:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579285.867486:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277274112 00000100:00100000:3.0:1789579285.867497:0:23423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277274112 00000100:00100000:3.0:1789579285.867554:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789579285.867565:0:23423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277274112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789579285.868451:0:23423:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789579285.868544:0:23423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277274112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 979us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579285.868554:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789579285.870793:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277274112:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789579285.876315:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789579285.876347:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277274240:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789579285.876461:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579285.876541:0:22686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277274240 00000100:00100000:0.0:1789579285.876551:0:22686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277274240 00000100:00100000:0.0:1789579285.876613:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789579285.876640:0:22686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277274240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789579285.876688:0:22686:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789579285.876740:0:22686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277274240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579285.876749:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789579285.876814:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277274240:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789579286.246544:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789579286.801347:0:24554:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg337-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789579287.268995:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789579287.703749:0:24607:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789579287.704108:0:24607:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:0.0:1789579287.781017:0:23440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789579288.301523:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789579288.647758:0:24657:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789579288.648076:0:24657:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789579289.316408:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789579289.957933:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789579289.957941:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789579289.957944:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789579289.957947:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789579289.957973:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789579289.957977:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789579289.957980:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789579289.957984:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789579289.958034:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277274624:0@lo:400:kworker.0 00000100:00100000:0.0:1789579289.958107:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579289.958184:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277275136:0@lo:400:kworker.0 00000100:00100000:0.0:1789579289.958205:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579289.958237:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789579289.958244:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277274752:0@lo:400:kworker.0 00000100:00100000:0.0:1789579289.958267:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579289.958299:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277274624 00000100:00100000:0.0:1789579289.958307:0:22681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277274624 00000100:00100000:0.0:1789579289.958346:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277275136 00000100:00100000:0.0:1789579289.958365:0:22681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277275136 00000100:00100000:0.0:1789579289.958396:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789579289.958405:0:22681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277274624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579289.958452:0:22681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277274624:12345-0@lo:400:kworker.0 Request processed in 48us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579289.958459:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789579289.958475:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789579289.958482:0:22681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277275136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579289.958509:0:22681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277275136:12345-0@lo:400:kworker.0 Request processed in 28us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579289.958515:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789579289.958533:0:22686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277274752 00000100:00100000:0.0:1789579289.958536:0:22686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277274752 00000100:00100000:0.0:1789579289.958558:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789579289.958565:0:22686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277274752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579289.958606:0:22686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277274752:12345-0@lo:400:kworker.0 Request processed in 42us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579289.958613:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1789579289.958632:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789579289.958674:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277274752:0@lo:400:kworker.0 00010000:00080000:0.0:1789579289.958687:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939302b4f100 x1876509277274624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579289.958697:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277274624:0@lo:400:kworker.0 00010000:00080000:0.0:1789579289.958706:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939302b4d880 x1876509277275136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579289.958714:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277275136:0@lo:400:kworker.0 00000100:00100000:3.0:1789579289.958774:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39addb08-5233-4b30-82ca-229405d26fae:3615:1876509277274368:0@lo:400:kworker.0 00000100:00100000:3.0:1789579289.958809:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579289.958842:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876509277274880:0@lo:400:kworker.0 00000100:00100000:3.0:1789579289.958863:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579289.958882:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789579289.958888:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277274496:0@lo:400:kworker.0 00000100:00100000:3.0:1789579289.958906:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579289.958920:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277275008:0@lo:400:kworker.0 00000100:00100000:3.0:1789579289.958942:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579289.958968:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277274880 00000100:00100000:3.0:1789579289.958978:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277274880 00000100:00100000:0.0:1789579289.958993:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277274368 00000100:00100000:0.0:1789579289.958999:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277274368 00000100:00100000:3.0:1789579289.959005:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277275008 00000100:00100000:3.0:1789579289.959010:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277275008 00000100:00100000:0.0:1789579289.959036:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789579289.959043:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789579289.959048:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402b70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+21:3615:x1876509277274368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579289.959055:0:22680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876509277274880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579289.959094:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402b70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+21:3615:x1876509277274368:12345-0@lo:400:kworker.0 Request processed in 49us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579289.959103:0:22680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876509277274880:12345-0@lo:400:kworker.0 Request processed in 50us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579289.959103:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789579289.959113:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789579289.959127:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789579289.959134:0:22680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876509277275008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579289.959160:0:22680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876509277275008:12345-0@lo:400:kworker.0 Request processed in 27us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579289.959165:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1789579289.959189:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939302b4d500 x1876509277275008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579289.959200:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277275008:0@lo:400:kworker.0 00000100:00100000:3.0:1789579289.959208:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39addb08-5233-4b30-82ca-229405d26fae:3615:1876509277274368:0@lo:400:kworker.0 00010000:00080000:3.0:1789579289.959216:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939302b4dc00 x1876509277274880/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579289.959224:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876509277274880:0@lo:400:kworker.0 00000100:00100000:0.0:1789579289.959889:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277274496 00000100:00100000:0.0:1789579289.959895:0:23423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277274496 00000100:00100000:0.0:1789579289.959920:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789579289.959927:0:23423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277274496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579289.959974:0:23423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277274496:12345-0@lo:400:kworker.0 Request processed in 48us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579289.959980:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1789579289.960006:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789579289.960034:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277274496:0@lo:400:kworker.0 00010000:00010000:0.0:1789579290.339805:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579290.659493:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789579275/real 1789579275] req@ffff93930439aa00 x1876509277267200/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579290 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579290.659528:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93930439aa00 x1876509277267200/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579290 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579290.659538:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789579275/real 1789579275] req@ffff939304399c00 x1876509277267328/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579290 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579290.659550:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff939304399c00 x1876509277267328/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579290 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789579290.659570:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939302b56000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789579290.659590:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789579290.659594:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277267200:0@lo:8:kworker.0 00000100:00080000:0.0:1789579290.659600:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939404134800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789579290.659604:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789579290.659607:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277267328:0@lo:8:kworker.0 00000100:00080000:3.0:1789579290.660285:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579290.660292:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789579290.660295:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579290.660298:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789579290.660307:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579290.660310:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789579290.660312:0:8:0:(import.c:65:import_set_state_nolock()) ffff939302b56000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789579290.660317:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 630 00000100:00080000:3.0:1789579290.660323:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789579290.660333:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff939302b56000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789579290.660386:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93930489d880 x1876509277275264/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789579290.660413:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579290.660416:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789579290.660418:0:8:0:(import.c:65:import_set_state_nolock()) ffff939404134800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789579290.660421:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 630 00000100:00080000:3.0:1789579290.660424:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789579290.660428:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff939404134800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789579290.660441:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93930489f100 x1876509277275392/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789579290.660453:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277275264:0@lo:8:kworker.0 00000100:00100000:0.0:1789579290.660514:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579290.660560:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277275392:0@lo:8:kworker.0 00000100:00100000:0.0:1789579290.660596:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579290.660633:0:24187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277275264 00000100:00100000:2.0:1789579290.660642:0:24187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277275264 00000100:00100000:3.0:1789579290.660653:0:24186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277275392 00000100:00100000:3.0:1789579290.660659:0:24186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277275392 00000100:00100000:2.0:1789579290.660680:0:24187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789579290.660688:0:24187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3614:x1876509277275264:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789579290.660716:0:24187:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 645 last 0 00000020:00000080:2.0:1789579290.660743:0:24187:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd90373d592f229e5 00002000:00100000:2.0:1789579290.660755:0:24187:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9393010c2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1789579290.660759:0:24187:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1789579290.660761:0:24187:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789579290.660906:0:24187:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1789579290.660926:0:24187:0:(import.c:65:import_set_state_nolock()) ffff9393010c5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789579290.661161:0:24187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3614:x1876509277275264:12345-0@lo:8:kworker.0 Request processed in 471us (646us total) trans 0 rc 0/0 00010000:00080000:0.0:1789579290.661203:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93930489d880 x1876509277275264/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789579310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579290.661214:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789579290.661220:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1789579290.661226:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789579290.661231:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789579290.661238:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939302b56000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789579290.661293:0:3614:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789579290.661298:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277275264:0@lo:8:kworker.0 00000004:00080000:0.0:1789579290.661318:0:23421:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789579290.661403:0:23421:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 645794051856ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789579290.661409:0:23421:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1789579290.662110:0:23422:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789579290.662131:0:23422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043a8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23422:1876509277275648:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1789579290.662170:0:23422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579290.662188:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277275520:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789579290.662205:0:23422:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394012ed600 going to sleep for 11 seconds 00000100:00100000:0.0:1789579290.662220:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579290.662233:0:24188:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789579290.662241:0:24188:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1789579290.662262:0:24190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277275520 00000100:00100000:0.0:1789579290.662267:0:24190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277275520 00000100:00100000:0.0:1789579290.662306:0:24190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789579290.662313:0:24190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3618:x1876509277275520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789579290.662334:0:24190:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789579290.662380:0:24190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3618:x1876509277275520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579290.662387:0:24190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789579290.662406:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789579290.662423:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9393043a8380 x1876509277275520/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789579306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579290.662437:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277275520:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789579290.662699:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277275648 00000100:00100000:1.0:1789579290.662704:0:24188:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277275648 00000004:00080000:0.0:1789579290.662791:0:23413:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1789579290.665282:0:24186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789579290.665323:0:24187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789579290.665381:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789579290.665402:0:24188:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:23422:x1876509277275648:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:1.0:1789579290.668853:0:24188:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1789579290.668862:0:24188:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1789579290.668961:0:24188:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:23422:x1876509277275648:12345-0@lo:7:osp-pre-0-1.0 Request processed in 3567us (6787us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579290.668972:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789579290.669032:0:23422:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9393043a8700 x1876509277275648/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789579306 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579290.669046:0:23422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043a8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23422:1876509277275648:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1789579290.669060:0:23422:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:1.0:1789579290.669096:0:23422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043a8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23422:1876509277275776:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1789579290.669139:0:23422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579290.669163:0:23422:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405e4c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789579290.669166:0:24736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277275776 00000100:00100000:0.0:1789579290.669690:0:24736:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277275776 00000100:00100000:0.0:1789579290.669742:0:24736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789579290.669752:0:24736:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+7:23422:x1876509277275776:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1789579290.669785:0:24736:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1789579290.669830:0:24736:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+7:23422:x1876509277275776:12345-0@lo:5:osp-pre-0-1.0 Request processed in 71us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579290.669848:0:24736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789579290.670063:0:23422:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9393043a8700 x1876509277275776/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789579306 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579290.670085:0:23422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043a8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23422:1876509277275776:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1789579290.670095:0:23422:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1789579290.670174:0:23422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043a8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23422:1876509277275904:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1789579290.670200:0:23422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579290.670223:0:23422:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405e4c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789579290.670236:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277275904 00000100:00100000:1.0:1789579290.670240:0:24188:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277275904 00000100:00100000:1.0:1789579290.670261:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789579290.670268:0:24188:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:23422:x1876509277275904:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1789579290.670295:0:24188:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:3.0:1789579290.671106:0:24186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3614:x1876509277275392:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789579290.671199:0:24186:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789579290.709526:0:24186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3614:x1876509277275392:12345-0@lo:8:kworker.0 Request processed in 38417us (48922us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789579290.709539:0:24186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789579290.709600:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939404134800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789579290.709612:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789579290.709617:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277275392:0@lo:8:kworker.0 00000001:00080000:3.0:1789579290.711368:0:24183:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:3.0:1789579290.711384:0:24183:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789579290.714388:0:24188:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23422:x1876509277275904:12345-0@lo:5:osp-pre-0-1.0 Request processed in 44111us (44178us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1789579290.714401:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789579290.714414:0:23422:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9393043a8700 x1876509277275904/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789579306 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579290.714426:0:23422:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1789579290.714433:0:23422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043a8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23422:1876509277275904:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1789579290.714449:0:23422:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:3.0:1789579290.714498:0:23422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23422:1876509277276032:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1789579290.714534:0:23422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579290.714566:0:23422:0:(client.c:2716:ptlrpc_set_wait()) set ffff93940832a240 going to sleep for 11 seconds 00000100:00100000:1.0:1789579290.714868:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277276032 00000100:00100000:1.0:1789579290.714875:0:22692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277276032 00000100:00100000:1.0:1789579290.715052:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789579290.715063:0:22692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23422:x1876509277276032:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1789579290.715283:0:22692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23422:x1876509277276032:12345-0@lo:900:osp-pre-0-1.0 Request processed in 222us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579290.715291:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789579290.715375:0:23422:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93930489f100 x1876509277276032/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789579306 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579290.715388:0:23422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23422:1876509277276032:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1789579290.980064:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789579290.980094:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277276160:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789579290.980346:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579290.980522:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277276160 00000100:00100000:0.0:1789579290.980530:0:22685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277276160 00000100:00100000:0.0:1789579290.980590:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789579290.980600:0:22685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277276160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789579290.980631:0:22685:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789579290.980679:0:22685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277276160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579290.980686:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789579290.980728:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277276160:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789579290.983229:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789579290.983250:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277276288:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789579290.983308:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579290.983396:0:22686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277276288 00000100:00100000:2.0:1789579290.983403:0:22686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277276288 00000100:00100000:2.0:1789579290.983445:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789579290.983516:0:22686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277276288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789579290.983748:0:22686:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789579290.983805:0:22686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277276288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 352us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579290.983812:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789579290.983859:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277276288:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789579291.364989:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579292.387653:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579293.411694:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789579293.733910:0:22718:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789579294.436094:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789579295.199263:0:25004:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789579295.199267:0:25004:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1789579295.199268:0:25004:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789579295.199410:0:25004:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93942e142800 00000020:01000004:0.0:1789579295.199426:0:25004:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789579295.199440:0:25004:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789579295.199453:0:25004:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff93941008cd40) 00000020:00000080:0.0:1789579295.199469:0:25004:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789579295.245600:0:25004:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789579295.249735:0:25004:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789579295.250269:0:25004:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1789579295.251484:0:25004:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789579295.252887:0:25004:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789579295.253245:0:25004:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789579295.253489:0:25004:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:3.0:1789579295.254325:0:25004:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789579295.254820:0:25004:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789579295.254835:0:25004:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789579295.254848:0:25004:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd90373d592f229f3 00000020:01000004:3.0:1789579295.254854:0:25004:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789579295.254875:0:25004:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.137@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789579295.254879:0:25004:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.137@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789579295.254885:0:25004:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789579295.254913:0:25004:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1789579295.254917:0:25004:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.137@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1789579295.269857:0:25004:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.137@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789579295.269899:0:25004:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.137@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1789579295.269904:0:25004:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789579295.269906:0:25004:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789579295.269907:0:25004:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789579295.269908:0:25004:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789579295.269909:0:25004:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789579295.269911:0:25004:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789579295.269912:0:25004:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789579295.269914:0:25004:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789579295.269915:0:25004:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789579295.269919:0:25004:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1789579295.269926:0:25004:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789579295.269928:0:25004:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789579295.269929:0:25004:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789579295.269930:0:25004:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789579295.269931:0:25004:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789579295.269932:0:25004:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789579295.269933:0:25004:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789579295.269934:0:25004:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789579295.269935:0:25004:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789579295.269960:0:25004:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789579295.269979:0:25004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277276416:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789579295.270045:0:25004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579295.270156:0:25004:0:(client.c:2716:ptlrpc_set_wait()) set ffff93943b607b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789579295.271144:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277276416 00000100:00100000:2.0:1789579295.271153:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277276416 00000100:00100000:2.0:1789579295.271211:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789579295.271226:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402b73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+21:25004:x1876509277276416:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789579295.271275:0:22673:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789579295.271279:0:22673:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1789579295.271283:0:22673:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789579295.272484:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402b73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+21:25004:x1876509277276416:12345-0@lo:253:mount.lustre.0 Request processed in 1255us (2432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579295.272496:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789579295.272604:0:25004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277276416:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789579295.272618:0:25004:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789579295.272621:0:25004:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789579295.272635:0:25004:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789579295.272636:0:25004:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789579295.272638:0:25004:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789579295.272639:0:25004:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789579295.272640:0:25004:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789579295.272641:0:25004:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789579295.272643:0:25004:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789579295.272644:0:25004:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789579295.272664:0:25004:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93942e142800 from lustre-OST0001 10000000:01000000:1.0:1789579295.272696:0:25004:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789579295.272699:0:25004:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789579295.272707:0:25004:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff939405a9b380 local copy 00010000:00010000:1.0:1789579295.272717:0:25004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f2270d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22714 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579295.272818:0:25004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043a8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277276544:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789579295.272859:0:25004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579295.272898:0:25004:0:(client.c:2716:ptlrpc_set_wait()) set ffff939442162b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789579295.273035:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277276544 00000100:00100000:3.0:1789579295.273041:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277276544 00000100:00100000:3.0:1789579295.273086:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789579295.273094:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402b73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+21:25004:x1876509277276544:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789579295.273163:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402b73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+21:25004:x1876509277276544:12345-0@lo:501:mount.lustre.0 Request processed in 69us (303us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789579295.273170:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789579295.273231:0:25004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043a8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277276544:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789579295.273243:0:25004:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.137@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789579295.273257:0:25004:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.137@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789579295.273262:0:25004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f2270d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22714 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579295.273271:0:25004:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f2270d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22714 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789579295.273296:0:25004:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93942e142800 10000000:01000000:1.0:1789579295.273300:0:25004:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789579295.273305:0:25004:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789579295.273308:0:25004:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789579295.273319:0:25004:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789579295.273321:0:25004:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789579295.273342:0:25004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401519e00/0xd90373d592f229fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579295.273375:0:25004:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939401519e00/0xd90373d592f229fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579295.273386:0:25004:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939401519e00/0xd90373d592f229fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579295.273398:0:25004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043a8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277276672:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789579295.273421:0:25004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579295.273436:0:25004:0:(client.c:2716:ptlrpc_set_wait()) set ffff939442162b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789579295.273560:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277276672 00000100:00100000:0.0:1789579295.273565:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277276672 00000100:00100000:0.0:1789579295.273586:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789579295.273592:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303442c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+21:25004:x1876509277276672:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789579295.273600:0:22675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579295.273613:0:22675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939435d7bc00/0xd90373d592f22a01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f229fa expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579295.273632:0:22675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939435d7bc00/0xd90373d592f22a01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f229fa expref: 22 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579295.273642:0:22675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939435d7bc00/0xd90373d592f22a01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f229fa expref: 22 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579295.273650:0:22675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939435d7bc00, rc 0) 00000100:00100000:0.0:1789579295.273689:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303442c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+22:25004:x1876509277276672:12345-0@lo:101:mount.lustre.0 Request processed in 97us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579295.273695:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789579295.273762:0:25004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043a8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277276672:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789579295.273774:0:25004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939401519e00/0xd90373d592f229fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22a01 expref: -99 pid: 25004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579295.273783:0:25004:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939401519e00/0xd90373d592f229fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f22a01 expref: -99 pid: 25004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789579295.274698:0:25004:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:0.0:1789579295.276172:0:25004:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789579295.288368:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1789579295.288428:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1789579295.288449:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1789579295.288463:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1789579295.288476:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1789579295.288508:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1789579295.288532:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1789579295.288560:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1789579295.288590:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:1.0:1789579295.288615:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:1.0:1789579295.288622:0:25004:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:1.0:1789579295.288756:0:25004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043a8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277276800:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789579295.288829:0:25004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579295.288872:0:25004:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091b0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789579295.289038:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277276800 00000100:00100000:0.0:1789579295.289052:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277276800 00000100:00100000:0.0:1789579295.289105:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789579295.289114:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303440050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+22:25004:x1876509277276800:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789579295.289272:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303440050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+22:25004:x1876509277276800:12345-0@lo:501:mount.lustre.0 Request processed in 159us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579295.289279:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789579295.290788:0:25004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043a8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277276800:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789579295.290845:0:25004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043a8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277276928:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789579295.290917:0:25004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579295.290969:0:25004:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091b0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789579295.291035:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277276928 00000100:00100000:3.0:1789579295.291041:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277276928 00000100:00100000:3.0:1789579295.291104:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789579295.291113:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303441450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+22:25004:x1876509277276928:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789579295.292018:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303441450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+22:25004:x1876509277276928:12345-0@lo:503:mount.lustre.0 Request processed in 903us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579295.292028:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789579295.292147:0:25004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043a8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277276928:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789579295.292602:0:25004:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789579295.292672:0:25004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304887100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277277056:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789579295.292714:0:25004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579295.292738:0:25004:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091a40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789579295.292871:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277277056 00000100:00100000:3.0:1789579295.292877:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277277056 00000100:00100000:3.0:1789579295.292924:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789579295.292932:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303443450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+22:25004:x1876509277277056:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789579295.293332:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303443450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+22:25004:x1876509277277056:12345-0@lo:502:mount.lustre.0 Request processed in 401us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579295.293339:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789579295.295636:0:25004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304887100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277277056:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789579295.295916:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1789579295.295951:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1789579295.295965:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1789579295.295976:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1789579295.295987:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1789579295.295998:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1789579295.296009:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1789579295.296030:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1789579295.296042:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1789579295.296088:0:25004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304887100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277277184:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789579295.296153:0:25004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579295.296199:0:25004:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091a40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789579295.299744:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277277184 00000100:00100000:3.0:1789579295.299759:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277277184 00000100:00100000:3.0:1789579295.299822:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789579295.299833:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303441850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+22:25004:x1876509277277184:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789579295.300008:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303441850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+22:25004:x1876509277277184:12345-0@lo:502:mount.lustre.0 Request processed in 177us (3854us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579295.300016:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789579295.300137:0:25004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304887100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277277184:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789579295.300216:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1789579295.300230:0:25004:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1789579295.301069:0:25008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789579295.301088:0:25008:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1789579295.301095:0:25008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579295.301098:0:25008:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789579295.301105:0:25008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789579295.301121:0:25008:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9394100899c0) 00000020:00000080:0.0:1789579295.301149:0:25008:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789579295.301156:0:25008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789579295.301245:0:25008:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93942e142800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789579295.301255:0:25008:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789579295.301263:0:25008:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd90373d592f22a0f 00010000:00010000:0.0:1789579295.304239:0:25008:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1789579295.312303:0:25008:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:3.0:1789579295.313891:0:25008:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1789579295.321256:0:25008:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789579295.321267:0:25008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789579295.321273:0:25008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579295.321274:0:25008:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789579295.321277:0:25008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789579295.321281:0:25008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579295.321282:0:25008:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789579295.321285:0:25008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789579295.321286:0:25008:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789579295.321288:0:25008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789579295.321290:0:25008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579295.321291:0:25008:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789579295.321293:0:25008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789579295.321300:0:25008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579295.321302:0:25008:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789579295.321306:0:25008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789579295.321329:0:25008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789579295.321332:0:25008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579295.321333:0:25008:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789579295.321337:0:25008:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:2.0:1789579295.321771:0:25004:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1789579295.321803:0:25004:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789579295.321828:0:25004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401519e00/0xd90373d592f229fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22a01 expref: -99 pid: 25004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.321841:0:25004:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939401519e00/0xd90373d592f229fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22a01 expref: -99 pid: 25004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789579295.321850:0:25004:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93942e142800 from 1 10000000:01000000:2.0:1789579295.321852:0:25004:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789579295.321888:0:25004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363afa00/0xd90373d592f22a16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.321896:0:25004:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff9394363afa00/0xd90373d592f22a16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.321907:0:25004:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff9394363afa00/0xd90373d592f22a16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579295.321929:0:25004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304887100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277277312:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789579295.321988:0:25004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579295.322040:0:25004:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091a40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789579295.322055:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277277312 00000100:00100000:0.0:1789579295.322062:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277277312 00000100:00100000:0.0:1789579295.322169:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789579295.322178:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303442450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+22:25004:x1876509277277312:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789579295.322192:0:22673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579295.322204:0:22673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939435d7aa00/0xd90373d592f22a1d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f22a16 expref: -99 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579295.322239:0:22673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939435d7aa00/0xd90373d592f22a1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f22a16 expref: 23 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579295.322252:0:22673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939435d7aa00/0xd90373d592f22a1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f22a16 expref: 23 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579295.322261:0:22673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939435d7aa00, rc 0) 00000100:00100000:0.0:1789579295.322308:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303442450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+23:25004:x1876509277277312:12345-0@lo:101:mount.lustre.0 Request processed in 130us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579295.322314:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789579295.322404:0:25004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304887100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277277312:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789579295.322418:0:25004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff9394363afa00/0xd90373d592f22a16 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22a1d expref: -99 pid: 25004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.322426:0:25004:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff9394363afa00/0xd90373d592f22a16 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f22a1d expref: -99 pid: 25004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789579295.332210:0:25004:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1789579295.332572:0:25004:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789579295.332748:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1789579295.332768:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1789579295.332780:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1789579295.332794:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1789579295.332805:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1789579295.332817:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1789579295.332829:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1789579295.332842:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1789579295.332856:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1789579295.332868:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1789579295.332886:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1789579295.332906:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1789579295.332910:0:25004:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1789579295.333178:0:25004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277277440:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789579295.333240:0:25004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579295.333285:0:25004:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394079c2180 going to sleep for 11 seconds 00000100:00100000:0.0:1789579295.333921:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277277440 00000100:00100000:0.0:1789579295.333930:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277277440 00000100:00100000:0.0:1789579295.333982:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789579295.333991:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303443850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+23:25004:x1876509277277440:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789579295.337910:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303443850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+23:25004:x1876509277277440:12345-0@lo:501:mount.lustre.0 Request processed in 3908us (4657us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579295.337924:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789579295.338039:0:25004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277277440:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789579295.338097:0:25004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277277568:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789579295.338150:0:25004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579295.338191:0:25004:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394079c2180 going to sleep for 11 seconds 00000100:00100000:0.0:1789579295.338235:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277277568 00000100:00100000:0.0:1789579295.338250:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277277568 00000100:00100000:0.0:1789579295.338298:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789579295.338312:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303440450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+23:25004:x1876509277277568:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789579295.338446:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303440450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+23:25004:x1876509277277568:12345-0@lo:503:mount.lustre.0 Request processed in 138us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579295.338453:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789579295.338612:0:25004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277277568:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789579295.339015:0:25004:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789579295.339096:0:25004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277277696:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789579295.339131:0:25004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579295.339166:0:25004:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394079c2180 going to sleep for 11 seconds 00000100:00100000:2.0:1789579295.339181:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277277696 00000100:00100000:2.0:1789579295.339186:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277277696 00000100:00100000:2.0:1789579295.339223:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789579295.339240:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303442050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+23:25004:x1876509277277696:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789579295.339328:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303442050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+23:25004:x1876509277277696:12345-0@lo:502:mount.lustre.0 Request processed in 97us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579295.339334:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789579295.339482:0:25004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277277696:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789579295.339658:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1789579295.339683:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1789579295.339695:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1789579295.339708:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1789579295.339720:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1789579295.339733:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1789579295.339745:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1789579295.339756:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1789579295.339768:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1789579295.339780:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1789579295.339807:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1789579295.339830:0:25004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277277824:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789579295.339865:0:25004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579295.340159:0:25004:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394079c2180 going to sleep for 11 seconds 00000100:00100000:0.0:1789579295.340424:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277277824 00000100:00100000:0.0:1789579295.340430:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277277824 00000100:00100000:1.0:1789579295.342938:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789579295.342951:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303442850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+23:25004:x1876509277277824:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789579295.343479:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303442850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+23:25004:x1876509277277824:12345-0@lo:502:mount.lustre.0 Request processed in 530us (3612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579295.343488:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789579295.343697:0:25004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277277824:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789579295.343897:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1789579295.343912:0:25004:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1789579295.345060:0:25012:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789579295.345084:0:25012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579295.345087:0:25012:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789579295.345095:0:25012:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93942e142800 00000020:00000080:0.0:1789579295.345097:0:25012:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789579295.345105:0:25012:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789579295.345108:0:25012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579295.345110:0:25012:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789579295.345112:0:25012:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789579295.345118:0:25012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579295.345119:0:25012:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789579295.345123:0:25012:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93942e142800 00000020:00000080:0.0:1789579295.345124:0:25012:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789579295.345180:0:25012:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789579295.345186:0:25012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579295.345187:0:25012:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789579295.345189:0:25012:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789579295.345191:0:25012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579295.345193:0:25012:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789579295.345195:0:25012:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93942e142800 00000020:00000080:0.0:1789579295.345197:0:25012:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789579295.345212:0:25012:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789579295.345214:0:25012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579295.345215:0:25012:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789579295.345223:0:25012:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789579295.345226:0:25012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579295.345227:0:25012:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789579295.345229:0:25012:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93942e142800 00000020:00000080:0.0:1789579295.345232:0:25012:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789579295.345255:0:25012:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789579295.345258:0:25012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579295.345259:0:25012:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789579295.345262:0:25012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1789579295.345325:0:25004:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789579295.345521:0:25004:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789579295.345554:0:25004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363afa00/0xd90373d592f22a16 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22a1d expref: -99 pid: 25004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579295.345568:0:25004:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff9394363afa00/0xd90373d592f22a16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22a1d expref: -99 pid: 25004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789579295.345616:0:25004:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789579295.345619:0:25004:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93942e142800 10000000:01000000:3.0:1789579295.345621:0:25004:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93942e142800 10000000:01000000:3.0:1789579295.345624:0:25004:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789579295.345629:0:25004:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93942e142800 from 1 10000000:01000000:3.0:1789579295.345631:0:25004:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789579295.345661:0:25004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f22a24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579295.345669:0:25004:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f22a24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579295.345678:0:25004:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f22a24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579295.345697:0:25004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277277952:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789579295.345762:0:25004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579295.345908:0:25004:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394079c2240 going to sleep for 11 seconds 00000100:00100000:1.0:1789579295.345972:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277277952 00000100:00100000:1.0:1789579295.345978:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277277952 00000100:00100000:1.0:1789579295.346024:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789579295.346033:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303440850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+23:25004:x1876509277277952:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789579295.346045:0:22675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579295.346057:0:22675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939401519c00/0xd90373d592f22a2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f22a24 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579295.346081:0:22675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939401519c00/0xd90373d592f22a2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f22a24 expref: 24 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579295.346099:0:22675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939401519c00/0xd90373d592f22a2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f22a24 expref: 24 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579295.346108:0:22675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401519c00, rc 0) 00000100:00100000:1.0:1789579295.346157:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303440850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+24:25004:x1876509277277952:12345-0@lo:101:mount.lustre.0 Request processed in 125us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579295.346164:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789579295.346384:0:25004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277277952:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789579295.346399:0:25004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f22a24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22a2b expref: -99 pid: 25004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579295.346409:0:25004:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f22a24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f22a2b expref: -99 pid: 25004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789579295.347736:0:25004:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1789579295.347995:0:25004:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789579295.348179:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1789579295.348204:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1789579295.348218:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1789579295.348245:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1789579295.348261:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1789579295.348272:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1789579295.348285:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1789579295.348298:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1789579295.348313:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1789579295.348324:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1789579295.348335:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1789579295.348347:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1789579295.348387:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1789579295.348401:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1789579295.348425:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1789579295.348439:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1789579295.348458:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1789579295.348472:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1789579295.348485:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1789579295.348511:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1789579295.348525:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1789579295.348537:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1789579295.348562:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1789579295.348575:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1789579295.348587:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1789579295.348597:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1789579295.348609:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1789579295.348620:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1789579295.348630:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1789579295.348641:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1789579295.348655:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1789579295.348674:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1789579295.348688:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1789579295.348701:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1789579295.348712:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1789579295.348738:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1789579295.348752:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1789579295.348765:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1789579295.348778:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1789579295.348790:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1789579295.348801:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1789579295.348814:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1789579295.348828:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1789579295.348840:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1789579295.348853:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1789579295.348866:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1789579295.348879:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1789579295.348901:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1789579295.349005:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1789579295.349024:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1789579295.349053:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1789579295.349059:0:25004:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1789579295.349144:0:25004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277278080:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789579295.349203:0:25004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579295.349231:0:25004:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302359b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789579295.349867:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277278080 00000100:00100000:1.0:1789579295.349876:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277278080 00000100:00100000:1.0:1789579295.349931:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789579295.349941:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303441c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+24:25004:x1876509277278080:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789579295.350082:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303441c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+24:25004:x1876509277278080:12345-0@lo:501:mount.lustre.0 Request processed in 142us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579295.350090:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789579295.350110:0:25004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277278080:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789579295.350142:0:25004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277278208:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789579295.350182:0:25004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579295.350213:0:25004:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302359b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789579295.350956:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277278208 00000100:00100000:3.0:1789579295.350963:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277278208 00000100:00100000:3.0:1789579295.350998:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789579295.351006:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303443050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+24:25004:x1876509277278208:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789579295.351099:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303443050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+24:25004:x1876509277278208:12345-0@lo:503:mount.lustre.0 Request processed in 93us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579295.351106:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789579295.351190:0:25004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277278208:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789579295.351575:0:25004:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789579295.351642:0:25004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277278336:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789579295.351680:0:25004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579295.351705:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277278336 00000100:00100000:0.0:1789579295.351705:0:25004:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302359d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789579295.351709:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277278336 00000100:00100000:1.0:1789579295.351749:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789579295.351757:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303443c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+24:25004:x1876509277278336:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789579295.351858:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303443c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+24:25004:x1876509277278336:12345-0@lo:502:mount.lustre.0 Request processed in 101us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579295.351865:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789579295.352171:0:25004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277278336:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789579295.352320:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1789579295.352345:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1789579295.352382:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1789579295.352398:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1789579295.352411:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1789579295.352423:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1789579295.352437:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1789579295.352451:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1789579295.352464:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1789579295.352487:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1789579295.352499:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1789579295.352511:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1789579295.352539:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1789579295.352566:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1789579295.352580:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1789579295.352593:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1789579295.352607:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1789579295.352618:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1789579295.352630:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1789579295.352642:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1789579295.352655:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1789579295.352669:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1789579295.352683:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1789579295.352696:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1789579295.352709:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1789579295.352721:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1789579295.352734:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1789579295.352746:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1789579295.352769:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1789579295.352785:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1789579295.352799:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1789579295.352812:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1789579295.352826:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1789579295.352839:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1789579295.352852:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1789579295.352864:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1789579295.352875:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1789579295.352888:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1789579295.352900:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1789579295.352913:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1789579295.352926:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1789579295.352938:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1789579295.352959:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1789579295.352973:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1789579295.352994:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1789579295.353008:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1789579295.353020:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1789579295.353033:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1789579295.353067:0:25004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277278464:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789579295.353186:0:25004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579295.353222:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277278464 00000100:00100000:0.0:1789579295.353228:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277278464 00000100:00100000:0.0:1789579295.353260:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789579295.353267:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393042f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+24:25004:x1876509277278464:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789579295.353368:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393042f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+24:25004:x1876509277278464:12345-0@lo:502:mount.lustre.0 Request processed in 84us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579295.353375:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789579295.353417:0:25004:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302359d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789579295.353431:0:25004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277278464:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789579295.353570:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1789579295.353591:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1789579295.353609:0:25004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277278592:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789579295.353639:0:25004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579295.353660:0:25004:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302359d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789579295.353662:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277278592 00000100:00100000:1.0:1789579295.353667:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277278592 00000100:00100000:1.0:1789579295.353695:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789579295.353703:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393042f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+24:25004:x1876509277278592:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789579295.354500:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393042f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+24:25004:x1876509277278592:12345-0@lo:502:mount.lustre.0 Request processed in 793us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579295.354515:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789579295.355207:0:25004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277278592:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789579295.355276:0:25004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1789579295.355288:0:25004:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789579295.356535:0:25015:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789579295.356564:0:25015:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff93943f544d40) 00000020:00000080:2.0:1789579295.356589:0:25015:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1789579295.356664:0:25015:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93942e142800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789579295.356667:0:25015:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93942e142800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789579295.356670:0:25015:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93942e142800 3 00010000:00080000:2.0:1789579295.356697:0:25015:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939304130800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.137@tcp at head 00010000:00010000:2.0:1789579295.358283:0:25015:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1789579295.358513:0:25015:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789579295.358562:0:25015:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789579295.358574:0:25015:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xd90373d592f22a39 00000100:00080000:2.0:1789579295.358583:0:25015:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789579295.358593:0:25015:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff939304130800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:2.0:1789579295.358626:0:25015:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939304887100 x1876509277278720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789579295.358674:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3614:1876509277278720:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789579295.358733:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579295.358788:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277278720 00000100:00100000:2.0:1789579295.358795:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277278720 00000100:00100000:2.0:1789579295.358828:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789579295.358835:0:22680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3614:x1876509277278720:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789579295.358856:0:22680:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 650 last 0 00000020:00000080:2.0:1789579295.358891:0:22680:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xd90373d592f22a40 00000004:00100000:2.0:1789579295.358905:0:22680:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789579295.358944:0:22680:0:(import.c:65:import_set_state_nolock()) ffff9393029dc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789579295.358990:0:22680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1876509277278720:12345-0@lo:38:llog_process_th.0 Request processed in 153us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579295.358998:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789579295.359031:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939304887100 x1876509277278720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789579305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579295.359041:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789579295.359047:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1789579295.359053:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789579295.359057:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789579295.359060:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939304130800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789579295.359064:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3614:1876509277278720:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789579295.359081:0:25015:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789579295.359128:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789579295.359132:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789579295.359138:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789579295.359141:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789579295.359170:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789579295.359173:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789579295.359175:0:36:0:(import.c:65:import_set_state_nolock()) ffff939404134800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789579295.359179:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 645 00000100:00080000:2.0:1789579295.359183:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789579295.359188:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff939404134800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:2.0:1789579295.359200:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939304884a80 x1876509277279360/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789579295.359241:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277278976:0@lo:400:kworker.0 00000100:00100000:2.0:1789579295.359267:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579295.359286:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876509277279616:0@lo:400:kworker.0 00000100:00100000:2.0:1789579295.359306:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579295.359326:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789579295.359332:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277278848:0@lo:400:kworker.0 00000100:00100000:2.0:1789579295.359375:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579295.359392:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277279488:0@lo:400:kworker.0 00000100:00100000:2.0:1789579295.359411:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579295.359434:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277279104:0@lo:400:kworker.0 00000100:00100000:2.0:1789579295.359455:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579295.359471:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277279744:0@lo:400:kworker.0 00000100:00100000:2.0:1789579295.359500:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579295.359522:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789579295.359527:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277279232:0@lo:400:kworker.0 00000100:00100000:2.0:1789579295.365530:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579295.365624:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277279360:0@lo:8:kworker.0 00000100:00100000:2.0:1789579295.365675:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579295.365712:0:24487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277278976 00000100:00100000:2.0:1789579295.365720:0:24487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277278976 00000100:00100000:2.0:1789579295.365758:0:24487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277279616 00000100:00100000:2.0:1789579295.365761:0:24487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277279616 00000100:00100000:2.0:1789579295.365783:0:24487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277279488 00000100:00100000:2.0:1789579295.365786:0:24487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277279488 00000100:00100000:2.0:1789579295.365797:0:24487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277279744 00000100:00100000:2.0:1789579295.365799:0:24487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277279744 00000100:00100000:2.0:1789579295.365830:0:24487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789579295.365839:0:24487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277278976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579295.365896:0:24487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277278976:12345-0@lo:400:kworker.0 Request processed in 58us (6627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579295.365903:0:24487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789579295.365918:0:24487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789579295.365924:0:24487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876509277279616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579295.365950:0:24487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876509277279616:12345-0@lo:400:kworker.0 Request processed in 27us (6644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579295.365956:0:24487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789579295.365966:0:24487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789579295.365971:0:24487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277279488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579295.366003:0:24487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277279488:12345-0@lo:400:kworker.0 Request processed in 31us (6591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579295.366009:0:24487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789579295.366030:0:24487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789579295.366035:0:24487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277279744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579295.366067:0:24487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277279744:12345-0@lo:400:kworker.0 Request processed in 32us (6566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579295.366087:0:24487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789579295.366126:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277278848 00000100:00100000:2.0:1789579295.366129:0:23423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277278848 00000100:00100000:2.0:1789579295.366152:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277279104 00000100:00100000:2.0:1789579295.366155:0:23423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277279104 00000100:00100000:2.0:1789579295.366169:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789579295.366174:0:23423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277278848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579295.366206:0:23423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277278848:12345-0@lo:400:kworker.0 Request processed in 31us (6829us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579295.366211:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789579295.366222:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789579295.366227:0:23423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277279104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579295.366254:0:23423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277279104:12345-0@lo:400:kworker.0 Request processed in 27us (6799us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579295.366259:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789579295.366285:0:24736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277279232 00000100:00100000:2.0:1789579295.366288:0:24736:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277279232 00000100:00100000:2.0:1789579295.366315:0:24736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277279360 00000100:00100000:2.0:1789579295.366318:0:24736:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277279360 00000100:00100000:2.0:1789579295.366333:0:24736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789579295.366340:0:24736:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277279232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579295.366408:0:24736:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277279232:12345-0@lo:400:kworker.0 Request processed in 68us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579295.366422:0:24736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789579295.366434:0:24736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789579295.366439:0:24736:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3614:x1876509277279360:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789579295.366486:0:24736:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3614:x1876509277279360:12345-0@lo:8:kworker.0 Request processed in 45us (810us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789579295.366491:0:24736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1789579295.366517:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789579295.366520:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789579295.366522:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789579295.366562:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277278848:0@lo:400:kworker.0 00010000:00080000:2.0:1789579295.366578:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939304886a00 x1876509277279488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579295.366589:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277279488:0@lo:400:kworker.0 00010000:00080000:2.0:1789579295.366600:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939304884e00 x1876509277278976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579295.366608:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277278976:0@lo:400:kworker.0 00010000:00080000:2.0:1789579295.366618:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939304885c00 x1876509277279616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579295.366625:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876509277279616:0@lo:400:kworker.0 00010000:00080000:2.0:1789579295.366666:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939304887480 x1876509277279232/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789579311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579295.366675:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277279232:0@lo:400:kworker.0 00000100:00100000:2.0:1789579295.366685:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277279104:0@lo:400:kworker.0 00010000:00080000:2.0:1789579295.366703:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939304886680 x1876509277279744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579295.366710:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277279744:0@lo:400:kworker.0 00000100:00100000:2.0:1789579295.366744:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789579295.366750:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939404134800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789579295.366754:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789579295.366757:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277279360:0@lo:8:kworker.0 00000020:01000004:2.0:1789579295.370441:0:25015:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789579295.370458:0:25015:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff93943f540000) 00000020:00000080:2.0:1789579295.370483:0:25015:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1789579295.370586:0:25015:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93942e142800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789579295.370591:0:25015:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93942e142800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789579295.370594:0:25015:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93942e142800 3 00010000:00080000:2.0:1789579295.370624:0:25015:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9393029db000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.137@tcp at head 00010000:00010000:2.0:1789579295.379670:0:25015:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1789579295.380779:0:25015:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1789579295.380827:0:25015:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789579295.380840:0:25015:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xd90373d592f22a4e 00000100:00080000:2.0:1789579295.380850:0:25015:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789579295.380861:0:25015:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9393029db000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:2.0:1789579295.380895:0:25015:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9393048ed500 x1876509277279872/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789579295.380937:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3614:1876509277279872:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789579295.381009:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579295.381068:0:24487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277279872 00000100:00100000:2.0:1789579295.381076:0:24487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277279872 00000100:00100000:2.0:1789579295.381111:0:24487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789579295.381118:0:24487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3614:x1876509277279872:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789579295.381144:0:24487:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 650 last 0 00000020:00000080:2.0:1789579295.381174:0:24487:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xd90373d592f22a55 00000004:00100000:2.0:1789579295.381187:0:24487:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789579295.381213:0:24487:0:(import.c:65:import_set_state_nolock()) ffff9393029de800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789579295.381260:0:24487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1876509277279872:12345-0@lo:38:llog_process_th.0 Request processed in 141us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579295.381267:0:24487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789579295.381303:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9393048ed500 x1876509277279872/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789579305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579295.381312:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789579295.381320:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1789579295.381326:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789579295.381330:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789579295.381332:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9393029db000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789579295.381338:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3614:1876509277279872:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789579295.381374:0:25015:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789579295.381393:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789579295.381397:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789579295.381400:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789579295.381403:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1789579295.383586:0:25015:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1789579295.384196:0:25004:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789579295.384225:0:25004:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789579295.384248:0:25004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f22a24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22a2b expref: -99 pid: 25004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579295.384259:0:25004:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f22a24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22a2b expref: -99 pid: 25004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789579295.384313:0:25004:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789579295.384316:0:25004:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789579295.384317:0:25004:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789579295.384319:0:25004:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789579295.384320:0:25004:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789579295.384322:0:25004:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789579295.384323:0:25004:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789579295.384325:0:25004:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789579295.384326:0:25004:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789579295.384330:0:25004:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1789579295.384332:0:25004:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789579295.384334:0:25004:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789579295.384335:0:25004:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789579295.384336:0:25004:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789579295.384337:0:25004:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789579295.384338:0:25004:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789579295.384339:0:25004:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789579295.384340:0:25004:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789579295.384341:0:25004:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789579295.384385:0:25004:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789579295.384405:0:25004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277280000:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789579295.384466:0:25004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579295.384499:0:25004:0:(client.c:2716:ptlrpc_set_wait()) set ffff939403def9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789579295.384536:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277280000 00000100:00100000:0.0:1789579295.384542:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277280000 00000100:00100000:0.0:1789579295.384595:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789579295.384603:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393042f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+24:25004:x1876509277280000:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789579295.384628:0:22674:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789579295.384647:0:22674:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789579295.386281:0:22674:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789579295.386299:0:22674:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789579295.386490:0:22696:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789579295.386502:0:22696:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789579295.386522:0:22696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9394363ae000/0xd90373d592f22a5c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.386538:0:22696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939401519800/0xd90373d592f229d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f229c9 expref: 24 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.386558:0:22696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939302b2ec00/0xd90373d592f229de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f229d7 expref: 24 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.386565:0:22696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9394363ae000/0xd90373d592f22a5c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.386598:0:22696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939302b2ec00/0xd90373d592f229de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f229d7 expref: 24 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.386611:0:22696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939302b2ec00/0xd90373d592f229de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f229d7 expref: 24 pid: 22673 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579295.386624:0:22696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ed500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22696:1876509277280128:0@lo:104: 00000100:00100000:2.0:1789579295.386673:0:22696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789579295.386710:0:22696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939401519800/0xd90373d592f229d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f229c9 expref: 24 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.386718:0:22696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939401519800/0xd90373d592f229d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f229c9 expref: 24 pid: 22675 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579295.386727:0:22696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304886680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22696:1876509277280256:0@lo:104: 00000100:00100000:2.0:1789579295.386759:0:22696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579295.386777:0:22696:0:(client.c:2716:ptlrpc_set_wait()) set ffff93940810f480 going to sleep for 11 seconds 00000100:00100000:2.0:1789579295.386795:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277280128 00000100:00100000:2.0:1789579295.386807:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277280128 00000100:00100000:2.0:1789579295.386837:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277280256 00000100:00100000:2.0:1789579295.386840:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277280256 00000100:00100000:2.0:1789579295.386854:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789579295.386861:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304884a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39addb08-5233-4b30-82ca-229405d26fae+4:22696:x1876509277280128:12345-0@lo:104: 00010000:00010000:2.0:1789579295.386872:0:22664:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939302b2f000/0xd90373d592f229d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f229de expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.386922:0:22664:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789579295.386928:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304884a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39addb08-5233-4b30-82ca-229405d26fae+4:22696:x1876509277280128:12345-0@lo:104: Request processed in 67us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579295.386934:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789579295.387394:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789579295.387401:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304885880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39addb08-5233-4b30-82ca-229405d26fae+3:22696:x1876509277280256:12345-0@lo:104: 00010000:00010000:2.0:1789579295.387409:0:22664:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939401518e00/0xd90373d592f229c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f229d0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.387444:0:22664:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789579295.387448:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304885880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39addb08-5233-4b30-82ca-229405d26fae+3:22696:x1876509277280256:12345-0@lo:104: Request processed in 49us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579295.387453:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1789579295.387470:0:22668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789579295.387476:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939302b2f000/0xd90373d592f229d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f229de expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.387483:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939302b2f000 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:2.0:1789579295.387487:0:22668:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939302b2f000/0xd90373d592f229d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f229de expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.387506:0:22668:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939302b2f000/0xd90373d592f229d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f229de expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789579295.387514:0:22668:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939302b2f000/0xd90373d592f229d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f229de expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789579295.387520:0:22668:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789579295.387557:0:22668:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939302b2f000/0xd90373d592f229d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f229de expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.387564:0:22668:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789579295.387581:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939302b2f000/0xd90373d592f229d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f229de expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.387588:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939302b2f000/0xd90373d592f229d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f229de expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.387600:0:22668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789579295.387603:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939401518e00/0xd90373d592f229c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f229d0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.387608:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401518e00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:2.0:1789579295.387610:0:22668:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939401518e00/0xd90373d592f229c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f229d0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.387616:0:22668:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939401518e00/0xd90373d592f229c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f229d0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789579295.387622:0:22668:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939401518e00/0xd90373d592f229c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f229d0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789579295.387633:0:22668:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789579295.387646:0:22668:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939401518e00/0xd90373d592f229c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f229d0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.387652:0:22668:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789579295.387665:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939401518e00/0xd90373d592f229c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f229d0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.387672:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939401518e00/0xd90373d592f229c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f229d0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.387685:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579295.387687:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579295.387688:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579295.387694:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579295.387711:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39addb08-5233-4b30-82ca-229405d26fae:3616:1876509277280384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789579295.387739:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579295.387777:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39addb08-5233-4b30-82ca-229405d26fae:3617:1876509277280512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789579295.387799:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579295.387829:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277280384 00000100:00100000:2.0:1789579295.387834:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277280384 00010000:00010000:2.0:1789579295.387851:0:22666:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939302b2ec00/0xd90373d592f229de lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f229d7 expref: 25 pid: 22673 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579295.387868:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277280512 00000100:00100000:2.0:1789579295.387871:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277280512 00010000:00010000:2.0:1789579295.387880:0:22666:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939401519800/0xd90373d592f229d0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f229c9 expref: 26 pid: 22675 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579295.387905:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789579295.387911:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304884e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39addb08-5233-4b30-82ca-229405d26fae+26:3616:x1876509277280384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789579295.387920:0:22666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579295.387925:0:22666:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939302b2ec00/0xd90373d592f229de lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f229d7 expref: 26 pid: 22673 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.387934:0:22666:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939302b2ec00/0xd90373d592f229de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f229d7 expref: 26 pid: 22673 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.387948:0:22666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789579295.387976:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304884e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39addb08-5233-4b30-82ca-229405d26fae+26:3616:x1876509277280384:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579295.387982:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789579295.387994:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789579295.388000:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304886a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39addb08-5233-4b30-82ca-229405d26fae+25:3617:x1876509277280512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789579295.388007:0:22666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579295.388011:0:22666:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939401519800/0xd90373d592f229d0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f229c9 expref: 25 pid: 22675 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.388020:0:22666:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939401519800/0xd90373d592f229d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f229c9 expref: 25 pid: 22675 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.388031:0:22666:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9394363ae000/0xd90373d592f22a5c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.388039:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394363ae000/0xd90373d592f22a5c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789579295.388062:0:22666:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015818013s 00010000:00010000:2.0:1789579295.388067:0:22666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9394363ae000/0xd90373d592f22a5c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.388088:0:22666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9394363ae000/0xd90373d592f22a5c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.388095:0:22666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9394363ae000/0xd90373d592f22a5c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.388102:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9394363ae000/0xd90373d592f22a5c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.388108:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363ae000 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579295.388112:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9394363ae000/0xd90373d592f22a5c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.388119:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9394363ae000/0xd90373d592f22a5c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.388128:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9394363ae000/0xd90373d592f22a5c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.388136:0:22666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789579295.388164:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304886a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39addb08-5233-4b30-82ca-229405d26fae+25:3617:x1876509277280512:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579295.388170:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789579295.388209:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39addb08-5233-4b30-82ca-229405d26fae:3617:1876509277280512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789579295.388233:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39addb08-5233-4b30-82ca-229405d26fae:3616:1876509277280384:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789579295.388265:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939302b2ec00/0xd90373d592f229de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f229d7 expref: 24 pid: 22673 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579295.388275:0:22696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ed500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22696:1876509277280128:0@lo:104: 00010000:00010000:2.0:1789579295.388284:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939401519800/0xd90373d592f229d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f229c9 expref: 23 pid: 22675 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579295.388291:0:22696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304886680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22696:1876509277280256:0@lo:104: 00010000:00010000:2.0:1789579295.388319:0:22696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9394363ae000/0xd90373d592f22a5c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.388328:0:22696:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9394363ae000/0xd90373d592f22a5c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.388335:0:22696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9394363ae000/0xd90373d592f22a5c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579295.388341:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394363ae000/0xd90373d592f22a5c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579295.388644:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393042f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+22:25004:x1876509277280000:12345-0@lo:253:mount.lustre.0 Request processed in 4040us (4176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579295.388652:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789579295.388699:0:25004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39addb08-5233-4b30-82ca-229405d26fae:25004:1876509277280000:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789579295.388709:0:25004:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789579295.388712:0:25004:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789579295.388713:0:25004:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789579295.388715:0:25004:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789579295.388716:0:25004:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789579295.388717:0:25004:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789579295.388718:0:25004:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789579295.388720:0:25004:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789579295.388721:0:25004:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789579295.388723:0:25004:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789579295.388732:0:25004:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:0.0:1789579295.392498:0:25004:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1789579295.395214:0:25004:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789579295.395223:0:25004:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789579295.395255:0:25004:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789579295.395305:0:25004:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.137@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789579295.395326:0:25004:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1789579295.395342:0:25004:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1789579295.396085:0:25004:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789579295.396311:0:25004:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789579295.460582:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579296.099670:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277280768:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789579296.099737:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579296.099797:0:24190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277280768 00000100:00100000:3.0:1789579296.099805:0:24190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277280768 00000100:00100000:3.0:1789579296.099852:0:24190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789579296.099863:0:24190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277280768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789579296.099892:0:24190:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789579296.099938:0:24190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277280768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579296.099944:0:24190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789579296.099982:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93930489fb80 x1876509277280768/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789579312 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579296.100001:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277280768:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789579296.103672:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277280896:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789579296.103737:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579296.103790:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277280896 00000100:00100000:3.0:1789579296.103797:0:23423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277280896 00000100:00100000:3.0:1789579296.103840:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789579296.103849:0:23423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277280896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789579296.103890:0:23423:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789579296.103933:0:23423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277280896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579296.103939:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789579296.103983:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277280896:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789579296.107700:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277280640:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789579296.107773:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579296.111168:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277280640 00000100:00100000:0.0:1789579296.111183:0:22685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277280640 00000100:00100000:0.0:1789579296.111242:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789579296.111252:0:22685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277280640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789579296.111287:0:22685:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789579296.111380:0:22685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277280640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (3607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579296.111394:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789579296.111445:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277280640:0@lo:41:osp-pre-1-0.0 00000020:00000004:0.0:1789579296.373004:0:25071:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789579296.373639:0:25071:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1789579296.419426:0:22677:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789579296.419433:0:22677:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93943f647000 from 14 10000000:01000000:2.0:1789579296.419438:0:22677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789579296.419479:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363ae400/0xd90373d592f22a63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.419491:0:22677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff9394363ae400/0xd90373d592f22a63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.419511:0:22677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff9394363ae400/0xd90373d592f22a63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579296.419548:0:22677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304887480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277281024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789579296.419617:0:22677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579296.419656:0:22677:0:(client.c:2716:ptlrpc_set_wait()) set ffff939409505d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789579296.419680:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277281024 00000100:00100000:2.0:1789579296.419687:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277281024 00000100:00100000:2.0:1789579296.419751:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789579296.419759:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393042fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+22:22677:x1876509277281024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789579296.419773:0:22673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579296.419787:0:22673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394363af800/0xd90373d592f22a6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f22a63 expref: -99 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.419809:0:22673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394363af800/0xd90373d592f22a6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f22a63 expref: 23 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.419819:0:22673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394363af800/0xd90373d592f22a6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f22a63 expref: 23 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.419827:0:22673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363af800, rc 0) 00000100:00100000:2.0:1789579296.419862:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393042fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+23:22677:x1876509277281024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579296.419869:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789579296.419910:0:22677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304887480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277281024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789579296.419922:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff9394363ae400/0xd90373d592f22a63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22a6a expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.419936:0:22677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff9394363ae400/0xd90373d592f22a63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f22a6a expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579296.419977:0:22677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304887480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277281152:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789579296.420004:0:22677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579296.420026:0:22677:0:(client.c:2716:ptlrpc_set_wait()) set ffff939409505d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789579296.420028:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277281152 00000100:00100000:0.0:1789579296.420032:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277281152 00000100:00100000:0.0:1789579296.420074:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789579296.420081:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393042fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+23:22677:x1876509277281152:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789579296.420094:0:22674:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789579296.420109:0:22674:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789579296.420112:0:22674:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1789579296.420182:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393042fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+23:22677:x1876509277281152:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 102us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579296.420189:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789579296.420439:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789579276/real 1789579276] req@ffff9393048ec000 x1876509277268096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579296 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579296.420457:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9393048ec000 x1876509277268096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579296 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579296.420467:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789579276/real 1789579276] req@ffff9393048eca80 x1876509277268224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579296 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579296.420476:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9393048eca80 x1876509277268224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579296 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789579296.420490:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939436233000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789579296.420507:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789579296.420511:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277268096:0@lo:8:kworker.0 00000100:00080000:3.0:1789579296.420516:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939302b53800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789579296.420521:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789579296.420523:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277268224:0@lo:8:kworker.0 00000100:00100000:2.0:1789579296.421705:0:22677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304887480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277281152:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789579296.421779:0:22677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789579296.421787:0:22677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363ae400/0xd90373d592f22a63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22a6a expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.421797:0:22677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff9394363ae400/0xd90373d592f22a63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22a6a expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789579296.421807:0:22677:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789579296.421809:0:22677:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff939435d8b800 from 14 10000000:01000000:2.0:1789579296.421812:0:22677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789579296.421840:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363aee00/0xd90373d592f22a71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.421848:0:22677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff9394363aee00/0xd90373d592f22a71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.421870:0:22677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff9394363aee00/0xd90373d592f22a71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579296.421887:0:22677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304887480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277281280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789579296.421940:0:22677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579296.421975:0:22677:0:(client.c:2716:ptlrpc_set_wait()) set ffff939409505d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789579296.421992:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277281280 00000100:00100000:2.0:1789579296.421998:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277281280 00000100:00100000:2.0:1789579296.422033:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789579296.422041:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393042f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+23:22677:x1876509277281280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789579296.422052:0:22675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579296.422062:0:22675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394363aea00/0xd90373d592f22a78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f22a71 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.422268:0:22675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394363aea00/0xd90373d592f22a78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f22a71 expref: 24 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.422278:0:22675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394363aea00/0xd90373d592f22a78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f22a71 expref: 24 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.422285:0:22675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363aea00, rc 0) 00000100:00100000:2.0:1789579296.422319:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393042f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+24:22677:x1876509277281280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 279us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579296.422325:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789579296.422390:0:22677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304887480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277281280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789579296.422401:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff9394363aee00/0xd90373d592f22a71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22a78 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.422409:0:22677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff9394363aee00/0xd90373d592f22a71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f22a78 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579296.422448:0:22677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304887480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277281408:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789579296.422481:0:22677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579296.422496:0:22677:0:(client.c:2716:ptlrpc_set_wait()) set ffff939409505d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789579296.422508:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277281408 00000100:00100000:2.0:1789579296.422512:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277281408 00000100:00100000:2.0:1789579296.422547:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789579296.422554:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393042fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+24:22677:x1876509277281408:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789579296.422568:0:22673:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789579296.422582:0:22673:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789579296.422585:0:22673:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1789579296.422650:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393042fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+24:22677:x1876509277281408:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 96us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579296.422657:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789579296.422689:0:22677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304887480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277281408:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789579296.422726:0:22677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789579296.422731:0:22677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363aee00/0xd90373d592f22a71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22a78 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.422739:0:22677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff9394363aee00/0xd90373d592f22a71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22a78 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789579296.426499:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789579296.426508:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789579296.426512:0:36:0:(import.c:65:import_set_state_nolock()) ffff939436233000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789579296.426519:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 631 00000100:00080000:0.0:1789579296.426524:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789579296.426535:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff939436233000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:1.0:1789579296.434574:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9393043aaa00 x1876509277281536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789579296.434607:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789579296.434611:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789579296.434614:0:36:0:(import.c:65:import_set_state_nolock()) ffff939302b53800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789579296.434619:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 631 00000100:00080000:1.0:1789579296.434624:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789579296.434635:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff939302b53800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:1.0:1789579296.434648:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9393043aa680 x1876509277281664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789579296.434677:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789579296.434681:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789579296.434682:0:36:0:(import.c:65:import_set_state_nolock()) ffff939404134800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789579296.434688:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff939404134800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:1.0:1789579296.434697:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789579296.434713:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277281792:0@lo:400:kworker.0 00000100:00100000:1.0:1789579296.434771:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579296.434819:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277281792 00000100:00100000:1.0:1789579296.434843:0:22681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277281792 00000100:00100000:1.0:1789579296.434899:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789579296.434907:0:22681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277281792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579296.434955:0:22681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277281792:12345-0@lo:400:kworker.0 Request processed in 48us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579296.434978:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1789579296.435019:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9393043ab800 x1876509277281792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579296.435032:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277281792:0@lo:400:kworker.0 00000100:00100000:1.0:1789579296.435060:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9393043ab800 x1876509277281920/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789579296.435099:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277282048:0@lo:400:kworker.0 00000100:00100000:1.0:1789579296.435123:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579296.435151:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277282048 00000100:00100000:1.0:1789579296.435154:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277282048 00000100:00100000:1.0:1789579296.435179:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789579296.435185:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277282048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579296.435220:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277282048:12345-0@lo:400:kworker.0 Request processed in 35us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579296.435226:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1789579296.435252:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9393043abb80 x1876509277282048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579296.435261:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277282048:0@lo:400:kworker.0 00000100:00100000:1.0:1789579296.435304:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789579296.435311:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876509277282432:0@lo:400:kworker.0 00000100:00100000:1.0:1789579296.435336:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579296.435386:0:24054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277282432 00000100:00100000:1.0:1789579296.435390:0:24054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277282432 00000100:00100000:1.0:1789579296.435420:0:24054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789579296.435427:0:24054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876509277282432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579296.435467:0:24054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876509277282432:12345-0@lo:400:kworker.0 Request processed in 40us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579296.435473:0:24054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1789579296.435490:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789579296.435508:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9393043a9500 x1876509277282432/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579296.435518:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876509277282432:0@lo:400:kworker.0 00000100:00100000:1.0:1789579296.435563:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277282560:0@lo:400:kworker.0 00000100:00100000:1.0:1789579296.435591:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579296.435613:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277282560 00000100:00100000:1.0:1789579296.435617:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277282560 00000100:00100000:1.0:1789579296.435642:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789579296.435648:0:22680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876509277282560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579296.435681:0:22680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876509277282560:12345-0@lo:400:kworker.0 Request processed in 32us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579296.435686:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1789579296.435699:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789579296.435715:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9393043a9500 x1876509277282560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579296.435724:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277282560:0@lo:400:kworker.0 00000100:00100000:3.0:1789579296.438526:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277282176:0@lo:400:kworker.0 00000100:00100000:3.0:1789579296.438599:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579296.438631:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789579296.438637:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277282304:0@lo:400:kworker.0 00000100:00100000:3.0:1789579296.438665:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579296.441768:0:24054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277282176 00000100:00100000:1.0:1789579296.441783:0:24054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277282176 00000100:00100000:1.0:1789579296.441835:0:24054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277282304 00000100:00100000:1.0:1789579296.441838:0:24054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277282304 00000100:00100000:1.0:1789579296.441860:0:24054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789579296.441870:0:24054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876509277282176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579296.441960:0:24054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876509277282176:12345-0@lo:400:kworker.0 Request processed in 91us (3360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579296.441968:0:24054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789579296.441983:0:24054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789579296.441989:0:24054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277282304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579296.442028:0:24054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277282304:12345-0@lo:400:kworker.0 Request processed in 39us (3362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579296.442034:0:24054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1789579296.445318:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9393043a9c00 x1876509277282304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579296.445338:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277282304:0@lo:400:kworker.0 00010000:00080000:1.0:1789579296.445392:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9393043abb80 x1876509277282176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579296.445401:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277282176:0@lo:400:kworker.0 00000100:00100000:0.0:1789579296.446817:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277281536:0@lo:8:kworker.0 00000100:00100000:0.0:1789579296.446953:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579296.447038:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277281664:0@lo:8:kworker.0 00000100:00100000:0.0:1789579296.447187:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579296.464023:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277281920:0@lo:8:kworker.0 00000100:00100000:0.0:1789579296.464107:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579296.471240:0:24736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277281536 00000100:00100000:2.0:1789579296.471255:0:24736:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277281536 00000100:00100000:2.0:1789579296.471433:0:24186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277281664 00000100:00100000:2.0:1789579296.471438:0:24186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277281664 00000100:00100000:2.0:1789579296.471459:0:24186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789579296.471468:0:24186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3614:x1876509277281536:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789579296.471501:0:24186:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 651 last 0 00000020:00000080:2.0:1789579296.471531:0:24186:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd90373d592f22a7f 00002000:00100000:2.0:1789579296.471567:0:24186:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9393029de000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789579296.471572:0:24186:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1789579296.471575:0:24186:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789579296.471645:0:24186:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789579296.471669:0:24186:0:(import.c:65:import_set_state_nolock()) ffff9393029dd800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789579296.471740:0:24186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3614:x1876509277281536:12345-0@lo:8:kworker.0 Request processed in 273us (24787us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579296.471748:0:24186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789579296.471764:0:24186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789579296.471768:0:24186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3614:x1876509277281664:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789579296.471782:0:24186:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 651 last 0 00000020:00000080:2.0:1789579296.471798:0:24186:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd90373d592f22a86 00002000:00100000:2.0:1789579296.471803:0:24186:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9393029d8800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789579296.471806:0:24186:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1789579296.471808:0:24186:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789579296.471948:0:24186:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789579296.471960:0:24186:0:(import.c:65:import_set_state_nolock()) ffff9393029da000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789579296.471989:0:24186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3614:x1876509277281664:12345-0@lo:8:kworker.0 Request processed in 219us (24801us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579296.471995:0:24186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789579296.475569:0:24186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277281920 00000100:00100000:2.0:1789579296.475585:0:24186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277281920 00000100:00100000:2.0:1789579296.475635:0:24186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789579296.475643:0:24186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3614:x1876509277281920:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789579296.475677:0:24186:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 651 last 0 00000020:00000080:2.0:1789579296.475708:0:24186:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd90373d592f22a8d 00002000:00100000:2.0:1789579296.475732:0:24186:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9393029d9000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1789579296.475736:0:24186:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1789579296.475738:0:24186:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789579296.475792:0:24186:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1789579296.475819:0:24186:0:(import.c:65:import_set_state_nolock()) ffff9393029dd000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789579296.475943:0:24186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3614:x1876509277281920:12345-0@lo:8:kworker.0 Request processed in 300us (11835us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579296.475951:0:24186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1789579296.476260:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9393043ab800 x1876509277281920/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789579321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789579296.476276:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1789579296.476283:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789579296.476288:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789579296.476291:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939404134800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789579296.476310:0:3614:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789579296.476316:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277281920:0@lo:8:kworker.0 00010000:00080000:1.0:1789579296.476370:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9393043aaa00 x1876509277281536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789579321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579296.476392:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789579296.476398:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1789579296.476403:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789579296.476406:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789579296.476408:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939436233000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789579296.476420:0:3614:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789579296.476424:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277281536:0@lo:8:kworker.0 00000004:00080000:1.0:1789579296.476466:0:22705:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:1.0:1789579296.476487:0:22705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043abb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22705:1876509277282816:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789579296.476522:0:22705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579296.476550:0:22705:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408f64540 going to sleep for 11 seconds 00000004:00080000:1.0:1789579296.476566:0:22704:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789579296.476634:0:22704:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 651609282719ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789579296.476641:0:22704:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1789579296.476661:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789579296.476670:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277282688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789579296.476698:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579296.476727:0:24190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277282688 00000100:00100000:1.0:1789579296.476731:0:24190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277282688 00000100:00100000:1.0:1789579296.476768:0:24190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789579296.476776:0:24190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1876509277282688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789579296.476790:0:24190:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789579296.476825:0:24190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1876509277282688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579296.476832:0:24190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789579296.476848:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1789579296.477219:0:23424:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789579296.477267:0:23424:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 651609916067ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789579296.477272:0:23424:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1789579296.478248:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277282816 00000100:00100000:0.0:1789579296.478256:0:24188:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277282816 00000100:00100000:0.0:1789579296.478296:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789579296.478304:0:24188:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22705:x1876509277282816:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789579296.478987:0:23425:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789579296.479007:0:23425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304885c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23425:1876509277283072:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1789579296.479057:0:23425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579296.479196:0:23425:0:(client.c:2716:ptlrpc_set_wait()) set ffff939409505d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789579296.479216:0:24186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277283072 00000100:00100000:2.0:1789579296.479221:0:24186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277283072 00000100:00100000:2.0:1789579296.479247:0:24186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789579296.479255:0:24186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304887100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23425:x1876509277283072:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:1.0:1789579296.480944:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789579296.480977:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277282944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789579296.481027:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789579296.482457:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9393043ab800 x1876509277282688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789579312 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579296.482485:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277282688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789579296.482534:0:24190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277282944 00000100:00100000:1.0:1789579296.482550:0:24190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277282944 00000100:00100000:1.0:1789579296.482598:0:24190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789579296.482609:0:24190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3616:x1876509277282944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789579296.482628:0:24190:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789579296.482695:0:24190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3616:x1876509277282944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (1666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579296.482702:0:24190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789579296.482740:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939304887480 x1876509277282944/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789579312 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579296.482753:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277282944:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1789579296.482782:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9393043aa680 x1876509277281664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789579321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579296.482789:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789579296.482796:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1789579296.482804:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789579296.482809:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789579296.482812:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939302b53800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789579296.482843:0:3614:0:(osp_dev.c:1648:osp_import_event()) got connected 00002000:00080000:0.0:1789579296.485013:0:24188:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1789579296.485025:0:24188:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:0.0:1789579296.485031:0:24188:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:65) 00010000:00010000:2.0:1789579296.486071:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579296.486603:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277281664:0@lo:8:kworker.0 00000004:00080000:3.0:1789579296.488256:0:22706:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789579296.488362:0:22706:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651620996757ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789579296.488372:0:22706:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00002000:00080000:3.0:1789579296.498378:0:24186:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1789579296.498388:0:24186:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1789579296.498481:0:24186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304887100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23425:x1876509277283072:12345-0@lo:7:osp-pre-1-1.0 Request processed in 19222us (19419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579296.498491:0:24186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1789579296.498596:0:23425:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939304885c00 x1876509277283072/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789579312 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579296.498612:0:23425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304885c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23425:1876509277283072:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1789579296.498626:0:23425:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1789579296.498666:0:23425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043aa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23425:1876509277283200:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1789579296.498701:0:23425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579296.498734:0:23425:0:(client.c:2716:ptlrpc_set_wait()) set ffff93942ef583c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789579296.498781:0:24736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277283200 00000100:00100000:3.0:1789579296.498787:0:24736:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277283200 00000100:00100000:3.0:1789579296.498830:0:24736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789579296.498839:0:24736:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23425:x1876509277283200:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1789579296.498872:0:24736:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1789579296.498905:0:24736:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23425:x1876509277283200:12345-0@lo:5:osp-pre-1-1.0 Request processed in 68us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579296.498911:0:24736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1789579296.498937:0:23425:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9393043aa680 x1876509277283200/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789579312 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579296.498946:0:23425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043aa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23425:1876509277283200:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1789579296.498955:0:23425:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1789579296.498977:0:23425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23425:1876509277283328:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1789579296.498999:0:23425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579296.499023:0:23425:0:(client.c:2716:ptlrpc_set_wait()) set ffff939429192e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789579296.499035:0:24186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277283328 00000100:00100000:3.0:1789579296.499038:0:24186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277283328 00000100:00100000:3.0:1789579296.499056:0:24186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789579296.499062:0:24186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23425:x1876509277283328:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1789579296.499100:0:24186:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000004:00080000:1.0:1789579296.501612:0:23413:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:3.0:1789579296.502004:0:22660:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1789579296.502018:0:22660:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:0.0:1789579296.516367:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789579296.516380:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009204c59b/0xd90373d592f22a94 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.516398:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1789579296.516403:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789579296.516409:0:24188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009204c59b/0xd90373d592f22a94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.516427:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009204c59b/0xd90373d592f22a94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.516438:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009204c59b/0xd90373d592f22a94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789579296.516452:0:22707:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:2.0:1789579296.516480:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304887480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22707:1876509277283584:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789579296.516578:0:22707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579296.516610:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff939409505480 going to sleep for 11 seconds 00000100:00100000:2.0:1789579296.516628:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277283456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789579296.516653:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579296.516696:0:24190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277283456 00000100:00100000:2.0:1789579296.516703:0:24190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277283456 00000100:00100000:2.0:1789579296.516752:0:24190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789579296.516760:0:24190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1876509277283456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789579296.516791:0:24190:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 896 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789579296.516836:0:24190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1876509277283456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579296.516842:0:24190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789579296.516936:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789579296.516965:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939304885c00 x1876509277283456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789579312 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579296.516986:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277283456:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789579296.517326:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009204c59b/0xd90373d592f22a94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.517371:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789579296.517433:0:22668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789579296.517439:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009204c59b/0xd90373d592f22a94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.517448:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939435d7a400 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579296.517452:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009204c59b/0xd90373d592f22a94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.517462:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009204c59b/0xd90373d592f22a94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.517481:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009204c59b/0xd90373d592f22a94 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.517488:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009204c59b/0xd90373d592f22a94 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.517509:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579296.517516:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579296.517518:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579296.518039:0:24736:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1789579296.518048:0:24736:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00002000:00010000:0.0:1789579296.518548:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789579296.518557:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3d83675/0xd90373d592f22a9b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.518570:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1789579296.518575:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789579296.518580:0:24188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3d83675/0xd90373d592f22a9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.518593:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3d83675/0xd90373d592f22a9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.518602:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3d83675/0xd90373d592f22a9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.518610:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3d83675/0xd90373d592f22a9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.518629:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789579296.518742:0:22669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789579296.518750:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3d83675/0xd90373d592f22a9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.518757:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939435d7a600 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579296.518762:0:22669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3d83675/0xd90373d592f22a9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.518772:0:22669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3d83675/0xd90373d592f22a9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.518789:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3d83675/0xd90373d592f22a9b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.518797:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3d83675/0xd90373d592f22a9b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.518813:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579296.518821:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579296.518823:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579296.518838:0:24736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277283584 00000100:00100000:3.0:1789579296.518846:0:24736:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277283584 00000100:00100000:3.0:1789579296.519440:0:25077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789579296.519451:0:25077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:22707:x1876509277283584:12345-0@lo:5:osp-pre-1-0.0 00002000:00010000:0.0:1789579296.526390:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789579296.526405:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000398aa15a/0xd90373d592f22aa2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.526422:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1789579296.526426:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789579296.526432:0:24188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000398aa15a/0xd90373d592f22aa2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.526464:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000398aa15a/0xd90373d592f22aa2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.526474:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000398aa15a/0xd90373d592f22aa2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.526481:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000398aa15a/0xd90373d592f22aa2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.526502:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789579296.526729:0:22668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789579296.526736:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000398aa15a/0xd90373d592f22aa2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.526744:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939435d7ba00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:0.0:1789579296.526748:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000398aa15a/0xd90373d592f22aa2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.526757:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000398aa15a/0xd90373d592f22aa2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.526776:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000398aa15a/0xd90373d592f22aa2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.526785:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000398aa15a/0xd90373d592f22aa2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.526812:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579296.526814:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579296.526815:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789579296.528082:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789579296.528095:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b606317/0xd90373d592f22aa9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.528109:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1789579296.528114:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789579296.528119:0:24188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b606317/0xd90373d592f22aa9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.528131:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b606317/0xd90373d592f22aa9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.528140:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b606317/0xd90373d592f22aa9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.528147:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b606317/0xd90373d592f22aa9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.528166:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1789579296.528328:0:25077:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1789579296.528337:0:25077:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1789579296.528343:0:25077:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00010000:00010000:2.0:1789579296.532585:0:22669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789579296.532598:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b606317/0xd90373d592f22aa9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.532612:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939435d7a800 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579296.532618:0:22669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b606317/0xd90373d592f22aa9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.532629:0:22669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b606317/0xd90373d592f22aa9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.532650:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b606317/0xd90373d592f22aa9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.532658:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b606317/0xd90373d592f22aa9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.532677:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579296.532679:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579296.532680:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789579296.544835:0:25005:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:2.0:1789579296.544850:0:25005:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1789579296.545145:0:25005:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789579296.545344:0:24186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23425:x1876509277283328:12345-0@lo:5:osp-pre-1-1.0 Request processed in 46278us (46340us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1789579296.545379:0:24186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1789579296.545517:0:23425:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93930489f800 x1876509277283328/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789579312 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579296.545530:0:23425:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1789579296.545559:0:23425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23425:1876509277283328:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1789579296.545574:0:23425:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:2.0:1789579296.545621:0:23425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ed500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23425:1876509277283712:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1789579296.545654:0:23425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1789579296.547758:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789579296.547777:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2b7779e/0xd90373d592f22ab0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.547794:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1789579296.547798:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789579296.547805:0:24188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2b7779e/0xd90373d592f22ab0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.547820:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2b7779e/0xd90373d592f22ab0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.547831:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2b7779e/0xd90373d592f22ab0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.547838:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2b7779e/0xd90373d592f22ab0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.547855:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789579296.548031:0:22668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789579296.548038:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2b7779e/0xd90373d592f22ab0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.548046:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437600 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:0.0:1789579296.548051:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2b7779e/0xd90373d592f22ab0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.548059:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2b7779e/0xd90373d592f22ab0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.548083:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2b7779e/0xd90373d592f22ab0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.548091:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2b7779e/0xd90373d592f22ab0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.548108:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579296.548110:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579296.548111:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579296.548387:0:23425:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394012edc00 going to sleep for 11 seconds 00002000:00010000:0.0:1789579296.550601:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789579296.550615:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048832481/0xd90373d592f22ab7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.550631:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1789579296.550636:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789579296.550643:0:24188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048832481/0xd90373d592f22ab7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.550659:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048832481/0xd90373d592f22ab7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.550670:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048832481/0xd90373d592f22ab7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.550678:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048832481/0xd90373d592f22ab7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.550721:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789579296.551112:0:22669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789579296.551119:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048832481/0xd90373d592f22ab7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.551128:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436c00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579296.551132:0:22669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048832481/0xd90373d592f22ab7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.551141:0:22669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048832481/0xd90373d592f22ab7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.551156:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048832481/0xd90373d592f22ab7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.551164:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048832481/0xd90373d592f22ab7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.551184:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579296.551186:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579296.551188:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789579296.552710:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789579296.552723:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c47208ff/0xd90373d592f22abe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.552737:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1789579296.552742:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789579296.552747:0:24188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c47208ff/0xd90373d592f22abe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.552760:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c47208ff/0xd90373d592f22abe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.552770:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c47208ff/0xd90373d592f22abe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.552778:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c47208ff/0xd90373d592f22abe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.552800:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789579296.553491:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789579296.553498:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000344c5080/0xd90373d592f22ac5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.553508:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1789579296.553519:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789579296.553524:0:24188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000344c5080/0xd90373d592f22ac5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.553543:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000344c5080/0xd90373d592f22ac5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.553552:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000344c5080/0xd90373d592f22ac5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.553560:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000344c5080/0xd90373d592f22ac5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.553656:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1789579296.554134:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277283712 00000100:00100000:1.0:1789579296.554145:0:22692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277283712 00000100:00100000:1.0:1789579296.554604:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789579296.554614:0:22692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23425:x1876509277283712:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1789579296.554710:0:22692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23425:x1876509277283712:12345-0@lo:900:osp-pre-1-1.0 Request processed in 97us (9054us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579296.554717:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00002000:00010000:1.0:1789579296.555324:0:25077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789579296.555333:0:25077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb9e13e9/0xd90373d592f22acc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.555346:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=651s v=(0 0) 00010000:00010000:1.0:1789579296.555373:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789579296.555379:0:25077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb9e13e9/0xd90373d592f22acc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.555402:0:25077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb9e13e9/0xd90373d592f22acc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.555412:0:25077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb9e13e9/0xd90373d592f22acc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.555420:0:25077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb9e13e9/0xd90373d592f22acc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789579296.555628:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789579296.555635:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008563646b/0xd90373d592f22ad3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.555643:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1789579296.555646:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789579296.555650:0:24188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008563646b/0xd90373d592f22ad3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.555660:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008563646b/0xd90373d592f22ad3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.555669:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008563646b/0xd90373d592f22ad3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.555681:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008563646b/0xd90373d592f22ad3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.556001:0:22668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789579296.556009:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c47208ff/0xd90373d592f22abe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.556018:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437000 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579296.556022:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c47208ff/0xd90373d592f22abe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.556031:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c47208ff/0xd90373d592f22abe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.556047:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c47208ff/0xd90373d592f22abe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.556055:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c47208ff/0xd90373d592f22abe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.556086:0:22668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789579296.556090:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000344c5080/0xd90373d592f22ac5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.556097:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436400 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579296.556107:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000344c5080/0xd90373d592f22ac5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.556115:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000344c5080/0xd90373d592f22ac5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.556125:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000344c5080/0xd90373d592f22ac5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.556132:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000344c5080/0xd90373d592f22ac5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.556145:0:22668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789579296.556149:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb9e13e9/0xd90373d592f22acc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.556156:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401518e00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579296.556159:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb9e13e9/0xd90373d592f22acc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.556166:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb9e13e9/0xd90373d592f22acc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.556177:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb9e13e9/0xd90373d592f22acc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.556185:0:22668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789579296.556194:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008563646b/0xd90373d592f22ad3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.556200:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437800 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579296.556203:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008563646b/0xd90373d592f22ad3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.556210:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008563646b/0xd90373d592f22ad3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.556220:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008563646b/0xd90373d592f22ad3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.556228:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579296.556230:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579296.556231:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579296.556699:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1789579296.556751:0:23425:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9393048ed500 x1876509277283712/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789579312 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579296.556766:0:23425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ed500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23425:1876509277283712:0@lo:900:osp-pre-1-1.0 00010000:00010000:1.0:1789579296.558960:0:25077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789579296.558974:0:25077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb9e13e9/0xd90373d592f22acc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.559480:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789579296.559487:0:24188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008563646b/0xd90373d592f22ad3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789579296.559939:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789579296.559948:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a2ff2b2/0xd90373d592f22ada lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.559962:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1789579296.559966:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789579296.559971:0:24188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a2ff2b2/0xd90373d592f22ada lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.559985:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a2ff2b2/0xd90373d592f22ada lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.559994:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a2ff2b2/0xd90373d592f22ada lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.560001:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a2ff2b2/0xd90373d592f22ada lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.560022:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789579296.560260:0:22669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789579296.560267:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a2ff2b2/0xd90373d592f22ada lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.560274:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436200 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579296.560279:0:22669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a2ff2b2/0xd90373d592f22ada lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.560286:0:22669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a2ff2b2/0xd90373d592f22ada lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.560301:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a2ff2b2/0xd90373d592f22ada lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.560308:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a2ff2b2/0xd90373d592f22ada lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.560327:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579296.560329:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579296.560331:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.561605:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789579296.561828:0:25077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789579296.561838:0:25077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000456b7528/0xd90373d592f22ae1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.561852:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1789579296.561864:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789579296.561870:0:25077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000456b7528/0xd90373d592f22ae1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.561885:0:25077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000456b7528/0xd90373d592f22ae1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.561894:0:25077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000456b7528/0xd90373d592f22ae1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.561902:0:25077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000456b7528/0xd90373d592f22ae1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.561924:0:25077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789579296.562420:0:25077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789579296.562427:0:25077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a225e18c/0xd90373d592f22ae8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.562436:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1789579296.562445:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789579296.562450:0:25077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a225e18c/0xd90373d592f22ae8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.562460:0:25077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a225e18c/0xd90373d592f22ae8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.562468:0:25077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a225e18c/0xd90373d592f22ae8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.562475:0:25077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a225e18c/0xd90373d592f22ae8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.562487:0:25077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789579296.562705:0:22668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789579296.562712:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000456b7528/0xd90373d592f22ae1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.562721:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437200 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579296.562726:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000456b7528/0xd90373d592f22ae1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.562734:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000456b7528/0xd90373d592f22ae1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.562762:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000456b7528/0xd90373d592f22ae1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.562770:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000456b7528/0xd90373d592f22ae1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.562789:0:22668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579296.562792:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a225e18c/0xd90373d592f22ae8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.562798:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436e00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579296.562801:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a225e18c/0xd90373d592f22ae8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.562808:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a225e18c/0xd90373d592f22ae8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.562818:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a225e18c/0xd90373d592f22ae8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.562825:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a225e18c/0xd90373d592f22ae8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.562838:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.562840:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.562847:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789579296.562908:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789579296.562914:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000e8e973/0xd90373d592f22aef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.562922:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=651s v=(0 0) 00010000:00010000:1.0:1789579296.562925:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789579296.562928:0:24188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000e8e973/0xd90373d592f22aef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.562939:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000e8e973/0xd90373d592f22aef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.562947:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000e8e973/0xd90373d592f22aef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.562954:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000e8e973/0xd90373d592f22aef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.562973:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789579296.563198:0:22668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789579296.563204:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000e8e973/0xd90373d592f22aef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.563211:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401519800 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:0.0:1789579296.563214:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000e8e973/0xd90373d592f22aef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.563221:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000e8e973/0xd90373d592f22aef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.563232:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000e8e973/0xd90373d592f22aef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.563252:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000e8e973/0xd90373d592f22aef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.563268:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579296.563270:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579296.563271:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789579296.563696:0:25077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789579296.563702:0:25077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a692f39e/0xd90373d592f22af6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.563712:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1789579296.563716:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789579296.563721:0:25077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a692f39e/0xd90373d592f22af6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.563731:0:25077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a692f39e/0xd90373d592f22af6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.563739:0:25077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a692f39e/0xd90373d592f22af6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.563745:0:25077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a692f39e/0xd90373d592f22af6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.563763:0:25077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789579296.564249:0:22669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789579296.564256:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a692f39e/0xd90373d592f22af6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.564278:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436000 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579296.564281:0:22669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a692f39e/0xd90373d592f22af6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.564289:0:22669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a692f39e/0xd90373d592f22af6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.564306:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a692f39e/0xd90373d592f22af6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.564312:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a692f39e/0xd90373d592f22af6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.564335:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579296.564337:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579296.564338:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.564660:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789579296.564724:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789579296.564730:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000650a967e/0xd90373d592f22afd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.564740:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=651s v=(0 0) 00010000:00010000:1.0:1789579296.564743:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789579296.564747:0:24188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000650a967e/0xd90373d592f22afd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.564764:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000650a967e/0xd90373d592f22afd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.564773:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000650a967e/0xd90373d592f22afd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.564780:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000650a967e/0xd90373d592f22afd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.564797:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789579296.564941:0:22669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579296.564947:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000650a967e/0xd90373d592f22afd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.564954:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401518c00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579296.564958:0:22669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000650a967e/0xd90373d592f22afd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.564966:0:22669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000650a967e/0xd90373d592f22afd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.564978:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000650a967e/0xd90373d592f22afd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.564985:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000650a967e/0xd90373d592f22afd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.565008:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.565010:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.565011:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789579296.565732:0:25077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789579296.565750:0:25077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f98167f/0xd90373d592f22b04 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.565762:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1789579296.565766:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789579296.565771:0:25077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f98167f/0xd90373d592f22b04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.565781:0:25077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f98167f/0xd90373d592f22b04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.565790:0:25077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f98167f/0xd90373d592f22b04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.565796:0:25077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f98167f/0xd90373d592f22b04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.565813:0:25077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789579296.565985:0:22668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579296.565992:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f98167f/0xd90373d592f22b04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.565999:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437400 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579296.566003:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f98167f/0xd90373d592f22b04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.566012:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f98167f/0xd90373d592f22b04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.566025:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f98167f/0xd90373d592f22b04 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.566031:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f98167f/0xd90373d592f22b04 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.566048:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.566050:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.566051:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789579296.566218:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789579296.566224:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098f6463f/0xd90373d592f22b0b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.566244:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=651s v=(0 0) 00010000:00010000:1.0:1789579296.566247:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789579296.566251:0:24188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098f6463f/0xd90373d592f22b0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.566261:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098f6463f/0xd90373d592f22b0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.566269:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098f6463f/0xd90373d592f22b0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.566275:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098f6463f/0xd90373d592f22b0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.566290:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789579296.567214:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789579296.567222:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b01e09a/0xd90373d592f22b12 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.567234:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=651s v=(0 0) 00010000:00010000:1.0:1789579296.567238:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789579296.567242:0:24188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b01e09a/0xd90373d592f22b12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.567253:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b01e09a/0xd90373d592f22b12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.567272:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b01e09a/0xd90373d592f22b12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.567279:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b01e09a/0xd90373d592f22b12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.567301:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789579296.567455:0:22669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789579296.567462:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098f6463f/0xd90373d592f22b0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.567469:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401519400 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579296.567474:0:22669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098f6463f/0xd90373d592f22b0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.567482:0:22669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098f6463f/0xd90373d592f22b0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.567496:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098f6463f/0xd90373d592f22b0b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.567504:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098f6463f/0xd90373d592f22b0b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.567518:0:22669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579296.567527:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b01e09a/0xd90373d592f22b12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.567732:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789579296.568810:0:25077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789579296.568819:0:25077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2b7779e/0xd90373d592f22b19 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.568834:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1789579296.568838:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789579296.568843:0:25077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2b7779e/0xd90373d592f22b19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.568877:0:25077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2b7779e/0xd90373d592f22b19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.568885:0:25077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2b7779e/0xd90373d592f22b19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.568892:0:25077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2b7779e/0xd90373d592f22b19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.568909:0:25077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789579296.568920:0:22668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579296.569500:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394041dac00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579296.569506:0:22669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b01e09a/0xd90373d592f22b12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.569516:0:22669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b01e09a/0xd90373d592f22b12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.569532:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b01e09a/0xd90373d592f22b12 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.569549:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b01e09a/0xd90373d592f22b12 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.569566:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.569568:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.569570:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579296.571432:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579296.571445:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2b7779e/0xd90373d592f22b19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.571459:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437600 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579296.571463:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2b7779e/0xd90373d592f22b19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.571474:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2b7779e/0xd90373d592f22b19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.571498:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2b7779e/0xd90373d592f22b19 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.571506:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2b7779e/0xd90373d592f22b19 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.571525:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579296.571526:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579296.571528:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579296.571551:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579296.571553:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789579296.572285:0:25077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789579296.572294:0:25077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9a911b8/0xd90373d592f22b20 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.572307:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1789579296.572311:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789579296.572317:0:25077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9a911b8/0xd90373d592f22b20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.572328:0:25077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9a911b8/0xd90373d592f22b20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.572337:0:25077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9a911b8/0xd90373d592f22b20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.572389:0:25077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9a911b8/0xd90373d592f22b20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.572416:0:25077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789579296.573011:0:22669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579296.573018:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9a911b8/0xd90373d592f22b20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.573026:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437e00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579296.573030:0:22669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9a911b8/0xd90373d592f22b20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.573052:0:22669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9a911b8/0xd90373d592f22b20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.573083:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9a911b8/0xd90373d592f22b20 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.573091:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9a911b8/0xd90373d592f22b20 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.573110:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.573112:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.573113:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789579296.573465:0:25077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789579296.573472:0:25077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ef19528/0xd90373d592f22b27 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.573480:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1789579296.573484:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789579296.573489:0:25077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ef19528/0xd90373d592f22b27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.573499:0:25077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ef19528/0xd90373d592f22b27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.573507:0:25077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ef19528/0xd90373d592f22b27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.573514:0:25077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ef19528/0xd90373d592f22b27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.573562:0:25077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789579296.574042:0:22668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579296.574048:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ef19528/0xd90373d592f22b27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.574056:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437a00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579296.574059:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ef19528/0xd90373d592f22b27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.574082:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ef19528/0xd90373d592f22b27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.574102:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ef19528/0xd90373d592f22b27 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.574120:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ef19528/0xd90373d592f22b27 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.574136:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.574138:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.574140:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789579296.574382:0:25077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789579296.574388:0:25077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c67ba499/0xd90373d592f22b2e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.574401:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1789579296.574405:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789579296.574409:0:25077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c67ba499/0xd90373d592f22b2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.574419:0:25077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c67ba499/0xd90373d592f22b2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.574427:0:25077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c67ba499/0xd90373d592f22b2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.574434:0:25077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c67ba499/0xd90373d592f22b2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.574452:0:25077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789579296.574758:0:25077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789579296.574764:0:25077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012930d81/0xd90373d592f22b35 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.574773:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1789579296.574775:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789579296.574779:0:25077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012930d81/0xd90373d592f22b35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.574787:0:25077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012930d81/0xd90373d592f22b35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.574806:0:25077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012930d81/0xd90373d592f22b35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.574814:0:25077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012930d81/0xd90373d592f22b35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.574827:0:25077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789579296.575284:0:25077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789579296.575290:0:25077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037ae8085/0xd90373d592f22b3c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.575300:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1789579296.575303:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789579296.575307:0:25077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037ae8085/0xd90373d592f22b3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.575317:0:25077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037ae8085/0xd90373d592f22b3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.575325:0:25077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037ae8085/0xd90373d592f22b3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.575333:0:25077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037ae8085/0xd90373d592f22b3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.575399:0:25077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1789579296.575556:0:22669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789579296.575563:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c67ba499/0xd90373d592f22b2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.575571:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436a00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579296.575575:0:22669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c67ba499/0xd90373d592f22b2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.575582:0:22669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c67ba499/0xd90373d592f22b2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.575595:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c67ba499/0xd90373d592f22b2e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.575603:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c67ba499/0xd90373d592f22b2e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.575625:0:22669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789579296.575628:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012930d81/0xd90373d592f22b35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.575640:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436800 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579296.575643:0:22669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012930d81/0xd90373d592f22b35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.575650:0:22669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012930d81/0xd90373d592f22b35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.575660:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012930d81/0xd90373d592f22b35 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.575667:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012930d81/0xd90373d592f22b35 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.575681:0:22669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579296.575684:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037ae8085/0xd90373d592f22b3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.575690:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437c00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579296.575693:0:22669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037ae8085/0xd90373d592f22b3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.575700:0:22669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037ae8085/0xd90373d592f22b3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.575710:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037ae8085/0xd90373d592f22b3c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.575723:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037ae8085/0xd90373d592f22b3c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.575736:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.575738:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.575739:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.575745:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.575749:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789579296.577294:0:25077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789579296.577306:0:25077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b737ec1/0xd90373d592f22b43 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.577319:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=651s v=(0 0) 00010000:00010000:2.0:1789579296.577323:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789579296.577328:0:25077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b737ec1/0xd90373d592f22b43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.577340:0:25077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b737ec1/0xd90373d592f22b43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.577376:0:25077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b737ec1/0xd90373d592f22b43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.577396:0:25077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b737ec1/0xd90373d592f22b43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.577414:0:25077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789579296.577955:0:22669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789579296.577963:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b737ec1/0xd90373d592f22b43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.577970:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363ae800 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:0.0:1789579296.577974:0:22669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b737ec1/0xd90373d592f22b43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.577983:0:22669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b737ec1/0xd90373d592f22b43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.577996:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b737ec1/0xd90373d592f22b43 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.578003:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b737ec1/0xd90373d592f22b43 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.578021:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579296.578023:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579296.578025:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789579296.578736:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579296.578744:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005065be3e/0xd90373d592f22b4a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.578755:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=651s v=(0 0) 00010000:00010000:3.0:1789579296.578759:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579296.578765:0:24188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005065be3e/0xd90373d592f22b4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.578777:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005065be3e/0xd90373d592f22b4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.578797:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005065be3e/0xd90373d592f22b4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.578804:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005065be3e/0xd90373d592f22b4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.578828:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789579296.579027:0:25077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789579296.579033:0:25077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000704b81c8/0xd90373d592f22b51 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.579042:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=651s v=(0 0) 00010000:00010000:2.0:1789579296.579045:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789579296.579049:0:25077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000704b81c8/0xd90373d592f22b51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.579058:0:25077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000704b81c8/0xd90373d592f22b51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.579724:0:22668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789579296.579732:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005065be3e/0xd90373d592f22b4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.579741:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939302b2f600 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:0.0:1789579296.579751:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005065be3e/0xd90373d592f22b4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.579760:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005065be3e/0xd90373d592f22b4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.579777:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005065be3e/0xd90373d592f22b4a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.579784:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005065be3e/0xd90373d592f22b4a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.579801:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579296.579803:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579296.579804:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579296.579846:0:25077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000704b81c8/0xd90373d592f22b51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.579921:0:25077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000704b81c8/0xd90373d592f22b51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.582595:0:25077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789579296.584014:0:25077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579296.584024:0:25077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da16ee2b/0xd90373d592f22b58 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.584041:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=651s v=(0 0) 00010000:00010000:3.0:1789579296.584046:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579296.584051:0:25077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da16ee2b/0xd90373d592f22b58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.584080:0:25077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da16ee2b/0xd90373d592f22b58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.584098:0:25077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da16ee2b/0xd90373d592f22b58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.584105:0:25077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da16ee2b/0xd90373d592f22b58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789579296.584596:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789579296.584603:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be810752/0xd90373d592f22b5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.584619:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=651s v=(0 0) 00010000:00010000:2.0:1789579296.584622:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789579296.584626:0:24188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be810752/0xd90373d592f22b5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.584637:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be810752/0xd90373d592f22b5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.584645:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be810752/0xd90373d592f22b5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.584652:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be810752/0xd90373d592f22b5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.585327:0:25081:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789579296.585335:0:25081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000704b81c8/0xd90373d592f22b51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.585345:0:25081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363afe00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:0.0:1789579296.585365:0:25081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000704b81c8/0xd90373d592f22b51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.585375:0:25081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000704b81c8/0xd90373d592f22b51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.585394:0:25081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000704b81c8/0xd90373d592f22b51 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.585410:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000704b81c8/0xd90373d592f22b51 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.585428:0:25081:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789579296.585432:0:25081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da16ee2b/0xd90373d592f22b58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.585439:0:25081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939302b2fc00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:0.0:1789579296.585442:0:25081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da16ee2b/0xd90373d592f22b58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.585449:0:25081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da16ee2b/0xd90373d592f22b58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.585460:0:25081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da16ee2b/0xd90373d592f22b58 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.585469:0:25081:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789579296.585472:0:25081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be810752/0xd90373d592f22b5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.585477:0:25081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af200 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:0.0:1789579296.585480:0:25081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be810752/0xd90373d592f22b5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.585500:0:25081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be810752/0xd90373d592f22b5f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.585511:0:25081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be810752/0xd90373d592f22b5f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579296.585519:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579296.585521:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579296.585523:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579296.586744:0:25077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789579296.586756:0:25077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da16ee2b/0xd90373d592f22b58 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.587438:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579296.587653:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789579296.587660:0:24188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be810752/0xd90373d592f22b5f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.588048:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789579296.588607:0:25077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789579296.588616:0:25077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047a9c971/0xd90373d592f22b66 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.588629:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=651s v=(0 0) 00010000:00010000:2.0:1789579296.588633:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789579296.588639:0:25077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047a9c971/0xd90373d592f22b66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.588665:0:25077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047a9c971/0xd90373d592f22b66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.588674:0:25077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047a9c971/0xd90373d592f22b66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.588681:0:25077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047a9c971/0xd90373d592f22b66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.588706:0:25077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789579296.589291:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789579296.589300:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b01e09a/0xd90373d592f22b6d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.589310:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=651s v=(0 0) 00010000:00010000:1.0:1789579296.589314:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789579296.589318:0:24188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b01e09a/0xd90373d592f22b6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.589328:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b01e09a/0xd90373d592f22b6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.589338:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b01e09a/0xd90373d592f22b6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.589346:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b01e09a/0xd90373d592f22b6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.589399:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789579296.589409:0:22669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789579296.589415:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047a9c971/0xd90373d592f22b66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.589424:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363ae600 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579296.589428:0:22669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047a9c971/0xd90373d592f22b66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.589436:0:22669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047a9c971/0xd90373d592f22b66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.589453:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047a9c971/0xd90373d592f22b66 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.589461:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047a9c971/0xd90373d592f22b66 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.589479:0:22669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579296.589483:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b01e09a/0xd90373d592f22b6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.589489:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394041dac00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579296.589493:0:22669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b01e09a/0xd90373d592f22b6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.589512:0:22669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b01e09a/0xd90373d592f22b6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.589523:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b01e09a/0xd90373d592f22b6d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.589530:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b01e09a/0xd90373d592f22b6d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.589554:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.589556:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.589557:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789579296.589990:0:25077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789579296.589997:0:25077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e778aca/0xd90373d592f22b74 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.590006:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=651s v=(0 0) 00010000:00010000:2.0:1789579296.590009:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789579296.590013:0:25077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e778aca/0xd90373d592f22b74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.590022:0:25077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e778aca/0xd90373d592f22b74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.590030:0:25077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e778aca/0xd90373d592f22b74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.590046:0:25077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e778aca/0xd90373d592f22b74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.590062:0:25077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789579296.590438:0:25081:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789579296.590444:0:25081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e778aca/0xd90373d592f22b74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.590453:0:25081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363ae000 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579296.590457:0:25081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e778aca/0xd90373d592f22b74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.590466:0:25081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e778aca/0xd90373d592f22b74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.590480:0:25081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e778aca/0xd90373d592f22b74 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.590488:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e778aca/0xd90373d592f22b74 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.590506:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579296.590508:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579296.590509:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.590595:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789579296.590816:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789579296.590822:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a1d0d8c/0xd90373d592f22b7b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.590831:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=651s v=(0 0) 00010000:00010000:2.0:1789579296.590834:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789579296.590838:0:24188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a1d0d8c/0xd90373d592f22b7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.590848:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a1d0d8c/0xd90373d592f22b7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789579296.590966:0:25077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579296.590978:0:25077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000989499fb/0xd90373d592f22b82 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.590990:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=651s v=(0 0) 00010000:00010000:3.0:1789579296.590993:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579296.590996:0:25077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000989499fb/0xd90373d592f22b82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.591004:0:25077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000989499fb/0xd90373d592f22b82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.591011:0:25077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000989499fb/0xd90373d592f22b82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.591017:0:25077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000989499fb/0xd90373d592f22b82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.591037:0:25077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789579296.591246:0:22669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579296.591253:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000989499fb/0xd90373d592f22b82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.591260:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939302b2fa00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579296.591264:0:22669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000989499fb/0xd90373d592f22b82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.591272:0:22669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000989499fb/0xd90373d592f22b82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.591283:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000989499fb/0xd90373d592f22b82 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.591299:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000989499fb/0xd90373d592f22b82 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.591316:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.591318:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.591319:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789579296.591693:0:25077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579296.591700:0:25077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000550c3b4c/0xd90373d592f22b89 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.591708:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=651s v=(0 0) 00010000:00010000:3.0:1789579296.591711:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579296.591716:0:25077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000550c3b4c/0xd90373d592f22b89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.591725:0:25077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000550c3b4c/0xd90373d592f22b89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.591740:0:25077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000550c3b4c/0xd90373d592f22b89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.591747:0:25077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000550c3b4c/0xd90373d592f22b89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.591769:0:25077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789579296.591932:0:25081:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579296.591938:0:25081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000550c3b4c/0xd90373d592f22b89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.591946:0:25081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939302b2f800 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579296.591950:0:25081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000550c3b4c/0xd90373d592f22b89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.591958:0:25081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000550c3b4c/0xd90373d592f22b89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.591970:0:25081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000550c3b4c/0xd90373d592f22b89 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.591977:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000550c3b4c/0xd90373d592f22b89 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.591991:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.591993:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.591995:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789579296.592334:0:25077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579296.592342:0:25077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055dfa66b/0xd90373d592f22b90 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.592382:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=651s v=(0 0) 00010000:00010000:3.0:1789579296.592385:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579296.592390:0:25077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055dfa66b/0xd90373d592f22b90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.592400:0:25077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055dfa66b/0xd90373d592f22b90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.592408:0:25077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055dfa66b/0xd90373d592f22b90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.592414:0:25077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055dfa66b/0xd90373d592f22b90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.592439:0:25077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789579296.592591:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a1d0d8c/0xd90373d592f22b7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.592602:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a1d0d8c/0xd90373d592f22b7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.592621:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789579296.592991:0:22668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789579296.592998:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055dfa66b/0xd90373d592f22b90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.593006:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939302b2ec00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579296.593010:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055dfa66b/0xd90373d592f22b90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.593019:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055dfa66b/0xd90373d592f22b90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.593032:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055dfa66b/0xd90373d592f22b90 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.593038:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055dfa66b/0xd90373d592f22b90 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.593055:0:22668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579296.593058:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a1d0d8c/0xd90373d592f22b7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.593080:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939400031c00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579296.593084:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a1d0d8c/0xd90373d592f22b7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.593222:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a1d0d8c/0xd90373d592f22b7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.593247:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a1d0d8c/0xd90373d592f22b7b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.593255:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a1d0d8c/0xd90373d592f22b7b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.593273:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.593275:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.593276:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789579296.593406:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789579296.593412:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d17c293a/0xd90373d592f22b97 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.593426:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=651s v=(0 0) 00010000:00010000:2.0:1789579296.593430:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789579296.593435:0:24188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d17c293a/0xd90373d592f22b97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.593444:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d17c293a/0xd90373d592f22b97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.593452:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d17c293a/0xd90373d592f22b97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.593459:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d17c293a/0xd90373d592f22b97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.593474:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789579296.593627:0:25081:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579296.593633:0:25081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d17c293a/0xd90373d592f22b97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.593640:0:25081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939400031400 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579296.593643:0:25081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d17c293a/0xd90373d592f22b97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.593650:0:25081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d17c293a/0xd90373d592f22b97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.593661:0:25081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d17c293a/0xd90373d592f22b97 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.593667:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d17c293a/0xd90373d592f22b97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.593691:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.593693:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.593695:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789579296.593977:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789579296.593983:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000468ef5b/0xd90373d592f22b9e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.593991:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=651s v=(0 0) 00010000:00010000:2.0:1789579296.593994:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789579296.593998:0:24188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000468ef5b/0xd90373d592f22b9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.594008:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000468ef5b/0xd90373d592f22b9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.594027:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000468ef5b/0xd90373d592f22b9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.594034:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000468ef5b/0xd90373d592f22b9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.594055:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789579296.594283:0:22669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789579296.594290:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000468ef5b/0xd90373d592f22b9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.594297:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939400030200 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579296.594301:0:22669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000468ef5b/0xd90373d592f22b9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.594309:0:22669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000468ef5b/0xd90373d592f22b9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.594320:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000468ef5b/0xd90373d592f22b9e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.594327:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000468ef5b/0xd90373d592f22b9e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.594342:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579296.594344:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579296.594345:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789579296.594406:0:25077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579296.594411:0:25077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074ff4df6/0xd90373d592f22ba5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.594418:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=651s v=(0 0) 00010000:00010000:3.0:1789579296.594427:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579296.594431:0:25077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074ff4df6/0xd90373d592f22ba5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.594440:0:25077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074ff4df6/0xd90373d592f22ba5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.594448:0:25077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074ff4df6/0xd90373d592f22ba5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.594455:0:25077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074ff4df6/0xd90373d592f22ba5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.594467:0:25077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789579296.595221:0:22668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579296.595230:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074ff4df6/0xd90373d592f22ba5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.595239:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939302b2f000 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579296.595243:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074ff4df6/0xd90373d592f22ba5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.595253:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074ff4df6/0xd90373d592f22ba5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.595266:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074ff4df6/0xd90373d592f22ba5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.595274:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074ff4df6/0xd90373d592f22ba5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.595295:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.595297:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.595299:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.595305:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789579296.595436:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789579296.595443:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009175fcf/0xd90373d592f22bac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.595453:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=651s v=(0 0) 00010000:00010000:2.0:1789579296.595457:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789579296.595462:0:24188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009175fcf/0xd90373d592f22bac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.595473:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009175fcf/0xd90373d592f22bac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.595482:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009175fcf/0xd90373d592f22bac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.595490:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009175fcf/0xd90373d592f22bac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.595522:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789579296.595804:0:22669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579296.595809:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009175fcf/0xd90373d592f22bac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.595824:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939400030e00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579296.595828:0:22669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009175fcf/0xd90373d592f22bac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.595835:0:22669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009175fcf/0xd90373d592f22bac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.595847:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009175fcf/0xd90373d592f22bac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.595920:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009175fcf/0xd90373d592f22bac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.595942:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.595943:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.595945:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789579296.597610:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789579296.597619:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000091b3132/0xd90373d592f22bb3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.597631:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=651s v=(0 0) 00010000:00010000:1.0:1789579296.597635:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789579296.597640:0:24188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000091b3132/0xd90373d592f22bb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.597650:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000091b3132/0xd90373d592f22bb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.597669:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000091b3132/0xd90373d592f22bb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.597675:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000091b3132/0xd90373d592f22bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.597700:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789579296.598343:0:25077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579296.598371:0:25077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da16ee2b/0xd90373d592f22bba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.598381:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=651s v=(0 0) 00010000:00010000:3.0:1789579296.598384:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579296.598389:0:25077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da16ee2b/0xd90373d592f22bba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.598399:0:25077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da16ee2b/0xd90373d592f22bba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.598407:0:25077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da16ee2b/0xd90373d592f22bba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.598422:0:25077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da16ee2b/0xd90373d592f22bba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.598438:0:25077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789579296.598597:0:22668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789579296.598604:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000091b3132/0xd90373d592f22bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.598613:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394041db600 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579296.598617:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000091b3132/0xd90373d592f22bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.598631:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000091b3132/0xd90373d592f22bb3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.598647:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000091b3132/0xd90373d592f22bb3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.598654:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000091b3132/0xd90373d592f22bb3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.598671:0:22668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789579296.598674:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da16ee2b/0xd90373d592f22bba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.598680:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939302b2fc00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579296.598683:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da16ee2b/0xd90373d592f22bba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.598701:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da16ee2b/0xd90373d592f22bba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.598713:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da16ee2b/0xd90373d592f22bba lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.598720:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da16ee2b/0xd90373d592f22bba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.598733:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579296.598735:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579296.598737:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.600418:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789579296.600727:0:25077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579296.600736:0:25077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005065be3e/0xd90373d592f22bc1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.600751:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=651s v=(0 0) 00010000:00010000:3.0:1789579296.600756:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579296.600761:0:25077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005065be3e/0xd90373d592f22bc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.600774:0:25077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005065be3e/0xd90373d592f22bc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.600783:0:25077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005065be3e/0xd90373d592f22bc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.600791:0:25077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005065be3e/0xd90373d592f22bc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.600804:0:25077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789579296.602269:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789579296.602281:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000757765e/0xd90373d592f22bc8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.602294:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=651s v=(0 0) 00010000:00010000:2.0:1789579296.602298:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789579296.602303:0:24188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000757765e/0xd90373d592f22bc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.602314:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000757765e/0xd90373d592f22bc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.602323:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000757765e/0xd90373d592f22bc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.602337:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000757765e/0xd90373d592f22bc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.602372:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789579296.602385:0:22668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789579296.602391:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005065be3e/0xd90373d592f22bc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.602399:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939302b2f600 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579296.602404:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005065be3e/0xd90373d592f22bc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.602413:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005065be3e/0xd90373d592f22bc1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.602431:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005065be3e/0xd90373d592f22bc1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.602439:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005065be3e/0xd90373d592f22bc1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.602457:0:22668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789579296.602460:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000757765e/0xd90373d592f22bc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.602479:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939400030800 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579296.602482:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000757765e/0xd90373d592f22bc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.602489:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000757765e/0xd90373d592f22bc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.602501:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000757765e/0xd90373d592f22bc8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.602508:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000757765e/0xd90373d592f22bc8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.602522:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579296.602524:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579296.602525:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789579296.604629:0:25077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579296.604641:0:25077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b606317/0xd90373d592f22bcf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.604661:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=651s v=(0 0) 00010000:00010000:3.0:1789579296.604665:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579296.604671:0:25077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b606317/0xd90373d592f22bcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.604684:0:25077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b606317/0xd90373d592f22bcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.604693:0:25077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b606317/0xd90373d592f22bcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.604701:0:25077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b606317/0xd90373d592f22bcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.604723:0:25077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789579296.604989:0:25081:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789579296.604996:0:25081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b606317/0xd90373d592f22bcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.605005:0:25081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939435d7a800 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579296.605009:0:25081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b606317/0xd90373d592f22bcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.605019:0:25081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b606317/0xd90373d592f22bcf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.605042:0:25081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b606317/0xd90373d592f22bcf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.605050:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b606317/0xd90373d592f22bcf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.605074:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579296.605076:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579296.605078:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789579296.606252:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579296.606262:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000398aa15a/0xd90373d592f22bd6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.606275:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=651s v=(0 0) 00010000:00010000:3.0:1789579296.606279:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579296.606284:0:24188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000398aa15a/0xd90373d592f22bd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.606296:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000398aa15a/0xd90373d592f22bd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.606316:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000398aa15a/0xd90373d592f22bd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.606323:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000398aa15a/0xd90373d592f22bd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.606340:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789579296.606780:0:22668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789579296.606787:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000398aa15a/0xd90373d592f22bd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.606796:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939435d7ba00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579296.606800:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000398aa15a/0xd90373d592f22bd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.606808:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000398aa15a/0xd90373d592f22bd6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.606823:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000398aa15a/0xd90373d592f22bd6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.606831:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000398aa15a/0xd90373d592f22bd6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.606872:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579296.606874:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579296.606876:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789579296.608338:0:25077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579296.608376:0:25077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009204c59b/0xd90373d592f22bdd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.608389:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=651s v=(0 0) 00010000:00010000:3.0:1789579296.608394:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579296.608399:0:25077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009204c59b/0xd90373d592f22bdd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.608413:0:25077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009204c59b/0xd90373d592f22bdd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.608422:0:25077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009204c59b/0xd90373d592f22bdd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.608431:0:25077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009204c59b/0xd90373d592f22bdd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.608465:0:25077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789579296.608728:0:25081:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789579296.608734:0:25081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009204c59b/0xd90373d592f22bdd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.608743:0:25081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939435d7a400 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579296.608747:0:25081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009204c59b/0xd90373d592f22bdd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.608757:0:25081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009204c59b/0xd90373d592f22bdd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.608771:0:25081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009204c59b/0xd90373d592f22bdd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.608779:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009204c59b/0xd90373d592f22bdd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.608796:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579296.608798:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579296.608800:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.609706:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789579296.609955:0:25077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579296.609964:0:25077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3d83675/0xd90373d592f22be4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.609977:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=651s v=(0 0) 00010000:00010000:3.0:1789579296.609982:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579296.609987:0:25077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3d83675/0xd90373d592f22be4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.610000:0:25077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3d83675/0xd90373d592f22be4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.610009:0:25077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3d83675/0xd90373d592f22be4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.610017:0:25077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3d83675/0xd90373d592f22be4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.610037:0:25077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789579296.610281:0:22668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789579296.610287:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3d83675/0xd90373d592f22be4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.610308:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939435d7a600 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579296.610312:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3d83675/0xd90373d592f22be4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.610321:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3d83675/0xd90373d592f22be4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.610334:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3d83675/0xd90373d592f22be4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.610341:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3d83675/0xd90373d592f22be4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.610376:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579296.610378:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579296.610379:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789579296.611323:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789579296.611332:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b01e09a/0xd90373d592f22beb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.611344:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=651s v=(0 0) 00010000:00010000:1.0:1789579296.611365:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789579296.611370:0:24188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b01e09a/0xd90373d592f22beb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.611380:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b01e09a/0xd90373d592f22beb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.611388:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b01e09a/0xd90373d592f22beb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.611395:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b01e09a/0xd90373d592f22beb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.611433:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789579296.612388:0:25081:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789579296.612397:0:25081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b01e09a/0xd90373d592f22beb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.612406:0:25081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394041dac00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579296.612416:0:25081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b01e09a/0xd90373d592f22beb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.612425:0:25081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b01e09a/0xd90373d592f22beb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.612441:0:25081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b01e09a/0xd90373d592f22beb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.612448:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b01e09a/0xd90373d592f22beb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.612467:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579296.612468:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579296.612470:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789579296.612953:0:25077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579296.612962:0:25077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccdfb408/0xd90373d592f22bf2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.612973:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=651s v=(0 0) 00010000:00010000:3.0:1789579296.612977:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579296.612983:0:25077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccdfb408/0xd90373d592f22bf2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.612996:0:25077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ccdfb408/0xd90373d592f22bf2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.613006:0:25077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccdfb408/0xd90373d592f22bf2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.613020:0:25077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ccdfb408/0xd90373d592f22bf2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.613035:0:25077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789579296.613325:0:22669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579296.613332:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ccdfb408/0xd90373d592f22bf2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.613340:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304367c00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579296.613344:0:22669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccdfb408/0xd90373d592f22bf2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.613367:0:22669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccdfb408/0xd90373d592f22bf2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.613381:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ccdfb408/0xd90373d592f22bf2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.613389:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccdfb408/0xd90373d592f22bf2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.613405:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.613406:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.613408:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789579296.613448:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789579296.613454:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004aa76c6a/0xd90373d592f22bf9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.613462:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=651s v=(0 0) 00010000:00010000:1.0:1789579296.613472:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789579296.613476:0:24188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004aa76c6a/0xd90373d592f22bf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.613485:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004aa76c6a/0xd90373d592f22bf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.613493:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004aa76c6a/0xd90373d592f22bf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.613500:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004aa76c6a/0xd90373d592f22bf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.613515:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789579296.615297:0:22668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789579296.615307:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004aa76c6a/0xd90373d592f22bf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.615319:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394041da600 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579296.615323:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004aa76c6a/0xd90373d592f22bf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.615333:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004aa76c6a/0xd90373d592f22bf9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.615371:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004aa76c6a/0xd90373d592f22bf9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.615378:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004aa76c6a/0xd90373d592f22bf9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579296.615397:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579296.615399:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579296.615400:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789579296.616505:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789579296.616513:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d952e3c/0xd90373d592f22c00 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.616524:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=651s v=(0 0) 00010000:00010000:1.0:1789579296.616528:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789579296.616533:0:24188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d952e3c/0xd90373d592f22c00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.616555:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d952e3c/0xd90373d592f22c00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.616564:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d952e3c/0xd90373d592f22c00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.616580:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d952e3c/0xd90373d592f22c00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.616600:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789579296.617313:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789579296.617320:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006784819f/0xd90373d592f22c07 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.617330:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=651s v=(0 0) 00010000:00010000:1.0:1789579296.617333:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789579296.617337:0:24188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006784819f/0xd90373d592f22c07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.617346:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006784819f/0xd90373d592f22c07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.617388:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006784819f/0xd90373d592f22c07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.617396:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006784819f/0xd90373d592f22c07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.617412:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789579296.617420:0:22669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789579296.617426:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d952e3c/0xd90373d592f22c00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.617440:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394041da800 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579296.617444:0:22669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d952e3c/0xd90373d592f22c00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.617452:0:22669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d952e3c/0xd90373d592f22c00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.617469:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d952e3c/0xd90373d592f22c00 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.617476:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d952e3c/0xd90373d592f22c00 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.617491:0:22669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579296.617494:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006784819f/0xd90373d592f22c07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.617500:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394041dbc00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579296.617503:0:22669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006784819f/0xd90373d592f22c07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.617510:0:22669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006784819f/0xd90373d592f22c07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.617519:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006784819f/0xd90373d592f22c07 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.617532:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006784819f/0xd90373d592f22c07 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.617554:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.617556:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.617558:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579296.617772:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789579296.617847:0:25077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789579296.617852:0:25077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d72b0f1/0xd90373d592f22c0e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.618014:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=651s v=(0 0) 00010000:00010000:1.0:1789579296.618018:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789579296.618022:0:25077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d72b0f1/0xd90373d592f22c0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.618033:0:25077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d72b0f1/0xd90373d592f22c0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.618042:0:25077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d72b0f1/0xd90373d592f22c0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.618048:0:25077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d72b0f1/0xd90373d592f22c0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.619612:0:25077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789579296.621055:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789579296.621087:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c00782a2/0xd90373d592f22c15 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.621110:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=651s v=(0 0) 00010000:00010000:1.0:1789579296.621114:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789579296.621119:0:24188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c00782a2/0xd90373d592f22c15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.621133:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c00782a2/0xd90373d592f22c15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.621144:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c00782a2/0xd90373d592f22c15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.621151:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c00782a2/0xd90373d592f22c15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.623489:0:22668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789579296.623504:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d72b0f1/0xd90373d592f22c0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.623517:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394041db400 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579296.623522:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d72b0f1/0xd90373d592f22c0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.624287:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d72b0f1/0xd90373d592f22c0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.624317:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d72b0f1/0xd90373d592f22c0e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.624327:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d72b0f1/0xd90373d592f22c0e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.624377:0:22668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789579296.624382:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c00782a2/0xd90373d592f22c15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.624402:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394041dbe00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579296.624406:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c00782a2/0xd90373d592f22c15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.624415:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c00782a2/0xd90373d592f22c15 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.624427:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c00782a2/0xd90373d592f22c15 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.624436:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579296.624438:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579296.624440:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789579296.625582:0:25077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579296.625594:0:25077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000417648be/0xd90373d592f22c1c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.625609:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=651s v=(0 0) 00010000:00010000:3.0:1789579296.625614:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579296.625621:0:25077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000417648be/0xd90373d592f22c1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.625634:0:25077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000417648be/0xd90373d592f22c1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.625644:0:25077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000417648be/0xd90373d592f22c1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.625665:0:25077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000417648be/0xd90373d592f22c1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.625688:0:25077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789579296.626574:0:25077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579296.626583:0:25077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d53fb66/0xd90373d592f22c23 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.626598:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=651s v=(0 0) 00010000:00010000:3.0:1789579296.626602:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579296.626607:0:25077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d53fb66/0xd90373d592f22c23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.626619:0:25077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d53fb66/0xd90373d592f22c23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.626628:0:25077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d53fb66/0xd90373d592f22c23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.626636:0:25077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d53fb66/0xd90373d592f22c23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.626654:0:25077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789579296.626664:0:25081:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789579296.626670:0:25081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000417648be/0xd90373d592f22c1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.626685:0:25081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304366000 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579296.626689:0:25081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000417648be/0xd90373d592f22c1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.626699:0:25081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000417648be/0xd90373d592f22c1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.626715:0:25081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000417648be/0xd90373d592f22c1c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.626723:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000417648be/0xd90373d592f22c1c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.626741:0:25081:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789579296.626745:0:25081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d53fb66/0xd90373d592f22c23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.626752:0:25081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304367a00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579296.626755:0:25081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d53fb66/0xd90373d592f22c23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.626763:0:25081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d53fb66/0xd90373d592f22c23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.626773:0:25081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d53fb66/0xd90373d592f22c23 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.626787:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d53fb66/0xd90373d592f22c23 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.626803:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579296.626805:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579296.626808:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.628592:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789579296.628603:0:24188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c00782a2/0xd90373d592f22c15 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.628648:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579296.628880:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789579296.628952:0:25077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579296.628960:0:25077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ec60156/0xd90373d592f22c2a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.628974:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=651s v=(0 0) 00010000:00010000:3.0:1789579296.628979:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579296.628984:0:25077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ec60156/0xd90373d592f22c2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.628997:0:25077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ec60156/0xd90373d592f22c2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.629006:0:25077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ec60156/0xd90373d592f22c2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.629014:0:25077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ec60156/0xd90373d592f22c2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.629031:0:25077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789579296.629049:0:25081:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789579296.629054:0:25081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ec60156/0xd90373d592f22c2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.629061:0:25081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304367000 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579296.629065:0:25081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ec60156/0xd90373d592f22c2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.629073:0:25081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ec60156/0xd90373d592f22c2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.629088:0:25081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ec60156/0xd90373d592f22c2a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.629095:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ec60156/0xd90373d592f22c2a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.629110:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579296.629111:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579296.629113:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789579296.629605:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789579296.629614:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000304605d6/0xd90373d592f22c31 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.629624:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=651s v=(0 0) 00010000:00010000:1.0:1789579296.629634:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789579296.629639:0:24188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000304605d6/0xd90373d592f22c31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.629650:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000304605d6/0xd90373d592f22c31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.629658:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000304605d6/0xd90373d592f22c31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.629665:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000304605d6/0xd90373d592f22c31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.629679:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789579296.629688:0:22669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579296.629692:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000304605d6/0xd90373d592f22c31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.629699:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394041db200 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579296.629703:0:22669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000304605d6/0xd90373d592f22c31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.629710:0:22669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000304605d6/0xd90373d592f22c31 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.629722:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000304605d6/0xd90373d592f22c31 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.629741:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000304605d6/0xd90373d592f22c31 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.629756:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.629758:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.629760:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789579296.630158:0:25077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579296.630165:0:25077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008de9c619/0xd90373d592f22c38 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.630174:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=651s v=(0 0) 00010000:00010000:3.0:1789579296.630177:0:25077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579296.630182:0:25077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008de9c619/0xd90373d592f22c38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.630202:0:25077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008de9c619/0xd90373d592f22c38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.630210:0:25077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008de9c619/0xd90373d592f22c38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.630218:0:25077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008de9c619/0xd90373d592f22c38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.630232:0:25077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789579296.630238:0:22668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789579296.630243:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008de9c619/0xd90373d592f22c38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.630249:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304366a00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579296.630253:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008de9c619/0xd90373d592f22c38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.630260:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008de9c619/0xd90373d592f22c38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.630271:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008de9c619/0xd90373d592f22c38 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.630279:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008de9c619/0xd90373d592f22c38 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579296.630302:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579296.630304:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579296.630305:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1789579296.630347:0:25077:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:3.0:1789579296.630461:0:25077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:22707:x1876509277283584:12345-0@lo:5:osp-pre-1-0.0 Request processed in 111009us (113879us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579296.630470:0:25077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00002000:00010000:1.0:1789579296.631013:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789579296.631021:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000902b4a5a/0xd90373d592f22c3f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.631031:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=651s v=(0 0) 00010000:00010000:1.0:1789579296.631035:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789579296.631040:0:24188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000902b4a5a/0xd90373d592f22c3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.631050:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000902b4a5a/0xd90373d592f22c3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.631058:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000902b4a5a/0xd90373d592f22c3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.631255:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000902b4a5a/0xd90373d592f22c3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.631275:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789579296.631285:0:25081:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579296.631296:0:25081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000902b4a5a/0xd90373d592f22c3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.631303:0:25081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394041dae00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579296.631307:0:25081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000902b4a5a/0xd90373d592f22c3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.631315:0:25081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000902b4a5a/0xd90373d592f22c3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.631327:0:25081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000902b4a5a/0xd90373d592f22c3f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.631335:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000902b4a5a/0xd90373d592f22c3f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.631368:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.631370:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.631371:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579296.631765:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304887480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22707:1876509277283584:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789579296.631782:0:22707:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:2.0:1789579296.631824:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304887480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22707:1876509277283840:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789579296.631938:0:22707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579296.631966:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff939441a2c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789579296.632020:0:24736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277283840 00000100:00100000:2.0:1789579296.632027:0:24736:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277283840 00000100:00100000:2.0:1789579296.632230:0:24736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789579296.632242:0:24736:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22707:x1876509277283840:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789579296.632281:0:24736:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00002000:00010000:1.0:1789579296.633034:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789579296.633044:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf64d70d/0xd90373d592f22c46 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.633058:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=651s v=(0 0) 00010000:00010000:1.0:1789579296.633062:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789579296.633081:0:24188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf64d70d/0xd90373d592f22c46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.634224:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf64d70d/0xd90373d592f22c46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.634235:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf64d70d/0xd90373d592f22c46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.634243:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf64d70d/0xd90373d592f22c46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.634261:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789579296.634276:0:22669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579296.634281:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf64d70d/0xd90373d592f22c46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.634289:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394041da200 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579296.634295:0:22669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf64d70d/0xd90373d592f22c46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.634304:0:22669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf64d70d/0xd90373d592f22c46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.634321:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf64d70d/0xd90373d592f22c46 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.634329:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf64d70d/0xd90373d592f22c46 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579296.634375:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.634377:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579296.634379:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1789579296.634731:0:24188:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:1.0:1789579296.634813:0:24188:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22705:x1876509277282816:12345-0@lo:5:osp-pre-0-0.0 Request processed in 156507us (158287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579296.634822:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789579296.637983:0:22705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043abb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22705:1876509277282816:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789579296.638002:0:22705:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:1.0:1789579296.638048:0:22705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043abb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22705:1876509277283968:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789579296.638311:0:22705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579296.638342:0:22705:0:(client.c:2716:ptlrpc_set_wait()) set ffff93942e07f840 going to sleep for 11 seconds 00000100:00100000:1.0:1789579296.638385:0:24186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277283968 00000100:00100000:1.0:1789579296.638391:0:24186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277283968 00000100:00100000:1.0:1789579296.638435:0:24186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789579296.638445:0:24186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22705:x1876509277283968:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789579296.638481:0:24186:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000100:00100000:2.0:1789579296.640391:0:24736:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22707:x1876509277283840:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8147us (8447us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1789579296.640404:0:24736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789579296.641311:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304887480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22707:1876509277283840:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789579296.641326:0:22707:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000001:00080000:1.0:1789579296.657487:0:24183:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:1.0:1789579296.657553:0:24183:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789579296.657705:0:24186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22705:x1876509277283968:12345-0@lo:5:osp-pre-0-0.0 Request processed in 19258us (19391us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1789579296.657715:0:24186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789579296.657769:0:22705:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1789579296.657778:0:22705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043abb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22705:1876509277283968:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789579296.657805:0:22705:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:3.0:1789579297.509798:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789579298.020209:0:23440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789579298.531668:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579299.555861:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579300.579666:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579301.219562:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277284096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789579301.219632:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579301.219712:0:22686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277284096 00000100:00100000:0.0:1789579301.219720:0:22686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277284096 00000100:00100000:0.0:1789579301.219961:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789579301.219971:0:22686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277284096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789579301.220005:0:22686:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789579301.220053:0:22686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277284096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579301.220060:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789579301.220104:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277284096:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789579301.221791:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277284224:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789579301.221863:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579301.221904:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789579301.221910:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277284352:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789579301.221934:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579301.222021:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277284224 00000100:00100000:2.0:1789579301.222028:0:23423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277284224 00000100:00100000:2.0:1789579301.222075:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789579301.222083:0:23423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277284224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789579301.222112:0:23423:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789579301.222166:0:23423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277284224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579301.222173:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789579301.222233:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277284224:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789579301.222458:0:24190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277284352 00000100:00100000:0.0:1789579301.222463:0:24190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277284352 00000100:00100000:0.0:1789579301.222523:0:24190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789579301.222531:0:24190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277284352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789579301.222551:0:24190:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789579301.222599:0:24190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277284352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579301.222606:0:24190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1789579301.222666:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789579301.223019:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277284352:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789579301.609828:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579301.733008:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39addb08-5233-4b30-82ca-229405d26fae:3617:1876509277284480:0@lo:400:kworker.0 00000100:00100000:1.0:1789579301.733077:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579301.733117:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277284992:0@lo:400:kworker.0 00000100:00100000:1.0:1789579301.733142:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579301.733161:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3617:1876509277285504:0@lo:400:kworker.0 00000100:00100000:1.0:1789579301.733183:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579301.733207:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789579301.733212:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277284608:0@lo:400:kworker.0 00000100:00100000:1.0:1789579301.733231:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579301.733247:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277285120:0@lo:400:kworker.0 00000100:00100000:1.0:1789579301.733265:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579301.733281:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876509277285632:0@lo:400:kworker.0 00000100:00100000:1.0:1789579301.733298:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579301.733335:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277284736:0@lo:400:kworker.0 00000100:00100000:1.0:1789579301.733381:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579301.733398:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277285248:0@lo:400:kworker.0 00000100:00100000:1.0:1789579301.733418:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579301.733433:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277285760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789579301.733452:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579301.733470:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789579301.733475:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277284864:0@lo:400:kworker.0 00000100:00100000:1.0:1789579301.733495:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579301.733523:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277285376:0@lo:400:kworker.0 00000100:00100000:1.0:1789579301.733542:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579301.733567:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277284480 00000100:00100000:1.0:1789579301.733574:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277284480 00000100:00100000:1.0:1789579301.733622:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789579301.733630:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393042fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+24:3617:x1876509277284480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579301.733675:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393042fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+24:3617:x1876509277284480:12345-0@lo:400:kworker.0 Request processed in 46us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579301.733682:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789579301.733713:0:24736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277284992 00000100:00100000:1.0:1789579301.733717:0:24736:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277284992 00000100:00100000:1.0:1789579301.733744:0:24736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277284608 00000100:00100000:1.0:1789579301.733747:0:24736:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277284608 00000100:00100000:1.0:1789579301.733763:0:24736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277284736 00000100:00100000:1.0:1789579301.733765:0:24736:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277284736 00000100:00100000:1.0:1789579301.733780:0:24736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789579301.733785:0:24736:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277284992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579301.733814:0:24736:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277284992:12345-0@lo:400:kworker.0 Request processed in 29us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579301.733826:0:24736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789579301.733838:0:24736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789579301.733844:0:24736:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277284608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579301.733873:0:24736:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277284608:12345-0@lo:400:kworker.0 Request processed in 29us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579301.733877:0:24736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789579301.733888:0:24736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789579301.733894:0:24736:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3615:x1876509277284736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579301.733923:0:24736:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3615:x1876509277284736:12345-0@lo:400:kworker.0 Request processed in 29us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579301.733928:0:24736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789579301.733945:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277285504 00000100:00100000:1.0:1789579301.733948:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277285504 00000100:00100000:1.0:1789579301.733967:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277285120 00000100:00100000:1.0:1789579301.733969:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277285120 00000100:00100000:1.0:1789579301.733979:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277285632 00000100:00100000:1.0:1789579301.733982:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277285632 00000100:00100000:1.0:1789579301.733992:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277285248 00000100:00100000:1.0:1789579301.733994:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277285248 00000100:00100000:1.0:1789579301.734004:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277284864 00000100:00100000:1.0:1789579301.734006:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277284864 00000100:00100000:1.0:1789579301.734015:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277285376 00000100:00100000:1.0:1789579301.734017:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277285376 00000100:00100000:1.0:1789579301.734029:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789579301.734034:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1876509277285504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579301.734063:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1876509277285504:12345-0@lo:400:kworker.0 Request processed in 28us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579301.734069:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789579301.734089:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789579301.734095:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876509277285120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579301.734122:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876509277285120:12345-0@lo:400:kworker.0 Request processed in 28us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579301.734127:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789579301.734138:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789579301.734145:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876509277285632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579301.734169:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876509277285632:12345-0@lo:400:kworker.0 Request processed in 25us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579301.734174:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789579301.734185:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789579301.734191:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876509277285248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579301.734216:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876509277285248:12345-0@lo:400:kworker.0 Request processed in 25us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579301.734221:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789579301.734231:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789579301.734236:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277284864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579301.734260:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277284864:12345-0@lo:400:kworker.0 Request processed in 24us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579301.734266:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789579301.734277:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789579301.734282:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277285376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579301.734307:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277285376:12345-0@lo:400:kworker.0 Request processed in 25us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579301.734312:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789579301.734375:0:24190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277285760 00000100:00100000:1.0:1789579301.734379:0:24190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277285760 00000100:00100000:1.0:1789579301.734400:0:24190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789579301.734406:0:24190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277285760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789579301.734421:0:24190:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789579301.734452:0:24190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277285760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579301.734457:0:24190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1789579301.734479:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789579301.734482:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789579301.734485:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789579301.734487:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789579301.734527:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a30700 x1876509277284864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579301.734540:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277284864:0@lo:400:kworker.0 00010000:00080000:1.0:1789579301.734551:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a32300 x1876509277285376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579301.734559:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277285376:0@lo:400:kworker.0 00000100:00100000:1.0:1789579301.734569:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277284736:0@lo:400:kworker.0 00010000:00080000:1.0:1789579301.734577:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a33100 x1876509277285248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579301.734585:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277285248:0@lo:400:kworker.0 00000100:00100000:1.0:1789579301.734599:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277285760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789579301.734631:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277284608:0@lo:400:kworker.0 00010000:00080000:1.0:1789579301.734652:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a31500 x1876509277285120/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579301.734660:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277285120:0@lo:400:kworker.0 00010000:00080000:1.0:1789579301.734670:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a32a00 x1876509277285632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579301.734677:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876509277285632:0@lo:400:kworker.0 00000100:00100000:1.0:1789579301.734685:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39addb08-5233-4b30-82ca-229405d26fae:3617:1876509277284480:0@lo:400:kworker.0 00000100:00100000:1.0:1789579301.734694:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277284992:0@lo:400:kworker.0 00010000:00080000:1.0:1789579301.734702:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a30a80 x1876509277285504/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579301.734710:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3617:1876509277285504:0@lo:400:kworker.0 00000100:00100000:3.0:1789579301.735325:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789579301.735336:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277285888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789579301.735394:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579301.735427:0:24190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277285888 00000100:00100000:3.0:1789579301.735432:0:24190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277285888 00000100:00100000:3.0:1789579301.735456:0:24190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789579301.735462:0:24190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277285888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789579301.735481:0:24190:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789579301.735528:0:24190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277285888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579301.735533:0:24190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789579301.735565:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277285888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789579301.741924:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277286016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789579301.741994:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579301.742117:0:24190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277286016 00000100:00100000:0.0:1789579301.742126:0:24190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277286016 00000100:00100000:0.0:1789579301.742169:0:24190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789579301.742178:0:24190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1876509277286016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789579301.742200:0:24190:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789579301.742243:0:24190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1876509277286016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579301.742251:0:24190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789579301.742398:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277286016:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1789579301.743513:0:25005:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000001:02000400:3.0:1789579302.098441:0:25364:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg337-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789579302.627503:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789579303.134160:0:25416:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789579303.135147:0:25416:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789579303.652227:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789579303.972374:0:22718:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1789579304.125887:0:25466:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789579304.126109:0:25466:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789579304.476723:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579304.477533:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261451264 00000100:00100000:2.0:1789579304.477547:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261451264 00000100:00100000:2.0:1789579304.477595:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 113 00000100:00100000:2.0:1789579304.477602:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393042f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2391:x1876509261451264:12345-192.168.203.37@tcp:250:mount.lustre.0 00010000:00080000:2.0:1789579304.477630:0:22675:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 26ca68eb-fc53-4468-a753-d660cc98bf7c@192.168.203.37@tcp t0 exp 0000000000000000 cur 659 last 0 00000020:00000080:2.0:1789579304.477655:0:22675:0:(genops.c:1384:class_connect()) connect: client 26ca68eb-fc53-4468-a753-d660cc98bf7c, cookie 0xd90373d592f22c4d 00000100:00080000:2.0:1789579304.477789:0:22675:0:(import.c:65:import_set_state_nolock()) ffff9393010c3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789579304.477873:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393042f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26ca68eb-fc53-4468-a753-d660cc98bf7c+5:2391:x1876509261451264:12345-192.168.203.37@tcp:250:mount.lustre.0 Request processed in 270us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579304.477880:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 113 00000100:00100000:1.0:1789579304.484811:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579304.484972:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261451392 00000100:00100000:2.0:1789579304.484983:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261451392 00000100:00100000:2.0:1789579304.485047:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 114 00000100:00100000:2.0:1789579304.485073:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393042fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26ca68eb-fc53-4468-a753-d660cc98bf7c+5:18073:x1876509261451392:12345-192.168.203.37@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789579304.485091:0:22673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579304.485109:0:22673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939400031400/0xd90373d592f22c54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec4a1 expref: -99 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579304.485138:0:22673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939400031400/0xd90373d592f22c54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec4a1 expref: 6 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579304.485150:0:22673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939400031400/0xd90373d592f22c54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec4a1 expref: 6 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579304.485160:0:22673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939400031400, rc 0) 00000100:00100000:2.0:1789579304.485516:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393042fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26ca68eb-fc53-4468-a753-d660cc98bf7c+6:18073:x1876509261451392:12345-192.168.203.37@tcp:101:mount.lustre.0 Request processed in 445us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579304.485524:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 114 00000100:00100000:3.0:1789579304.497161:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579304.497316:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261451520 00000100:00100000:1.0:1789579304.497332:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261451520 00000100:00100000:1.0:1789579304.502626:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 115 00000100:00100000:1.0:1789579304.502656:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393042f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26ca68eb-fc53-4468-a753-d660cc98bf7c+6:18073:x1876509261451520:12345-192.168.203.37@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789579304.502809:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393042f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26ca68eb-fc53-4468-a753-d660cc98bf7c+6:18073:x1876509261451520:12345-192.168.203.37@tcp:501:mount.lustre.0 Request processed in 170us (5665us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789579304.502817:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 115 00000100:00100000:0.0:1789579304.508878:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579304.509011:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261451648 00000100:00100000:2.0:1789579304.509025:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261451648 00000100:00100000:2.0:1789579304.509094:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 116 00000100:00100000:2.0:1789579304.509105:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393042fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26ca68eb-fc53-4468-a753-d660cc98bf7c+6:18073:x1876509261451648:12345-192.168.203.37@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789579304.509126:0:22673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579304.509150:0:22673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939400030800/0xd90373d592f22c5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec4a8 expref: -99 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579304.509187:0:22673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939400030800/0xd90373d592f22c5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec4a8 expref: 7 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579304.509200:0:22673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939400030800/0xd90373d592f22c5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec4a8 expref: 7 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579304.509234:0:22673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939400030800, rc 0) 00000100:00100000:2.0:1789579304.509310:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393042fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26ca68eb-fc53-4468-a753-d660cc98bf7c+7:18073:x1876509261451648:12345-192.168.203.37@tcp:101:mount.lustre.0 Request processed in 206us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579304.509318:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 116 00000100:00100000:2.0:1789579304.515530:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579304.516206:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261451776 00000100:00100000:0.0:1789579304.516221:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261451776 00000100:00100000:0.0:1789579304.516294:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 117 00000100:00100000:0.0:1789579304.516306:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393042f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26ca68eb-fc53-4468-a753-d660cc98bf7c+7:18073:x1876509261451776:12345-192.168.203.37@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789579304.517497:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393042f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26ca68eb-fc53-4468-a753-d660cc98bf7c+8:18073:x1876509261451776:12345-192.168.203.37@tcp:501:mount.lustre.0 Request processed in 1172us (1960us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579304.517512:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 117 00000100:00100000:3.0:1789579304.520663:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579304.520757:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261451904 00000100:00100000:1.0:1789579304.520766:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261451904 00000100:00100000:1.0:1789579304.520986:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 118 00000100:00100000:1.0:1789579304.521023:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393042fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26ca68eb-fc53-4468-a753-d660cc98bf7c+8:18073:x1876509261451904:12345-192.168.203.37@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789579304.521162:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393042fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26ca68eb-fc53-4468-a753-d660cc98bf7c+8:18073:x1876509261451904:12345-192.168.203.37@tcp:503:mount.lustre.0 Request processed in 155us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579304.526988:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 118 00000100:00100000:3.0:1789579304.527779:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579304.528561:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261452032 00000100:00100000:0.0:1789579304.528571:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261452032 00000100:00100000:0.0:1789579304.528624:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 119 00000100:00100000:0.0:1789579304.528633:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26ca68eb-fc53-4468-a753-d660cc98bf7c+8:18091:x1876509261452032:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789579304.528792:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26ca68eb-fc53-4468-a753-d660cc98bf7c+8:18091:x1876509261452032:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 159us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579304.528800:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 119 00000100:00100000:3.0:1789579304.560468:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579304.560954:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261452160 00000100:00100000:1.0:1789579304.560965:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261452160 00000100:00100000:1.0:1789579304.561029:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 120 00000100:00100000:1.0:1789579304.561039:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26ca68eb-fc53-4468-a753-d660cc98bf7c+8:18091:x1876509261452160:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789579304.561621:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26ca68eb-fc53-4468-a753-d660cc98bf7c+8:18091:x1876509261452160:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 580us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579304.561631:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 120 00000100:00100000:3.0:1789579304.568508:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579304.568799:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261452288 00000100:00100000:2.0:1789579304.568810:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261452288 00000100:00100000:2.0:1789579304.568914:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 121 00000100:00100000:2.0:1789579304.568925:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939436de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26ca68eb-fc53-4468-a753-d660cc98bf7c+8:18091:x1876509261452288:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789579304.569079:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939436de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26ca68eb-fc53-4468-a753-d660cc98bf7c+8:18091:x1876509261452288:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 155us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579304.569087:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 121 00000100:00100000:3.0:1789579304.586410:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579304.587528:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261452416 00000100:00100000:1.0:1789579304.587541:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261452416 00000100:00100000:1.0:1789579304.587601:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 122 00000100:00100000:1.0:1789579304.587611:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939436de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26ca68eb-fc53-4468-a753-d660cc98bf7c+8:18073:x1876509261452416:12345-192.168.203.37@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789579304.587627:0:22674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579304.587729:0:22674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394041da400/0xd90373d592f22c62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec4d9 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579304.587761:0:22674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394041da400/0xd90373d592f22c62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec4d9 expref: 9 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579304.587773:0:22674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394041da400/0xd90373d592f22c62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec4d9 expref: 9 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579304.587782:0:22674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394041da400, rc 0) 00000100:00100000:1.0:1789579304.587874:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939436de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26ca68eb-fc53-4468-a753-d660cc98bf7c+9:18073:x1876509261452416:12345-192.168.203.37@tcp:101:mount.lustre.0 Request processed in 265us (1474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579304.587882:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 122 00000100:00100000:3.0:1789579304.599793:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579304.599931:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261452544 00000100:00100000:2.0:1789579304.599941:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261452544 00000100:00100000:2.0:1789579304.600004:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 123 00000100:00100000:2.0:1789579304.600023:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939436de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26ca68eb-fc53-4468-a753-d660cc98bf7c+9:18073:x1876509261452544:12345-192.168.203.37@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789579304.600048:0:22673:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789579304.600075:0:22673:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789579304.600079:0:22673:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789579304.600082:0:22673:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789579304.600085:0:22673:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789579304.600087:0:22673:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1789579304.602408:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939436de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26ca68eb-fc53-4468-a753-d660cc98bf7c+9:18073:x1876509261452544:12345-192.168.203.37@tcp:256:mount.lustre.0 Request processed in 2376us (2613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579304.602420:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 123 00000100:00100000:0.0:1789579304.606000:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579304.607193:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261452672 00000100:00100000:2.0:1789579304.607207:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261452672 00000100:00100000:2.0:1789579304.607272:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 124 00000100:00100000:2.0:1789579304.607281:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939436de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26ca68eb-fc53-4468-a753-d660cc98bf7c+9:18073:x1876509261452672:12345-192.168.203.37@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789579304.607297:0:22675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579304.607315:0:22675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939400031200/0xd90373d592f22c69 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec4e0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579304.607393:0:22675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939400031200/0xd90373d592f22c69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec4e0 expref: 10 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579304.607405:0:22675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939400031200/0xd90373d592f22c69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec4e0 expref: 10 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579304.607415:0:22675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939400031200, rc 0) 00000100:00100000:2.0:1789579304.607469:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939436de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26ca68eb-fc53-4468-a753-d660cc98bf7c+10:18073:x1876509261452672:12345-192.168.203.37@tcp:101:mount.lustre.0 Request processed in 189us (1478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579304.607487:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 124 00000100:00100000:3.0:1789579304.610723:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579304.610863:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261452800 00000100:00100000:2.0:1789579304.610873:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261452800 00000100:00100000:2.0:1789579304.610934:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 125 00000100:00100000:2.0:1789579304.610943:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939436de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26ca68eb-fc53-4468-a753-d660cc98bf7c+10:18073:x1876509261452800:12345-192.168.203.37@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789579304.611421:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939436de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26ca68eb-fc53-4468-a753-d660cc98bf7c+10:18073:x1876509261452800:12345-192.168.203.37@tcp:501:mount.lustre.0 Request processed in 476us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579304.611431:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 125 00000100:00100000:0.0:1789579304.619178:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579304.619328:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261452928 00000100:00100000:3.0:1789579304.619338:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261452928 00000100:00100000:3.0:1789579304.619420:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 126 00000100:00100000:3.0:1789579304.619430:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939436de0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26ca68eb-fc53-4468-a753-d660cc98bf7c+10:18073:x1876509261452928:12345-192.168.203.37@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789579304.619612:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939436de0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26ca68eb-fc53-4468-a753-d660cc98bf7c+10:18073:x1876509261452928:12345-192.168.203.37@tcp:503:mount.lustre.0 Request processed in 183us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579304.619620:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 126 00000100:00100000:3.0:1789579304.624127:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579304.624261:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261453056 00000100:00100000:2.0:1789579304.624270:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261453056 00000100:00100000:2.0:1789579304.624339:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 127 00000100:00100000:2.0:1789579304.624382:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939436de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26ca68eb-fc53-4468-a753-d660cc98bf7c+10:18096:x1876509261453056:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789579304.624533:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939436de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26ca68eb-fc53-4468-a753-d660cc98bf7c+10:18096:x1876509261453056:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 184us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579304.624541:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 127 00000100:00100000:2.0:1789579304.630445:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579304.630542:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261453184 00000100:00100000:0.0:1789579304.630552:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261453184 00000100:00100000:0.0:1789579304.630609:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 128 00000100:00100000:0.0:1789579304.630619:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394360e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26ca68eb-fc53-4468-a753-d660cc98bf7c+10:18096:x1876509261453184:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789579304.630769:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394360e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26ca68eb-fc53-4468-a753-d660cc98bf7c+10:18096:x1876509261453184:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 151us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579304.630777:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 128 00000100:00100000:0.0:1789579304.638531:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579304.638602:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261453312 00000100:00100000:1.0:1789579304.638612:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261453312 00000100:00100000:0.0:1789579304.638624:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579304.638699:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261453568 00000100:00100000:1.0:1789579304.638703:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261453568 00000100:00100000:1.0:1789579304.638730:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:1.0:1789579304.638738:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2391:x1876509261453312:12345-192.168.203.37@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789579304.638769:0:22682:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from a10e13f9-13f2-441e-b716-61685111baf3@192.168.203.37@tcp t0 exp 0000000000000000 cur 659 last 0 00000020:00000080:1.0:1789579304.638818:0:22682:0:(genops.c:1384:class_connect()) connect: client a10e13f9-13f2-441e-b716-61685111baf3, cookie 0xd90373d592f22c70 00000004:00100000:1.0:1789579304.638853:0:22682:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1789579304.638854:0:24054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 8 00000100:00100000:2.0:1789579304.638861:0:24054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2391:x1876509261453568:12345-192.168.203.37@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789579304.638877:0:24054:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from a10e13f9-13f2-441e-b716-61685111baf3@192.168.203.37@tcp t0 exp 0000000000000000 cur 659 last 0 00000020:00000080:2.0:1789579304.638907:0:24054:0:(genops.c:1384:class_connect()) connect: client a10e13f9-13f2-441e-b716-61685111baf3, cookie 0xd90373d592f22c77 00000004:00100000:2.0:1789579304.638919:0:24054:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789579304.639069:0:22682:0:(import.c:65:import_set_state_nolock()) ffff939304079800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1789579304.639086:0:24054:0:(import.c:65:import_set_state_nolock()) ffff939304131000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789579304.639136:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a10e13f9-13f2-441e-b716-61685111baf3+6:2391:x1876509261453312:12345-192.168.203.37@tcp:38:mount.lustre.0 Request processed in 396us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579304.639144:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:2.0:1789579304.652096:0:24054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a10e13f9-13f2-441e-b716-61685111baf3+6:2391:x1876509261453568:12345-192.168.203.37@tcp:38:mount.lustre.0 Request processed in 13221us (13458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579304.652111:0:24054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 8 00000100:00100000:1.0:1789579304.652148:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579304.652174:0:24487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261453440 00000100:00100000:2.0:1789579304.652183:0:24487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261453440 00000100:00100000:2.0:1789579304.652250:0:24487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 9 00000100:00100000:2.0:1789579304.652258:0:24487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a10e13f9-13f2-441e-b716-61685111baf3+6:0:x1876509261453440:12345-192.168.203.37@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789579304.652305:0:24487:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789579304.652422:0:24487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a10e13f9-13f2-441e-b716-61685111baf3+6:0:x1876509261453440:12345-192.168.203.37@tcp:41:mount.lustre.0 Request processed in 163us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579304.652429:0:24487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 9 00000100:00080000:3.0:1789579304.652657:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789579304.652773:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579304.653429:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261453824 00000100:00100000:3.0:1789579304.653435:0:22681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261453824 00000100:00100000:3.0:1789579304.653485:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 10 00000100:00100000:3.0:1789579304.653493:0:22681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a10e13f9-13f2-441e-b716-61685111baf3+6:18073:x1876509261453824:12345-192.168.203.37@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789579304.653508:0:22681:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789579304.653545:0:22681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a10e13f9-13f2-441e-b716-61685111baf3+6:18073:x1876509261453824:12345-192.168.203.37@tcp:41:mount.lustre.0 Request processed in 53us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579304.653551:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 10 00000100:00100000:0.0:1789579304.660031:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579304.660073:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579304.660200:0:24054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261453696 00000100:00100000:2.0:1789579304.660209:0:24054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261453696 00000100:00100000:2.0:1789579304.660297:0:24054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261453952 00000100:00100000:2.0:1789579304.660301:0:24054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261453952 00000100:00100000:2.0:1789579304.660328:0:24054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 11 00000100:00100000:2.0:1789579304.660337:0:24054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a10e13f9-13f2-441e-b716-61685111baf3+6:0:x1876509261453696:12345-192.168.203.37@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789579304.660398:0:24054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789579304.660486:0:24054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a10e13f9-13f2-441e-b716-61685111baf3+6:0:x1876509261453696:12345-192.168.203.37@tcp:41:mount.lustre.0 Request processed in 139us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579304.660495:0:24054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 11 00000100:00100000:2.0:1789579304.660513:0:24054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 12 00000100:00100000:2.0:1789579304.660519:0:24054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a10e13f9-13f2-441e-b716-61685111baf3+6:18073:x1876509261453952:12345-192.168.203.37@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789579304.660547:0:24054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a10e13f9-13f2-441e-b716-61685111baf3+6:18073:x1876509261453952:12345-192.168.203.37@tcp:40:mount.lustre.0 Request processed in 28us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579304.660554:0:24054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 12 00000100:00080000:3.0:1789579304.660617:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789579304.672538:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579304.672578:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579304.672614:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579304.672708:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261454336 00000100:00100000:3.0:1789579304.672718:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261454336 00000100:00100000:3.0:1789579304.672774:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 3 00000100:00100000:3.0:1789579304.672791:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a10e13f9-13f2-441e-b716-61685111baf3+6:18073:x1876509261454336:12345-192.168.203.37@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789579304.672866:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a10e13f9-13f2-441e-b716-61685111baf3+6:18073:x1876509261454336:12345-192.168.203.37@tcp:900:mount.lustre.0 Request processed in 84us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579304.672874:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 3 00000100:00100000:1.0:1789579304.672948:0:24736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261454080 00000100:00100000:1.0:1789579304.672954:0:24736:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261454080 00000100:00100000:1.0:1789579304.672985:0:24736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261454208 00000100:00100000:1.0:1789579304.672988:0:24736:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261454208 00000100:00100000:1.0:1789579304.673018:0:24736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:1.0:1789579304.673024:0:24736:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2391:x1876509261454080:12345-192.168.203.37@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789579304.673051:0:24736:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from a10e13f9-13f2-441e-b716-61685111baf3@192.168.203.37@tcp t0 exp 0000000000000000 cur 659 last 0 00000020:00000080:1.0:1789579304.673092:0:24736:0:(genops.c:1384:class_connect()) connect: client a10e13f9-13f2-441e-b716-61685111baf3, cookie 0xd90373d592f22c7e 00002000:00100000:1.0:1789579304.673103:0:24736:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a10e13f9-13f2-441e-b716-61685111baf3/ffff93930407b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789579304.673133:0:24736:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789579304.673317:0:24736:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789579304.673345:0:24736:0:(import.c:65:import_set_state_nolock()) ffff93930407d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789579304.673407:0:24736:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a10e13f9-13f2-441e-b716-61685111baf3+6:2391:x1876509261454080:12345-192.168.203.37@tcp:8:mount.lustre.0 Request processed in 381us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579304.673415:0:24736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:1.0:1789579304.673431:0:24736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 17 00000100:00100000:1.0:1789579304.673436:0:24736:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2391:x1876509261454208:12345-192.168.203.37@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789579304.673452:0:24736:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from a10e13f9-13f2-441e-b716-61685111baf3@192.168.203.37@tcp t0 exp 0000000000000000 cur 659 last 0 00000020:00000080:1.0:1789579304.673467:0:24736:0:(genops.c:1384:class_connect()) connect: client a10e13f9-13f2-441e-b716-61685111baf3, cookie 0xd90373d592f22c85 00002000:00100000:1.0:1789579304.673472:0:24736:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a10e13f9-13f2-441e-b716-61685111baf3/ffff939304a4d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789579304.673493:0:24736:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789579304.673590:0:24736:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789579304.673604:0:24736:0:(import.c:65:import_set_state_nolock()) ffff939304a4a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789579304.673627:0:24736:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a10e13f9-13f2-441e-b716-61685111baf3+6:2391:x1876509261454208:12345-192.168.203.37@tcp:8:mount.lustre.0 Request processed in 189us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579304.673633:0:24736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 17 00010000:00010000:3.0:1789579304.675717:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579304.677155:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579304.681256:0:22683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261454464 00000100:00100000:0.0:1789579304.681653:0:22683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261454464 00000100:00100000:0.0:1789579304.681780:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 0 00000100:00100000:0.0:1789579304.681801:0:22683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a10e13f9-13f2-441e-b716-61685111baf3+6:18073:x1876509261454464:12345-192.168.203.37@tcp:33:mount.lustre.0 00000004:00080000:1.0:1789579304.682909:0:22683:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1019us 00000004:00200000:0.0:1789579304.704448:0:22683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789579304.704594:0:22683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a10e13f9-13f2-441e-b716-61685111baf3+6:18073:x1876509261454464:12345-192.168.203.37@tcp:33:mount.lustre.0 Request processed in 22787us (27437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579304.704604:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 0 00000100:00100000:0.0:1789579304.954309:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579304.954449:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261454592 00000100:00100000:1.0:1789579304.954459:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261454592 00000100:00100000:1.0:1789579304.954535:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 13 00000100:00100000:1.0:1789579304.954545:0:22680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a10e13f9-13f2-441e-b716-61685111baf3+6:18119:x1876509261454592:12345-192.168.203.37@tcp:101:mkdir.0 00010000:00010000:1.0:1789579304.954564:0:22680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579304.954597:0:22680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394041dbe00/0xd90373d592f22c8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec511 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579304.954662:0:22680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db200/0xd90373d592f22c93 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579304.954676:0:22680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db200/0xd90373d592f22c93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579304.954690:0:22680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db200/0xd90373d592f22c93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789579304.954799:0:22680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789579304.954805:0:22680:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789579304.954852:0:22680:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db200/0xd90373d592f22c93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579304.954879:0:22680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394041dbe00/0xd90373d592f22c8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec511 expref: 8 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579304.954900:0:22680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db200/0xd90373d592f22c93 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec511 expref: 7 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579304.954908:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93940905b200) 00010000:00010000:1.0:1789579304.954912:0:22680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789579304.954916:0:22680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394041db200, rc 0) 00000100:00100000:1.0:1789579304.954980:0:22680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a10e13f9-13f2-441e-b716-61685111baf3+7:18119:x1876509261454592:12345-192.168.203.37@tcp:101:mkdir.0 Request processed in 436us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579304.954988:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 13 00010000:00010000:3.0:1789579305.699822:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579306.339595:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789579306.339661:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277286144:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789579306.339752:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579306.339859:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277286144 00000100:00100000:0.0:1789579306.339867:0:22685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277286144 00000100:00100000:0.0:1789579306.339923:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789579306.339932:0:22685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277286144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789579306.339965:0:22685:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789579306.340043:0:22685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277286144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579306.340050:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789579306.340434:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277286272:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789579306.340491:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579306.340713:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277286144:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789579306.340771:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277286272 00000100:00100000:2.0:1789579306.340777:0:23423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277286272 00000100:00100000:2.0:1789579306.340813:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789579306.340820:0:23423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277286272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789579306.340840:0:23423:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789579306.340879:0:23423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277286272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579306.340895:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789579306.341026:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277286272:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789579306.341380:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789579306.341391:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277286400:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789579306.341421:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579306.341915:0:24190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277286400 00000100:00100000:0.0:1789579306.341921:0:24190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277286400 00000100:00100000:0.0:1789579306.341973:0:24190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789579306.341981:0:24190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277286400:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789579306.342135:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1789579306.342183:0:24190:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789579306.342231:0:24190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277286400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 252us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579306.342238:0:24190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789579306.342411:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277286400:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789579306.723658:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579306.851812:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277286656:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789579306.851884:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579306.852124:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277286528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789579306.852156:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579306.852175:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277287040:0@lo:400:kworker.0 00000100:00100000:0.0:1789579306.852198:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579306.852222:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789579306.852228:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277287168:0@lo:400:kworker.0 00000100:00100000:0.0:1789579306.852251:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579306.852282:0:24190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277286656 00000100:00100000:0.0:1789579306.852290:0:24190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277286656 00000100:00100000:0.0:1789579306.852344:0:24190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277286528 00000100:00100000:0.0:1789579306.852364:0:24190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277286528 00000100:00100000:0.0:1789579306.852414:0:24190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789579306.852423:0:24190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277286656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789579306.852452:0:24190:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789579306.853592:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277287168 00000100:00100000:2.0:1789579306.853602:0:22681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277287168 00000100:00100000:2.0:1789579306.853646:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789579306.853655:0:22681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277287168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579306.853844:0:22681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277287168:12345-0@lo:400:kworker.0 Request processed in 189us (1590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579306.853851:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789579306.853899:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39addb08-5233-4b30-82ca-229405d26fae:3615:1876509277286784:0@lo:400:kworker.0 00000100:00100000:2.0:1789579306.853931:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579306.853963:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789579306.853968:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277286912:0@lo:400:kworker.0 00000100:00100000:2.0:1789579306.853991:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579306.854041:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277287296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789579306.854374:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579306.854399:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277286784 00000100:00100000:2.0:1789579306.854403:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277286784 00000100:00100000:2.0:1789579306.855890:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789579306.855905:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394360eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+24:3615:x1876509277286784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579306.855975:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394360eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+24:3615:x1876509277286784:12345-0@lo:400:kworker.0 Request processed in 75us (2041us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579306.855981:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789579306.856038:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39addb08-5233-4b30-82ca-229405d26fae:3615:1876509277286784:0@lo:400:kworker.0 00000100:00100000:2.0:1789579306.865609:0:25077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277287040 00000100:00100000:2.0:1789579306.865622:0:25077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277287040 00000100:00100000:2.0:1789579306.865753:0:25077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277286912 00000100:00100000:2.0:1789579306.865819:0:25077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277286912 00000100:00100000:2.0:1789579306.865856:0:25077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789579306.865864:0:25077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3617:x1876509277287040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579306.865944:0:25077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3617:x1876509277287040:12345-0@lo:400:kworker.0 Request processed in 81us (13744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579306.865951:0:25077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789579306.865967:0:25077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789579306.865973:0:25077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277286912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579306.866004:0:25077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277286912:12345-0@lo:400:kworker.0 Request processed in 32us (12013us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579306.866010:0:25077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789579306.866050:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277286912:0@lo:400:kworker.0 00000100:00100000:2.0:1789579306.866105:0:24191:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1789579306.866113:0:24191:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00080000:2.0:1789579306.866405:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789579306.866409:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789579306.866595:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277287168:0@lo:400:kworker.0 00000100:00100000:2.0:1789579306.866605:0:3617:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1789579306.866617:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277287040:0@lo:400:kworker.0 00000100:00100000:2.0:1789579306.866865:0:24191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277287296 00000100:00100000:2.0:1789579306.866870:0:24191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277287296 00000100:00100000:2.0:1789579306.866958:0:25479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789579306.866966:0:25479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277286528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789579306.866983:0:25479:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789579306.867029:0:25479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277286528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (14872us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579306.867042:0:25479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789579306.867075:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277286528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789579306.867101:0:25479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789579306.867108:0:25479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277287296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789579306.867119:0:25479:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789579306.867160:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876509277287424:0@lo:400:kworker.0 00000100:00100000:3.0:1789579306.867202:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579306.867272:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876509277287552:0@lo:400:kworker.0 00000100:00100000:3.0:1789579306.867298:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579306.867338:0:24054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277287424 00000100:00100000:3.0:1789579306.867342:0:24054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277287424 00000100:00100000:3.0:1789579306.867548:0:24054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277287552 00000100:00100000:3.0:1789579306.867553:0:24054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277287552 00000100:00100000:3.0:1789579306.867581:0:24054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789579306.867588:0:24054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876509277287424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579306.867632:0:24054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876509277287424:12345-0@lo:400:kworker.0 Request processed in 45us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579306.867639:0:24054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789579306.867652:0:24054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789579306.867657:0:24054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876509277287552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579306.867684:0:24054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876509277287552:12345-0@lo:400:kworker.0 Request processed in 27us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579306.867689:0:24054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1789579306.867701:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789579306.867722:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876509277287424:0@lo:400:kworker.0 00000100:00100000:3.0:1789579306.867740:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876509277287552:0@lo:400:kworker.0 00000100:00100000:3.0:1789579306.867764:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789579306.867769:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277287680:0@lo:400:kworker.0 00000100:00100000:3.0:1789579306.867791:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579306.867816:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277287680 00000100:00100000:3.0:1789579306.867819:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277287680 00000100:00100000:3.0:1789579306.867845:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789579306.867851:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277287680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579306.867882:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277287680:12345-0@lo:400:kworker.0 Request processed in 31us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579306.867887:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1789579306.867899:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789579306.867917:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93930489e680 x1876509277287680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579306.867927:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277287680:0@lo:400:kworker.0 00000100:00100000:3.0:1789579306.867966:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277287808:0@lo:400:kworker.0 00000100:00100000:0.0:1789579306.868558:0:24190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277286656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 16133us (16672us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579306.868566:0:24190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789579306.868676:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579306.868736:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876509277287936:0@lo:400:kworker.0 00000100:00100000:3.0:1789579306.868765:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579306.868790:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277287808 00000100:00100000:3.0:1789579306.868794:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277287808 00000100:00100000:3.0:1789579306.868824:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277287936 00000100:00100000:3.0:1789579306.868827:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277287936 00000100:00100000:3.0:1789579306.868846:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789579306.868851:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277287808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579306.868883:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277287808:12345-0@lo:400:kworker.0 Request processed in 31us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579306.868889:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789579306.868899:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789579306.868905:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876509277287936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579306.868932:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876509277287936:12345-0@lo:400:kworker.0 Request processed in 28us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579306.868938:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1789579306.868950:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789579306.868953:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789579306.868974:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277287808:0@lo:400:kworker.0 00000100:00100000:1.0:1789579306.869144:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277286656:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1789579306.869494:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93930489d500 x1876509277287936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579306.869509:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876509277287936:0@lo:400:kworker.0 00000100:00100000:2.0:1789579306.870038:0:25479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277287296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2928us (15661us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579306.870047:0:25479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789579306.870177:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277287296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789579306.937718:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579306.937849:0:24487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261454720 00000100:00100000:0.0:1789579306.937860:0:24487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261454720 00000100:00100000:0.0:1789579306.937942:0:24487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 14 00000100:00100000:0.0:1789579306.937952:0:24487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a10e13f9-13f2-441e-b716-61685111baf3+7:18172:x1876509261454720:12345-192.168.203.37@tcp:41:lfs.0 00000004:00000024:0.0:1789579306.937991:0:24487:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789579306.938093:0:24487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a10e13f9-13f2-441e-b716-61685111baf3+7:18172:x1876509261454720:12345-192.168.203.37@tcp:41:lfs.0 Request processed in 141us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579306.938099:0:24487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 14 00000100:00080000:3.0:1789579306.940223:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789579306.946255:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579306.946390:0:24054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261454848 00000100:00100000:3.0:1789579306.946400:0:24054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261454848 00000100:00100000:3.0:1789579306.946495:0:24054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 15 00000100:00100000:3.0:1789579306.946505:0:24054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a10e13f9-13f2-441e-b716-61685111baf3+6:18172:x1876509261454848:12345-192.168.203.37@tcp:41:lfs.0 00000004:00000024:3.0:1789579306.946542:0:24054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789579306.946627:0:24054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a10e13f9-13f2-441e-b716-61685111baf3+6:18172:x1876509261454848:12345-192.168.203.37@tcp:41:lfs.0 Request processed in 123us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579306.946635:0:24054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 15 00000100:00080000:0.0:1789579306.950247:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789579306.956309:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579306.956398:0:24191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261454976 00000100:00100000:0.0:1789579306.956410:0:24191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261454976 00000100:00100000:0.0:1789579306.956500:0:24191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 13 00000100:00100000:0.0:1789579306.956510:0:24191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a10e13f9-13f2-441e-b716-61685111baf3+6:18172:x1876509261454976:12345-192.168.203.37@tcp:13:lfs.0 00002000:00000024:0.0:1789579306.956537:0:24191:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789579306.956623:0:24191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a10e13f9-13f2-441e-b716-61685111baf3+6:18172:x1876509261454976:12345-192.168.203.37@tcp:13:lfs.0 Request processed in 114us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579306.956631:0:24191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 13 00000100:00080000:3.0:1789579306.957541:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789579306.960261:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579306.960479:0:25479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261455104 00000100:00100000:0.0:1789579306.960490:0:25479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261455104 00000100:00100000:0.0:1789579306.960584:0:25479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 14 00000100:00100000:0.0:1789579306.960595:0:25479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a10e13f9-13f2-441e-b716-61685111baf3+6:18172:x1876509261455104:12345-192.168.203.37@tcp:13:lfs.0 00000100:00080000:3.0:1789579306.960614:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1789579306.960623:0:25479:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789579306.962472:0:25479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a10e13f9-13f2-441e-b716-61685111baf3+6:18172:x1876509261455104:12345-192.168.203.37@tcp:13:lfs.0 Request processed in 1857us (3108us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579306.962559:0:25479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 14 00000100:00100000:2.0:1789579307.252408:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579307.254633:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261455232 00000100:00100000:1.0:1789579307.254649:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261455232 00000100:00100000:1.0:1789579307.254725:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 130 00000100:00100000:1.0:1789579307.254739:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394360e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26ca68eb-fc53-4468-a753-d660cc98bf7c+10:18205:x1876509261455232:12345-192.168.203.37@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789579307.254756:0:22673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579307.254774:0:22673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394041dbe00/0xd90373d592f22c9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec518 expref: -99 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579307.254803:0:22673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394041dbe00/0xd90373d592f22c9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec518 expref: 11 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579307.254816:0:22673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394041dbe00/0xd90373d592f22c9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec518 expref: 11 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579307.254825:0:22673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394041dbe00, rc 0) 00000100:00100000:1.0:1789579307.254887:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394360e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26ca68eb-fc53-4468-a753-d660cc98bf7c+11:18205:x1876509261455232:12345-192.168.203.37@tcp:101:mount.lustre.0 Request processed in 151us (2487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579307.254894:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 130 00000100:00100000:2.0:1789579307.259980:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579307.260084:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261455360 00000100:00100000:0.0:1789579307.260094:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261455360 00000100:00100000:0.0:1789579307.260158:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 131 00000100:00100000:0.0:1789579307.260170:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394360e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26ca68eb-fc53-4468-a753-d660cc98bf7c+11:18205:x1876509261455360:12345-192.168.203.37@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789579307.260446:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394360e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26ca68eb-fc53-4468-a753-d660cc98bf7c+11:18205:x1876509261455360:12345-192.168.203.37@tcp:501:mount.lustre.0 Request processed in 276us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579307.260465:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 131 00000100:00100000:2.0:1789579307.281442:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579307.281520:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261455488 00000100:00100000:1.0:1789579307.281531:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261455488 00000100:00100000:1.0:1789579307.281591:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 132 00000100:00100000:1.0:1789579307.281600:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394360e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26ca68eb-fc53-4468-a753-d660cc98bf7c+11:18205:x1876509261455488:12345-192.168.203.37@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789579307.281754:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394360e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26ca68eb-fc53-4468-a753-d660cc98bf7c+11:18205:x1876509261455488:12345-192.168.203.37@tcp:503:mount.lustre.0 Request processed in 154us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579307.281762:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 132 00000100:00100000:1.0:1789579307.291830:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579307.292251:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261455616 00000100:00100000:2.0:1789579307.292261:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261455616 00000100:00100000:2.0:1789579307.292313:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 133 00000100:00100000:2.0:1789579307.292323:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394360eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26ca68eb-fc53-4468-a753-d660cc98bf7c+11:18211:x1876509261455616:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789579307.292561:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394360eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26ca68eb-fc53-4468-a753-d660cc98bf7c+11:18211:x1876509261455616:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 238us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579307.292569:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 133 00000100:00100000:2.0:1789579307.335677:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579307.337539:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261455744 00000100:00100000:0.0:1789579307.337557:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261455744 00000100:00100000:0.0:1789579307.337628:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 134 00000100:00100000:0.0:1789579307.337639:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394360ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26ca68eb-fc53-4468-a753-d660cc98bf7c+11:18211:x1876509261455744:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789579307.337812:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394360ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26ca68eb-fc53-4468-a753-d660cc98bf7c+11:18211:x1876509261455744:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 174us (2148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579307.337820:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 134 00000100:00100000:3.0:1789579307.346837:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579307.350488:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261455872 00000100:00100000:1.0:1789579307.350571:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261455872 00000100:00100000:1.0:1789579307.350743:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 135 00000100:00100000:1.0:1789579307.350757:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26ca68eb-fc53-4468-a753-d660cc98bf7c+11:18211:x1876509261455872:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789579307.351073:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26ca68eb-fc53-4468-a753-d660cc98bf7c+11:18211:x1876509261455872:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 317us (4260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579307.351082:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 135 00000100:00100000:1.0:1789579307.355523:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579307.355710:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261456000 00000100:00100000:0.0:1789579307.355722:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261456000 00000100:00100000:0.0:1789579307.356981:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 136 00000100:00100000:0.0:1789579307.357015:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26ca68eb-fc53-4468-a753-d660cc98bf7c+11:18205:x1876509261456000:12345-192.168.203.37@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789579307.357042:0:22675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579307.357089:0:22675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939303437000/0xd90373d592f22ca1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec549 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579307.357131:0:22675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303437000/0xd90373d592f22ca1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec549 expref: 12 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579307.357145:0:22675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939303437000/0xd90373d592f22ca1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec549 expref: 12 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579307.357155:0:22675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303437000, rc 0) 00000100:00100000:0.0:1789579307.357254:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26ca68eb-fc53-4468-a753-d660cc98bf7c+12:18205:x1876509261456000:12345-192.168.203.37@tcp:101:mount.lustre.0 Request processed in 250us (1749us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579307.357261:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 136 00000100:00100000:2.0:1789579307.362284:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579307.362412:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261456128 00000100:00100000:1.0:1789579307.362425:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261456128 00000100:00100000:1.0:1789579307.362519:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 137 00000100:00100000:1.0:1789579307.362533:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26ca68eb-fc53-4468-a753-d660cc98bf7c+12:18205:x1876509261456128:12345-192.168.203.37@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789579307.362567:0:22673:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789579307.362602:0:22673:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789579307.362608:0:22673:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789579307.362612:0:22673:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789579307.362615:0:22673:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789579307.362617:0:22673:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1789579307.364661:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26ca68eb-fc53-4468-a753-d660cc98bf7c+12:18205:x1876509261456128:12345-192.168.203.37@tcp:256:mount.lustre.0 Request processed in 2119us (2380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579307.364679:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 137 00000100:00100000:3.0:1789579307.379970:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579307.380139:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261456256 00000100:00100000:0.0:1789579307.380150:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261456256 00000100:00100000:0.0:1789579307.380219:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 138 00000100:00100000:0.0:1789579307.380232:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26ca68eb-fc53-4468-a753-d660cc98bf7c+12:18205:x1876509261456256:12345-192.168.203.37@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789579307.380264:0:22675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579307.380283:0:22675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939303436200/0xd90373d592f22ca8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec550 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579307.380311:0:22675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303436200/0xd90373d592f22ca8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec550 expref: 13 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579307.380322:0:22675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939303436200/0xd90373d592f22ca8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec550 expref: 13 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579307.380331:0:22675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303436200, rc 0) 00000100:00100000:0.0:1789579307.380422:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26ca68eb-fc53-4468-a753-d660cc98bf7c+13:18205:x1876509261456256:12345-192.168.203.37@tcp:101:mount.lustre.0 Request processed in 193us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579307.380444:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 138 00000100:00100000:2.0:1789579307.388786:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579307.388945:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261456384 00000100:00100000:1.0:1789579307.388971:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261456384 00000100:00100000:1.0:1789579307.389051:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 139 00000100:00100000:1.0:1789579307.389062:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26ca68eb-fc53-4468-a753-d660cc98bf7c+13:18205:x1876509261456384:12345-192.168.203.37@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789579307.394525:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26ca68eb-fc53-4468-a753-d660cc98bf7c+13:18205:x1876509261456384:12345-192.168.203.37@tcp:501:mount.lustre.0 Request processed in 5452us (5742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579307.394540:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 139 00000100:00100000:3.0:1789579307.410838:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579307.414870:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261456512 00000100:00100000:0.0:1789579307.414886:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261456512 00000100:00100000:0.0:1789579307.414960:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 140 00000100:00100000:0.0:1789579307.414981:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26ca68eb-fc53-4468-a753-d660cc98bf7c+13:18205:x1876509261456512:12345-192.168.203.37@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789579307.415906:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26ca68eb-fc53-4468-a753-d660cc98bf7c+13:18205:x1876509261456512:12345-192.168.203.37@tcp:503:mount.lustre.0 Request processed in 923us (5073us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579307.415916:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 140 00000100:00100000:3.0:1789579307.428336:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579307.435324:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261456640 00000100:00100000:1.0:1789579307.435341:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261456640 00000100:00100000:1.0:1789579307.435427:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 141 00000100:00100000:1.0:1789579307.435437:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26ca68eb-fc53-4468-a753-d660cc98bf7c+13:18215:x1876509261456640:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789579307.435748:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26ca68eb-fc53-4468-a753-d660cc98bf7c+13:18215:x1876509261456640:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 311us (7420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579307.435757:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 141 00000100:00100000:1.0:1789579307.447561:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579307.447649:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261456768 00000100:00100000:2.0:1789579307.447675:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261456768 00000100:00100000:2.0:1789579307.447738:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 142 00000100:00100000:2.0:1789579307.447748:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26ca68eb-fc53-4468-a753-d660cc98bf7c+13:18215:x1876509261456768:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789579307.447886:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26ca68eb-fc53-4468-a753-d660cc98bf7c+13:18215:x1876509261456768:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 140us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579307.447895:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 142 00000100:00100000:2.0:1789579307.465590:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579307.465649:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579307.465688:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579307.465714:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579307.465733:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579307.465767:0:25077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261457280 00000100:00100000:2.0:1789579307.465777:0:25077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261457280 00000100:00100000:3.0:1789579307.467049:0:24187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261457408 00000100:00100000:3.0:1789579307.467071:0:24187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261457408 00000100:00100000:1.0:1789579307.468251:0:24487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261456896 00000100:00100000:1.0:1789579307.468267:0:24487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261456896 00000100:00100000:1.0:1789579307.468402:0:24487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261457024 00000100:00100000:1.0:1789579307.468406:0:24487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261457024 00000100:00100000:1.0:1789579307.468462:0:24487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261457152 00000100:00100000:1.0:1789579307.468466:0:24487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261457152 00000100:00100000:1.0:1789579307.468489:0:24487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 40 00000100:00100000:1.0:1789579307.468500:0:24487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a10e13f9-13f2-441e-b716-61685111baf3+7:2392:x1876509261457024:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789579307.468625:0:24487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a10e13f9-13f2-441e-b716-61685111baf3+7:2392:x1876509261457024:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 126us (2975us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579307.468633:0:24487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 40 00000100:00100000:1.0:1789579307.468653:0:24487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 41 00000100:00100000:1.0:1789579307.468675:0:24487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a10e13f9-13f2-441e-b716-61685111baf3+6:2392:x1876509261457152:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789579307.468703:0:24487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a10e13f9-13f2-441e-b716-61685111baf3+6:2392:x1876509261457152:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 29us (2988us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579307.468709:0:24487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 41 00000100:00100000:1.0:1789579307.468722:0:24487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:1.0:1789579307.468727:0:24487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2391:x1876509261456896:12345-192.168.203.37@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789579307.468750:0:24487:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 7263f938-3275-4200-b80b-4135ea8c4f2d@192.168.203.37@tcp t0 exp 0000000000000000 cur 662 last 0 00000020:00000080:1.0:1789579307.468787:0:24487:0:(genops.c:1384:class_connect()) connect: client 7263f938-3275-4200-b80b-4135ea8c4f2d, cookie 0xd90373d592f22caf 00000004:00100000:1.0:1789579307.468810:0:24487:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789579307.469314:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579307.469486:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261457664 00000100:00100000:0.0:1789579307.469493:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261457664 00000100:00100000:0.0:1789579307.469521:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 17 00000100:00100000:0.0:1789579307.469527:0:22680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2391:x1876509261457664:12345-192.168.203.37@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789579307.469548:0:22680:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 7263f938-3275-4200-b80b-4135ea8c4f2d@192.168.203.37@tcp t0 exp 0000000000000000 cur 662 last 0 00000020:00000080:0.0:1789579307.469573:0:22680:0:(genops.c:1384:class_connect()) connect: client 7263f938-3275-4200-b80b-4135ea8c4f2d, cookie 0xd90373d592f22cb6 00000004:00100000:0.0:1789579307.469587:0:22680:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789579307.469676:0:22680:0:(import.c:65:import_set_state_nolock()) ffff939303ba3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789579307.469721:0:22680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7263f938-3275-4200-b80b-4135ea8c4f2d+6:2391:x1876509261457664:12345-192.168.203.37@tcp:38:mount.lustre.0 Request processed in 192us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579307.469729:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 17 00000100:00080000:1.0:1789579307.470611:0:24487:0:(import.c:65:import_set_state_nolock()) ffff93940419f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789579307.470654:0:24487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7263f938-3275-4200-b80b-4135ea8c4f2d+6:2391:x1876509261456896:12345-192.168.203.37@tcp:38:mount.lustre.0 Request processed in 1925us (5075us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579307.470664:0:24487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:2.0:1789579307.474666:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 6 00000100:00100000:2.0:1789579307.474694:0:24188:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a10e13f9-13f2-441e-b716-61685111baf3+6:2392:x1876509261457280:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789579307.474785:0:24188:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a10e13f9-13f2-441e-b716-61685111baf3+6:2392:x1876509261457280:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 106us (9095us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579307.474794:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 6 00000100:00100000:3.0:1789579307.475120:0:24187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:3.0:1789579307.475134:0:24187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a10e13f9-13f2-441e-b716-61685111baf3+6:2392:x1876509261457408:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789579307.475169:0:24187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a10e13f9-13f2-441e-b716-61685111baf3+6:2392:x1876509261457408:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 40us (9435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579307.475176:0:24187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:1.0:1789579307.484777:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579307.485340:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261457792 00000100:00100000:0.0:1789579307.485386:0:22681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261457792 00000100:00100000:0.0:1789579307.485516:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 18 00000100:00100000:0.0:1789579307.485526:0:22681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7263f938-3275-4200-b80b-4135ea8c4f2d+6:0:x1876509261457792:12345-192.168.203.37@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789579307.485558:0:22681:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789579307.485655:0:22681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7263f938-3275-4200-b80b-4135ea8c4f2d+6:0:x1876509261457792:12345-192.168.203.37@tcp:41:mount.lustre.0 Request processed in 130us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579307.485663:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 18 00000100:00080000:3.0:1789579307.487894:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789579307.490601:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579307.490644:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579307.490725:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261457536 00000100:00100000:2.0:1789579307.490735:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261457536 00000100:00100000:2.0:1789579307.490858:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261457920 00000100:00100000:2.0:1789579307.490862:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261457920 00000100:00080000:0.0:1789579307.491429:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789579307.494726:0:24487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 19 00000100:00100000:1.0:1789579307.494751:0:24487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437206300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7263f938-3275-4200-b80b-4135ea8c4f2d+7:0:x1876509261457536:12345-192.168.203.37@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789579307.494784:0:24487:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789579307.495476:0:24487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437206300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7263f938-3275-4200-b80b-4135ea8c4f2d+7:0:x1876509261457536:12345-192.168.203.37@tcp:41:mount.lustre.0 Request processed in 736us (4881us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579307.495487:0:24487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 19 00000100:00100000:1.0:1789579307.495517:0:24487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 20 00000100:00100000:1.0:1789579307.495527:0:24487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437204000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7263f938-3275-4200-b80b-4135ea8c4f2d+6:18205:x1876509261457920:12345-192.168.203.37@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789579307.495543:0:24487:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789579307.495584:0:24487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437204000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7263f938-3275-4200-b80b-4135ea8c4f2d+6:18205:x1876509261457920:12345-192.168.203.37@tcp:41:mount.lustre.0 Request processed in 59us (4939us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579307.495591:0:24487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 20 00000100:00100000:2.0:1789579307.512561:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579307.512673:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261458048 00000100:00100000:1.0:1789579307.512688:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261458048 00000100:00100000:1.0:1789579307.512766:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 21 00000100:00100000:1.0:1789579307.512777:0:22680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7263f938-3275-4200-b80b-4135ea8c4f2d+6:18205:x1876509261458048:12345-192.168.203.37@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789579307.512882:0:22680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7263f938-3275-4200-b80b-4135ea8c4f2d+6:18205:x1876509261458048:12345-192.168.203.37@tcp:40:mount.lustre.0 Request processed in 106us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579307.512890:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 21 00000100:00100000:0.0:1789579307.518849:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579307.520895:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579307.521151:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579307.523278:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261458432 00000100:00100000:3.0:1789579307.523296:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261458432 00000100:00100000:2.0:1789579307.524765:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 4 00000100:00100000:2.0:1789579307.524783:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437205880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7263f938-3275-4200-b80b-4135ea8c4f2d+6:18205:x1876509261458432:12345-192.168.203.37@tcp:900:mount.lustre.0 00000100:00100000:2.0:1789579307.525150:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437205880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7263f938-3275-4200-b80b-4135ea8c4f2d+6:18205:x1876509261458432:12345-192.168.203.37@tcp:900:mount.lustre.0 Request processed in 369us (6324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579307.525160:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 4 00000100:00100000:0.0:1789579307.528723:0:24187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261458176 00000100:00100000:0.0:1789579307.528745:0:24187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261458176 00000100:00100000:0.0:1789579307.528848:0:24187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261458304 00000100:00100000:0.0:1789579307.528852:0:24187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261458304 00000100:00100000:0.0:1789579307.528887:0:24187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 18 00000100:00100000:0.0:1789579307.528897:0:24187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2391:x1876509261458176:12345-192.168.203.37@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789579307.528942:0:24187:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 7263f938-3275-4200-b80b-4135ea8c4f2d@192.168.203.37@tcp t0 exp 0000000000000000 cur 662 last 0 00000020:00000080:0.0:1789579307.528997:0:24187:0:(genops.c:1384:class_connect()) connect: client 7263f938-3275-4200-b80b-4135ea8c4f2d, cookie 0xd90373d592f22cbd 00002000:00100000:0.0:1789579307.529014:0:24187:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7263f938-3275-4200-b80b-4135ea8c4f2d/ffff93943f646800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789579307.529028:0:24187:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789579307.529121:0:24187:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789579307.529191:0:24187:0:(import.c:65:import_set_state_nolock()) ffff93943de4a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789579307.529249:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579307.529286:0:24187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7263f938-3275-4200-b80b-4135ea8c4f2d+6:2391:x1876509261458176:12345-192.168.203.37@tcp:8:mount.lustre.0 Request processed in 386us (8402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579307.529310:0:24187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 18 00000100:00100000:0.0:1789579307.529339:0:24187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 19 00000100:00100000:0.0:1789579307.529345:0:24187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2391:x1876509261458304:12345-192.168.203.37@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789579307.529404:0:24187:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 7263f938-3275-4200-b80b-4135ea8c4f2d@192.168.203.37@tcp t0 exp 0000000000000000 cur 662 last 0 00000020:00000080:0.0:1789579307.529430:0:24187:0:(genops.c:1384:class_connect()) connect: client 7263f938-3275-4200-b80b-4135ea8c4f2d, cookie 0xd90373d592f22cc4 00002000:00100000:0.0:1789579307.529444:0:24187:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7263f938-3275-4200-b80b-4135ea8c4f2d/ffff93943de49000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789579307.529452:0:24187:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:2.0:1789579307.529500:0:22684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261458560 00000100:00100000:2.0:1789579307.529513:0:22684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261458560 00002000:00080000:0.0:1789579307.529514:0:24187:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789579307.529540:0:24187:0:(import.c:65:import_set_state_nolock()) ffff93943de4b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789579307.529577:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 1 00000100:00100000:0.0:1789579307.529586:0:24187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7263f938-3275-4200-b80b-4135ea8c4f2d+6:2391:x1876509261458304:12345-192.168.203.37@tcp:8:mount.lustre.0 Request processed in 237us (8432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579307.529595:0:22684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7263f938-3275-4200-b80b-4135ea8c4f2d+6:18205:x1876509261458560:12345-192.168.203.37@tcp:33:mount.lustre.0 00000100:00100000:0.0:1789579307.529602:0:24187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 19 00000004:00200000:2.0:1789579307.530757:0:22684:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789579307.530870:0:22684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7263f938-3275-4200-b80b-4135ea8c4f2d+6:18205:x1876509261458560:12345-192.168.203.37@tcp:33:mount.lustre.0 Request processed in 1280us (1634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579307.530879:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 1 00000100:00100000:0.0:1789579307.747346:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579307.747816:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261458688 00000100:00100000:3.0:1789579307.747831:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261458688 00000100:00100000:3.0:1789579307.747918:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 22 00000100:00100000:3.0:1789579307.747953:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437204380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7263f938-3275-4200-b80b-4135ea8c4f2d+6:18238:x1876509261458688:12345-192.168.203.37@tcp:101:mkdir.0 00010000:00010000:3.0:1789579307.748002:0:22682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579307.748034:0:22682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366a00/0xd90373d592f22ccb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec581 expref: -99 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579307.748122:0:22682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f22cd2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579307.748140:0:22682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f22cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579307.748154:0:22682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f22cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789579307.748217:0:22682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789579307.748222:0:22682:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789579307.748247:0:22682:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f22cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579307.748275:0:22682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366a00/0xd90373d592f22ccb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec581 expref: 8 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579307.748296:0:22682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f22cd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec581 expref: 7 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579307.748306:0:22682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93940905b200) 00010000:00010000:3.0:1789579307.748309:0:22682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789579307.748314:0:22682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939304367000, rc 0) 00000100:00100000:3.0:1789579307.748443:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437204380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7263f938-3275-4200-b80b-4135ea8c4f2d+7:18238:x1876509261458688:12345-192.168.203.37@tcp:101:mkdir.0 Request processed in 494us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579307.748476:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 22 00010000:00010000:1.0:1789579307.748953:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789579308.260440:0:23440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789579308.774697:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579309.795627:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579309.923857:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277288320:0@lo:400:kworker.0 00000100:00100000:0.0:1789579309.923925:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579309.923973:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277288832:0@lo:400:kworker.0 00000100:00100000:0.0:1789579309.923995:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579309.924012:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277289344:0@lo:400:kworker.0 00000100:00100000:0.0:1789579309.924030:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579309.924048:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789579309.924053:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277288448:0@lo:400:kworker.0 00000100:00100000:0.0:1789579309.924069:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579309.924094:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277288960:0@lo:400:kworker.0 00000100:00100000:0.0:1789579309.924111:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579309.924124:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277289472:0@lo:400:kworker.0 00000100:00100000:0.0:1789579309.924145:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579309.924170:0:24187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277288320 00000100:00100000:0.0:1789579309.924177:0:24187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277288320 00000100:00100000:0.0:1789579309.924221:0:24187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277288832 00000100:00100000:0.0:1789579309.924224:0:24187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277288832 00000100:00100000:0.0:1789579309.924236:0:24187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277288448 00000100:00100000:0.0:1789579309.924251:0:24187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277288448 00000100:00100000:0.0:1789579309.924266:0:24187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277288960 00000100:00100000:0.0:1789579309.924269:0:24187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277288960 00000100:00100000:0.0:1789579309.924281:0:24187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789579309.924288:0:24187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437206680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277288320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579309.924335:0:24187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437206680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277288320:12345-0@lo:400:kworker.0 Request processed in 47us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579309.924341:0:24187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789579309.924394:0:24187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789579309.924401:0:24187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437204e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277288832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579309.924426:0:24187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437204e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277288832:12345-0@lo:400:kworker.0 Request processed in 26us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579309.924431:0:24187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789579309.924453:0:24187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789579309.924459:0:24187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437205500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277288448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579309.924496:0:24187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437205500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277288448:12345-0@lo:400:kworker.0 Request processed in 37us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579309.924502:0:24187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789579309.924514:0:24187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789579309.924520:0:24187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437204a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277288960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579309.924545:0:24187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437204a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277288960:12345-0@lo:400:kworker.0 Request processed in 26us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579309.924551:0:24187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1789579309.924573:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789579309.924577:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789579309.924603:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277288448:0@lo:400:kworker.0 00000100:00100000:0.0:1789579309.924626:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277288960:0@lo:400:kworker.0 00000100:00100000:0.0:1789579309.924634:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277288320:0@lo:400:kworker.0 00000100:00100000:0.0:1789579309.924641:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277288832:0@lo:400:kworker.0 00000100:00100000:1.0:1789579309.925186:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277288192:0@lo:400:kworker.0 00000100:00100000:1.0:1789579309.925225:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579309.925276:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277288704:0@lo:400:kworker.0 00000100:00100000:1.0:1789579309.925298:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579309.925316:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876509277289216:0@lo:400:kworker.0 00000100:00100000:1.0:1789579309.925335:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579309.925377:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1789579309.925383:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39addb08-5233-4b30-82ca-229405d26fae:3618:1876509277288064:0@lo:400:kworker.0 00000100:00100000:1.0:1789579309.925408:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579309.925428:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277288576:0@lo:400:kworker.0 00000100:00100000:1.0:1789579309.925460:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579309.925475:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277289088:0@lo:400:kworker.0 00000100:00100000:1.0:1789579309.925517:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579309.925534:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277289600:0@lo:400:kworker.0 00000100:00100000:1.0:1789579309.925551:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579309.925580:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277289344 00000100:00100000:1.0:1789579309.925585:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277289344 00000100:00100000:1.0:1789579309.925619:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277289472 00000100:00100000:1.0:1789579309.925635:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277289472 00000100:00100000:1.0:1789579309.925650:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277289216 00000100:00100000:1.0:1789579309.925652:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277289216 00000100:00100000:1.0:1789579309.925665:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277288576 00000100:00100000:1.0:1789579309.925667:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277288576 00000100:00100000:1.0:1789579309.925676:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277289088 00000100:00100000:1.0:1789579309.925678:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277289088 00000100:00100000:1.0:1789579309.925687:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277289600 00000100:00100000:1.0:1789579309.925689:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277289600 00000100:00100000:1.0:1789579309.925700:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789579309.925707:0:22680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437206a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277289344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579309.925755:0:22680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437206a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277289344:12345-0@lo:400:kworker.0 Request processed in 48us (1723us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579309.925773:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789579309.925788:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789579309.925795:0:22680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437204700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277289472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579309.925823:0:22680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437204700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277289472:12345-0@lo:400:kworker.0 Request processed in 29us (1676us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579309.925829:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789579309.926453:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789579309.926466:0:22681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876509277289216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579309.926521:0:22681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876509277289216:12345-0@lo:400:kworker.0 Request processed in 60us (1184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579309.926528:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789579309.926544:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789579309.926550:0:22681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277288576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579309.926577:0:22681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277288576:12345-0@lo:400:kworker.0 Request processed in 27us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579309.926582:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789579309.926592:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789579309.926598:0:22681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277289088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579309.926637:0:22681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277289088:12345-0@lo:400:kworker.0 Request processed in 39us (1118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579309.926643:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789579309.926655:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789579309.926661:0:22681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876509277289600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579309.926686:0:22681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876509277289600:12345-0@lo:400:kworker.0 Request processed in 26us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579309.926692:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789579309.926710:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277288064 00000100:00100000:2.0:1789579309.926714:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277288064 00000100:00100000:2.0:1789579309.926743:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789579309.926750:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+24:3618:x1876509277288064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579309.926793:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+24:3618:x1876509277288064:12345-0@lo:400:kworker.0 Request processed in 43us (1383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579309.926799:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789579309.926826:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277288192 00000100:00100000:2.0:1789579309.926829:0:23423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277288192 00000100:00080000:1.0:1789579309.929454:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789579309.929463:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789579309.929580:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277288704 00000100:00100000:3.0:1789579309.929591:0:22685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277288704 00000100:00100000:2.0:1789579309.929602:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789579309.929616:0:23423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277288192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579309.929626:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789579309.929698:0:22685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277288704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579309.929704:0:23423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277288192:12345-0@lo:400:kworker.0 Request processed in 91us (4476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579309.929713:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789579309.929773:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39addb08-5233-4b30-82ca-229405d26fae:3618:1876509277288064:0@lo:400:kworker.0 00000100:00100000:2.0:1789579309.929791:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277288576:0@lo:400:kworker.0 00000100:00100000:2.0:1789579309.929801:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277289088:0@lo:400:kworker.0 00010000:00080000:2.0:1789579309.929832:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5e5500 x1876509277289600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579309.930066:0:22685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277288704:12345-0@lo:400:kworker.0 Request processed in 431us (4765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579309.930073:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789579309.930206:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277289472:0@lo:400:kworker.0 00010000:00080000:1.0:1789579309.930231:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5e7800 x1876509277289344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579309.930242:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277289344:0@lo:400:kworker.0 00000100:00100000:2.0:1789579309.930392:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277289600:0@lo:400:kworker.0 00000100:00100000:2.0:1789579309.930408:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277288192:0@lo:400:kworker.0 00000100:00100000:2.0:1789579309.930418:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277288704:0@lo:400:kworker.0 00000100:00100000:2.0:1789579309.930428:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876509277289216:0@lo:400:kworker.0 00010000:00010000:2.0:1789579310.822599:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789579310.976376:0:23413:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7263f938-3275-4200-b80b-4135ea8c4f2d 00000001:00100000:1.0:1789579310.976389:0:23413:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a10e13f9-13f2-441e-b716-61685111baf3 00000001:00100000:2.0:1789579310.977062:0:25005:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7263f938-3275-4200-b80b-4135ea8c4f2d 00000001:00100000:2.0:1789579310.977069:0:25005:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a10e13f9-13f2-441e-b716-61685111baf3 00000001:00100000:1.0:1789579310.979099:0:24183:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7263f938-3275-4200-b80b-4135ea8c4f2d 00000001:00100000:1.0:1789579310.979113:0:24183:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a10e13f9-13f2-441e-b716-61685111baf3 00000001:00100000:3.0:1789579310.987772:0:22660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7263f938-3275-4200-b80b-4135ea8c4f2d 00000001:00100000:3.0:1789579310.987783:0:22660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a10e13f9-13f2-441e-b716-61685111baf3 00000001:02000400:0.0:1789579311.002036:0:25565:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1789579311.459803:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789579311.459827:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437206d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277289856:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789579311.459893:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579311.460187:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789579311.460200:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277289728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789579311.460235:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579311.460266:0:24190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277289856 00000100:00100000:1.0:1789579311.460273:0:24190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277289856 00000100:00100000:1.0:1789579311.460323:0:24190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789579311.460334:0:24190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437207800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277289856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789579311.460379:0:24190:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789579311.460525:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789579311.460534:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277289984:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789579311.460562:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579311.460589:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277289728 00000100:00100000:3.0:1789579311.460593:0:22685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277289728 00000100:00100000:3.0:1789579311.460617:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277289984 00000100:00100000:3.0:1789579311.460620:0:22685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277289984 00000100:00100000:3.0:1789579311.460632:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789579311.460638:0:22685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277289728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789579311.460660:0:22685:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789579311.460712:0:22685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277289728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579311.460719:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789579311.460734:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789579311.460740:0:22685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277289984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789579311.460770:0:22685:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789579311.460803:0:22685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277289984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579311.460809:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789579311.460843:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277289984:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1789579311.460874:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789579311.460898:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277289728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789579311.461151:0:24190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437207800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277289856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 820us (1258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579311.461158:0:24190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789579311.461249:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437206d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277289856:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789579311.846200:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579311.971842:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789579311.971866:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277290112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789579311.971931:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579311.972738:0:25479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277290112 00000100:00100000:1.0:1789579311.972749:0:25479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277290112 00000100:00100000:1.0:1789579311.972823:0:25479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789579311.972832:0:25479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437206d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277290112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789579311.972855:0:25479:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789579311.972907:0:25479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437206d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277290112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579311.972927:0:25479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1789579311.973258:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789579311.973299:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277290112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789579311.973805:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789579311.973818:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277290240:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789579311.973859:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579311.973890:0:24191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277290240 00000100:00100000:2.0:1789579311.973894:0:24191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277290240 00000100:00100000:2.0:1789579311.973929:0:24191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789579311.973935:0:24191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277290240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789579311.973966:0:24191:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789579311.974001:0:24191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277290240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579311.974007:0:24191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1789579311.974023:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789579311.974044:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277290240:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789579311.974463:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789579311.974474:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277290368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789579311.974514:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579311.974641:0:24190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277290368 00000100:00100000:3.0:1789579311.974647:0:24190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277290368 00000100:00100000:3.0:1789579311.974688:0:24190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789579311.974695:0:24190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437205f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277290368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789579311.974710:0:24190:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789579311.974754:0:24190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437205f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277290368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579311.974760:0:24190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1789579311.974981:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789579311.975009:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277290368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789579312.776760:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579312.776812:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579312.776849:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579312.776873:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579312.776890:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579312.776910:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579312.776931:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579312.776947:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579312.776987:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579312.777017:0:24187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261459328 00000100:00100000:3.0:1789579312.777026:0:24187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261459328 00000100:00100000:3.0:1789579312.777091:0:24187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261459840 00000100:00100000:3.0:1789579312.777095:0:24187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261459840 00000100:00100000:3.0:1789579312.777110:0:24187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261459200 00000100:00100000:3.0:1789579312.777112:0:24187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261459200 00000100:00100000:3.0:1789579312.777126:0:24187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261459712 00000100:00100000:3.0:1789579312.777129:0:24187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261459712 00000100:00100000:3.0:1789579312.777146:0:24187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 12 00000100:00100000:3.0:1789579312.777154:0:24187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a10e13f9-13f2-441e-b716-61685111baf3+5:2392:x1876509261459328:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789579312.777223:0:24187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a10e13f9-13f2-441e-b716-61685111baf3+5:2392:x1876509261459328:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 69us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579312.777231:0:24187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 12 00000100:00100000:3.0:1789579312.777250:0:24187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 13 00000100:00100000:3.0:1789579312.777257:0:24187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7263f938-3275-4200-b80b-4135ea8c4f2d+5:2392:x1876509261459840:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789579312.777280:0:24187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7263f938-3275-4200-b80b-4135ea8c4f2d+5:2392:x1876509261459840:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 24us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579312.777286:0:24187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 13 00000100:00100000:3.0:1789579312.777297:0:24187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 14 00000100:00100000:3.0:1789579312.777303:0:24187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a10e13f9-13f2-441e-b716-61685111baf3+5:2392:x1876509261459200:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789579312.777326:0:24187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a10e13f9-13f2-441e-b716-61685111baf3+5:2392:x1876509261459200:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 23us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579312.777332:0:24187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 14 00000100:00100000:3.0:1789579312.777343:0:24187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 15 00000100:00100000:3.0:1789579312.777374:0:24187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7263f938-3275-4200-b80b-4135ea8c4f2d+5:2392:x1876509261459712:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789579312.777426:0:24187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7263f938-3275-4200-b80b-4135ea8c4f2d+5:2392:x1876509261459712:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 66us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579312.777440:0:24187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 15 00000100:00100000:3.0:1789579312.777467:0:24054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261459072 00000100:00100000:3.0:1789579312.777472:0:24054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261459072 00000100:00100000:3.0:1789579312.777499:0:24054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261459584 00000100:00100000:3.0:1789579312.777502:0:24054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261459584 00000100:00100000:3.0:1789579312.777513:0:24054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261458944 00000100:00100000:3.0:1789579312.777515:0:24054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261458944 00000100:00100000:3.0:1789579312.777525:0:24054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261459456 00000100:00100000:3.0:1789579312.777527:0:24054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261459456 00000100:00100000:3.0:1789579312.777540:0:24054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 48 00000100:00100000:3.0:1789579312.777545:0:24054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a10e13f9-13f2-441e-b716-61685111baf3+5:2392:x1876509261459072:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789579312.777573:0:24054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a10e13f9-13f2-441e-b716-61685111baf3+5:2392:x1876509261459072:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 27us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579312.777579:0:24054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 48 00000100:00100000:3.0:1789579312.777593:0:24054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 49 00000100:00100000:3.0:1789579312.777598:0:24054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7263f938-3275-4200-b80b-4135ea8c4f2d+5:2392:x1876509261459584:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789579312.777621:0:24054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7263f938-3275-4200-b80b-4135ea8c4f2d+5:2392:x1876509261459584:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 23us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579312.777626:0:24054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 49 00000100:00100000:3.0:1789579312.777636:0:24054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 50 00000100:00100000:3.0:1789579312.777642:0:24054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a10e13f9-13f2-441e-b716-61685111baf3+6:2392:x1876509261458944:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789579312.777664:0:24054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a10e13f9-13f2-441e-b716-61685111baf3+6:2392:x1876509261458944:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 22us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579312.777670:0:24054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 50 00000100:00100000:3.0:1789579312.777682:0:24054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 51 00000100:00100000:3.0:1789579312.777695:0:24054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7263f938-3275-4200-b80b-4135ea8c4f2d+6:2392:x1876509261459456:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789579312.777720:0:24054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7263f938-3275-4200-b80b-4135ea8c4f2d+6:2392:x1876509261459456:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 27us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579312.777727:0:24054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 51 00000100:00080000:3.0:1789579312.777749:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789579312.777753:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789579312.777755:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789579312.777757:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789579312.777973:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261458816 00000100:00100000:1.0:1789579312.777978:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261458816 00000100:00100000:1.0:1789579312.778019:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 144 00000100:00100000:1.0:1789579312.778027:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26ca68eb-fc53-4468-a753-d660cc98bf7c+13:2392:x1876509261458816:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789579312.778062:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26ca68eb-fc53-4468-a753-d660cc98bf7c+13:2392:x1876509261458816:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 37us (1311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579312.778069:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 144 00010000:00010000:3.0:1789579312.871231:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789579313.196243:0:22718:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789579313.891576:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789579314.697448:0:25713:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcbfe25e50 20000000:00000080:0.0:1789579314.697466:0:25713:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93940465e800 uarg=0000000000000000 20000000:01000000:0.0:1789579314.697507:0:25713:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789579314.697512:0:25713:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789579314.697516:0:25713:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789579314.701343:0:25714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1789579314.701589:0:25713:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789579314.716762:0:25713:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789579314.717230:0:25713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939303437400/0xd90373d592f22cd9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579314.717266:0:25713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939435d7ac00/0xd90373d592f22936 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f2292f expref: 23 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579314.717274:0:25713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939435d7b000/0xd90373d592f22944 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f2293d expref: 23 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579314.717282:0:25713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9394363afc00/0xd90373d592f22983 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f2297c expref: 23 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579314.717289:0:25713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939435d7aa00/0xd90373d592f22a1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f22a16 expref: 23 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579314.717298:0:25713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939400031200/0xd90373d592f22c69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec4e0 expref: 12 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579314.717306:0:25713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939303436200/0xd90373d592f22ca8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec550 expref: 12 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579314.717313:0:25713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff939303437400/0xd90373d592f22cd9 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579314.718250:0:25713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939303436200/0xd90373d592f22ca8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec550 expref: 12 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579314.718306:0:25713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939303436200/0xd90373d592f22ca8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec550 expref: 12 pid: 22675 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579314.718321:0:25713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437207100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25713:1876509277290496:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789579314.718602:0:25713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939400031200/0xd90373d592f22c69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec4e0 expref: 12 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579314.718621:0:25713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939400031200/0xd90373d592f22c69 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec4e0 expref: 12 pid: 22675 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579314.718629:0:25713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25713:1876509277290624:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789579314.718663:0:25713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939435d7aa00/0xd90373d592f22a1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f22a16 expref: 23 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579314.718671:0:25713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939435d7aa00/0xd90373d592f22a1d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f22a16 expref: 23 pid: 22673 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579314.718679:0:25713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437207b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25713:1876509277290752:0@lo:104: 00000100:00100000:0.0:1789579314.718717:0:25713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789579314.718756:0:25713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9394363afc00/0xd90373d592f22983 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f2297c expref: 23 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579314.718764:0:25713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9394363afc00/0xd90373d592f22983 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f2297c expref: 23 pid: 22675 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579314.718771:0:25713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437205c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25713:1876509277290880:0@lo:104: 00000100:00100000:0.0:1789579314.718839:0:25713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789579314.718879:0:25713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939435d7b000/0xd90373d592f22944 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f2293d expref: 23 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579314.718888:0:25713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939435d7b000/0xd90373d592f22944 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f2293d expref: 23 pid: 22673 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579314.718896:0:25713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25713:1876509277291008:0@lo:104: 00000100:00100000:2.0:1789579314.718897:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277290752 00000100:00100000:2.0:1789579314.718907:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277290752 00000100:00100000:0.0:1789579314.718921:0:25713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789579314.718953:0:25713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939435d7ac00/0xd90373d592f22936 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f2292f expref: 23 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579314.718959:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277290880 00010000:00010000:0.0:1789579314.718963:0:25713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939435d7ac00/0xd90373d592f22936 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f2292f expref: 23 pid: 22674 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579314.718965:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277290880 00000100:00100000:0.0:1789579314.718975:0:25713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25713:1876509277291136:0@lo:104: 00000100:00100000:2.0:1789579314.718981:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277291008 00000100:00100000:2.0:1789579314.718985:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277291008 00000100:00100000:2.0:1789579314.719004:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789579314.719005:0:25713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579314.719017:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437207480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39addb08-5233-4b30-82ca-229405d26fae+5:25713:x1876509277290752:12345-0@lo:104: 00000100:00100000:0.0:1789579314.719023:0:25713:0:(client.c:2716:ptlrpc_set_wait()) set ffff93930201e900 going to sleep for 11 seconds 00010000:00010000:2.0:1789579314.719031:0:22664:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff9394363afa00/0xd90373d592f22a16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f22a1d expref: -99 pid: 25004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579314.719044:0:22663:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1789579314.719054:0:22663:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1789579314.719095:0:22664:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789579314.719102:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437207480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39addb08-5233-4b30-82ca-229405d26fae+5:25713:x1876509277290752:12345-0@lo:104: Request processed in 88us (385us total) trans 0 rc 0/0 00010000:00010000:1.0:1789579314.719108:0:22669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1789579314.719110:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1789579314.719118:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff9394363afa00/0xd90373d592f22a16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f22a1d expref: -99 pid: 25004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579314.719127:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363afa00 already unused, calling callback (ffffffffc125cc20) 00000100:00100000:2.0:1789579314.719129:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277291136 10000000:00010000:1.0:1789579314.719132:0:22669:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff9394363afa00/0xd90373d592f22a16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f22a1d expref: -99 pid: 25004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579314.719134:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277291136 00010000:00010000:1.0:1789579314.719145:0:22669:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff9394363afa00/0xd90373d592f22a16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f22a1d expref: -99 pid: 25004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579314.719152:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 10000000:00010000:1.0:1789579314.719154:0:22669:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff9394363afa00/0xd90373d592f22a16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f22a1d expref: -99 pid: 25004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579314.719162:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39addb08-5233-4b30-82ca-229405d26fae+5:25713:x1876509277290880:12345-0@lo:104: 10000000:01000000:1.0:1789579314.719164:0:22669:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789579314.719171:0:22664:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939435d7ae00/0xd90373d592f2297c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f22983 expref: -99 pid: 24182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579314.719204:0:22669:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff9394363afa00/0xd90373d592f22a16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f22a1d expref: -99 pid: 25004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579314.719211:0:22669:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789579314.719212:0:22664:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789579314.719219:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39addb08-5233-4b30-82ca-229405d26fae+5:25713:x1876509277290880:12345-0@lo:104: Request processed in 59us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579314.719227:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789579314.719241:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1789579314.719245:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff9394363afa00/0xd90373d592f22a16 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f22a1d expref: -99 pid: 25004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579314.719249:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39addb08-5233-4b30-82ca-229405d26fae+4:25713:x1876509277291008:12345-0@lo:104: 00010000:00010000:1.0:1789579314.719257:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff9394363afa00/0xd90373d592f22a16 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f22a1d expref: -99 pid: 25004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579314.719261:0:22664:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939435d7a000/0xd90373d592f2293d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f22944 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579314.719270:0:22669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579314.719274:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939435d7ae00/0xd90373d592f2297c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f22983 expref: -99 pid: 24182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579314.719287:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939435d7ae00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1789579314.719290:0:22669:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939435d7ae00/0xd90373d592f2297c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f22983 expref: -99 pid: 24182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579314.719297:0:22669:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939435d7ae00/0xd90373d592f2297c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f22983 expref: -99 pid: 24182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789579314.719303:0:22669:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939435d7ae00/0xd90373d592f2297c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f22983 expref: -99 pid: 24182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789579314.719308:0:22669:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789579314.719316:0:22664:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789579314.719324:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39addb08-5233-4b30-82ca-229405d26fae+4:25713:x1876509277291008:12345-0@lo:104: Request processed in 75us (402us total) trans 0 rc 0/0 00010000:00010000:1.0:1789579314.719324:0:22669:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939435d7ae00/0xd90373d592f2297c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f22983 expref: -99 pid: 24182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579314.719337:0:22669:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789579314.719338:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1789579314.719379:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939435d7ae00/0xd90373d592f2297c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f22983 expref: -99 pid: 24182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579314.719380:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789579314.719390:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39addb08-5233-4b30-82ca-229405d26fae+3:25713:x1876509277291136:12345-0@lo:104: 00010000:00010000:2.0:1789579314.719408:0:22664:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939302b2e600/0xd90373d592f2292f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f22936 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579314.719411:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939435d7ae00/0xd90373d592f2297c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f22983 expref: -99 pid: 24182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579314.719431:0:22669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579314.719434:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939435d7a000/0xd90373d592f2293d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f22944 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579314.719441:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939435d7a000 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1789579314.719444:0:22669:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939435d7a000/0xd90373d592f2293d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f22944 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579314.719449:0:22664:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789579314.719452:0:22669:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939435d7a000/0xd90373d592f2293d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f22944 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579314.719457:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39addb08-5233-4b30-82ca-229405d26fae+3:25713:x1876509277291136:12345-0@lo:104: Request processed in 67us (454us total) trans 0 rc 0/0 10000000:00010000:1.0:1789579314.719466:0:22669:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939435d7a000/0xd90373d592f2293d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f22944 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579314.719469:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 10000000:01000000:1.0:1789579314.719477:0:22669:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789579314.719495:0:22669:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939435d7a000/0xd90373d592f2293d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f22944 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579314.719500:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1789579314.719502:0:22669:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789579314.719511:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939435d7a000/0xd90373d592f2293d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f22944 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579314.719512:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39addb08-5233-4b30-82ca-229405d26fae:3615:1876509277291264:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789579314.719525:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939435d7a000/0xd90373d592f2293d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f22944 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579314.719534:0:22669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579314.719543:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939302b2e600/0xd90373d592f2292f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f22936 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579314.719551:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789579314.719557:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939302b2e600 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1789579314.719561:0:22669:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939302b2e600/0xd90373d592f2292f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f22936 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579314.719568:0:22669:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939302b2e600/0xd90373d592f2292f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f22936 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789579314.719575:0:22669:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939302b2e600/0xd90373d592f2292f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f22936 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789579314.719581:0:22669:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1789579314.719584:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39addb08-5233-4b30-82ca-229405d26fae:3617:1876509277291392:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789579314.719603:0:22669:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939302b2e600/0xd90373d592f2292f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f22936 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579314.719611:0:22669:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789579314.719613:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789579314.719624:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939302b2e600/0xd90373d592f2292f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f22936 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579314.719632:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939302b2e600/0xd90373d592f2292f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f22936 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579314.719637:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789579314.719646:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39addb08-5233-4b30-82ca-229405d26fae:3617:1876509277291520:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789579314.719647:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579314.719651:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579314.719653:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579314.719661:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789579314.719670:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579314.719700:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277291264 00000100:00100000:2.0:1789579314.719704:0:22665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277291264 00010000:00010000:2.0:1789579314.719724:0:22665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939435d7aa00/0xd90373d592f22a1d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f22a16 expref: 24 pid: 22673 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579314.719746:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39addb08-5233-4b30-82ca-229405d26fae:3616:1876509277291648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789579314.719751:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277291392 00000100:00100000:2.0:1789579314.719756:0:22665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277291392 00010000:00010000:2.0:1789579314.719773:0:22665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9394363afc00/0xd90373d592f22983 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f2297c expref: 25 pid: 22675 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579314.719786:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277291520 00000100:00100000:2.0:1789579314.719789:0:22665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277291520 00000100:00100000:1.0:1789579314.719793:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789579314.719802:0:22665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939435d7b000/0xd90373d592f22944 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f2293d expref: 26 pid: 22673 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579314.719816:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277291648 00000100:00100000:2.0:1789579314.719819:0:22665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277291648 00010000:00010000:2.0:1789579314.719830:0:22665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939435d7ac00/0xd90373d592f22936 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f2292f expref: 27 pid: 22674 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579314.719842:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789579314.719848:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39addb08-5233-4b30-82ca-229405d26fae+27:3615:x1876509277291264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789579314.719857:0:22665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579314.719862:0:22665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939435d7aa00/0xd90373d592f22a1d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f22a16 expref: 27 pid: 22673 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579314.719870:0:22665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939435d7aa00/0xd90373d592f22a1d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f22a16 expref: 27 pid: 22673 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579314.719884:0:22665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789579314.719906:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39addb08-5233-4b30-82ca-229405d26fae+27:3615:x1876509277291264:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579314.719912:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789579314.719922:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789579314.719933:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39addb08-5233-4b30-82ca-229405d26fae+26:3617:x1876509277291392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789579314.719941:0:22665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579314.719946:0:22665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9394363afc00/0xd90373d592f22983 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f2297c expref: 26 pid: 22675 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579314.719953:0:22665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9394363afc00/0xd90373d592f22983 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f2297c expref: 26 pid: 22675 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579314.719963:0:22665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789579314.719997:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39addb08-5233-4b30-82ca-229405d26fae+26:3617:x1876509277291392:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579314.720002:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789579314.720014:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789579314.720019:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39addb08-5233-4b30-82ca-229405d26fae+25:3617:x1876509277291520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789579314.720026:0:22665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579314.720029:0:22665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939435d7b000/0xd90373d592f22944 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f2293d expref: 25 pid: 22673 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579314.720037:0:22665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939435d7b000/0xd90373d592f22944 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f2293d expref: 25 pid: 22673 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579314.720045:0:22665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789579314.720065:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39addb08-5233-4b30-82ca-229405d26fae+25:3617:x1876509277291520:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579314.720070:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789579314.720080:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789579314.720086:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39addb08-5233-4b30-82ca-229405d26fae+24:3616:x1876509277291648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789579314.720092:0:22665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579314.720119:0:22665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939435d7ac00/0xd90373d592f22936 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f2292f expref: 24 pid: 22674 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579314.720127:0:22665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939435d7ac00/0xd90373d592f22936 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f2292f expref: 24 pid: 22674 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579314.720136:0:22665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789579314.720163:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39addb08-5233-4b30-82ca-229405d26fae+24:3616:x1876509277291648:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579314.720169:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789579314.720216:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39addb08-5233-4b30-82ca-229405d26fae:3615:1876509277291264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789579314.720238:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39addb08-5233-4b30-82ca-229405d26fae:3616:1876509277291648:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789579314.720329:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579314.720394:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39addb08-5233-4b30-82ca-229405d26fae:3617:1876509277291520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789579314.720430:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39addb08-5233-4b30-82ca-229405d26fae:3617:1876509277291392:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789579314.720590:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579314.723223:0:25713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939435d7aa00/0xd90373d592f22a1d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f22a16 expref: 23 pid: 22673 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579314.723243:0:25713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437207b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25713:1876509277290752:0@lo:104: 00010000:00010000:0.0:1789579314.723256:0:25713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394363afc00/0xd90373d592f22983 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f2297c expref: 22 pid: 22675 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579314.723266:0:25713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437205c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25713:1876509277290880:0@lo:104: 00010000:00010000:0.0:1789579314.723275:0:25713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939435d7b000/0xd90373d592f22944 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f2293d expref: 21 pid: 22673 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579314.723285:0:25713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25713:1876509277291008:0@lo:104: 00010000:00010000:0.0:1789579314.723294:0:25713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939435d7ac00/0xd90373d592f22936 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f2292f expref: 20 pid: 22674 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579314.723302:0:25713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25713:1876509277291136:0@lo:104: 00000100:00100000:3.0:1789579314.728240:0:25713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437207100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25713:1876509277290496:192.168.203.37@tcp:104: 00000100:00100000:3.0:1789579314.728256:0:25713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25713:1876509277290624:192.168.203.37@tcp:104: 00000100:00100000:1.0:1789579314.728286:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00010000:00010000:3.0:1789579314.728303:0:25713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff939303437400/0xd90373d592f22cd9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579314.728346:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579314.728543:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261459968 00000100:00100000:0.0:1789579314.728551:0:22665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261459968 00010000:00010000:0.0:1789579314.728586:0:22665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939303436200/0xd90373d592f22ca8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec550 expref: 13 pid: 22675 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579314.728641:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261460096 00000100:00100000:0.0:1789579314.728645:0:22665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261460096 00010000:00010000:0.0:1789579314.728657:0:22665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939400031200/0xd90373d592f22c69 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec4e0 expref: 14 pid: 22675 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579314.728670:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 13 00000100:00100000:0.0:1789579314.728678:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393037ca450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26ca68eb-fc53-4468-a753-d660cc98bf7c+14:2395:x1876509261459968:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789579314.728690:0:22665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789579314.728696:0:22665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939303436200/0xd90373d592f22ca8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec550 expref: 14 pid: 22675 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579314.728706:0:22665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939303436200/0xd90373d592f22ca8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec550 expref: 14 pid: 22675 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579314.728721:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303436200/0xd90373d592f22ca8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec550 expref: 14 pid: 22675 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579314.728735:0:22665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789579314.728778:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393037ca450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26ca68eb-fc53-4468-a753-d660cc98bf7c+13:2395:x1876509261459968:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 100us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579314.728785:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 13 00000100:00100000:0.0:1789579314.728843:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 14 00000100:00100000:0.0:1789579314.728850:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26ca68eb-fc53-4468-a753-d660cc98bf7c+12:2395:x1876509261460096:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789579314.728957:0:22665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789579314.728964:0:22665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939400031200/0xd90373d592f22c69 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec4e0 expref: 12 pid: 22675 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579314.728983:0:22665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939400031200/0xd90373d592f22c69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec4e0 expref: 12 pid: 22675 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579314.728994:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939400031200/0xd90373d592f22c69 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec4e0 expref: 12 pid: 22675 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579314.729006:0:22665:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff939303437400/0xd90373d592f22cd9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579314.729014:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303437400/0xd90373d592f22cd9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579314.729028:0:22665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939303437400/0xd90373d592f22cd9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579314.729035:0:22665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939303437400/0xd90373d592f22cd9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579314.729042:0:22665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939303437400/0xd90373d592f22cd9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579314.729049:0:22665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939303437400/0xd90373d592f22cd9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579314.729055:0:22665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437400 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:0.0:1789579314.729059:0:22665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939303437400/0xd90373d592f22cd9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579314.729067:0:22665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939303437400/0xd90373d592f22cd9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579314.738005:0:25713:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff939303437400/0xd90373d592f22cd9 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579314.738025:0:25713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939303437400/0xd90373d592f22cd9 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579314.739083:0:22665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939303437400/0xd90373d592f22cd9 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579314.739101:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303437400/0xd90373d592f22cd9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579314.739196:0:22665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789579314.739314:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26ca68eb-fc53-4468-a753-d660cc98bf7c+11:2395:x1876509261460096:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 10459us (10962us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579314.739325:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 14 00010000:00010000:3.0:1789579314.917208:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579315.044945:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277292032:0@lo:400:kworker.0 00000100:00100000:1.0:1789579315.045011:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579315.045043:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277292544:0@lo:400:kworker.0 00000100:00100000:1.0:1789579315.045063:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579315.045078:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930486e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876509277293056:0@lo:400:kworker.0 00000100:00100000:1.0:1789579315.045099:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579315.045120:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789579315.045126:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277291904:0@lo:400:kworker.0 00000100:00100000:2.0:1789579315.045340:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39addb08-5233-4b30-82ca-229405d26fae:3616:1876509277291776:0@lo:400:kworker.0 00000100:00100000:2.0:1789579315.045391:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579315.045431:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277292288:0@lo:400:kworker.0 00000100:00100000:2.0:1789579315.045453:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579315.045468:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876509277292800:0@lo:400:kworker.0 00000100:00100000:2.0:1789579315.045487:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579315.045501:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930486d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876509277293312:0@lo:400:kworker.0 00000100:00100000:2.0:1789579315.045518:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579315.045534:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789579315.045539:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277292160:0@lo:400:kworker.0 00000100:00100000:2.0:1789579315.045560:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579315.045574:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277292672:0@lo:400:kworker.0 00000100:00100000:2.0:1789579315.045617:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579315.045634:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930486f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876509277293184:0@lo:400:kworker.0 00000100:00100000:2.0:1789579315.045664:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579315.045698:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277291776 00000100:00100000:2.0:1789579315.045705:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277291776 00000100:00100000:2.0:1789579315.045752:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789579315.045761:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+20:3616:x1876509277291776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579315.045810:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+20:3616:x1876509277291776:12345-0@lo:400:kworker.0 Request processed in 50us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579315.045818:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789579315.045851:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277293056 00000100:00100000:2.0:1789579315.045855:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277293056 00000100:00100000:2.0:1789579315.045880:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277292288 00000100:00100000:2.0:1789579315.045883:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277292288 00000100:00100000:2.0:1789579315.045894:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277292800 00000100:00100000:2.0:1789579315.045896:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277292800 00000100:00100000:2.0:1789579315.045906:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277293312 00000100:00100000:2.0:1789579315.045908:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277293312 00000100:00100000:2.0:1789579315.045921:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277293184 00000100:00100000:2.0:1789579315.045923:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277293184 00000100:00100000:2.0:1789579315.045934:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789579315.045940:0:22680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876509277293056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579315.045970:0:22680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876509277293056:12345-0@lo:400:kworker.0 Request processed in 30us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579315.045976:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789579315.045988:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789579315.045995:0:22680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277292288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579315.046021:0:22680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277292288:12345-0@lo:400:kworker.0 Request processed in 27us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579315.046033:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789579315.046044:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789579315.046049:0:22680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876509277292800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579315.046077:0:22680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876509277292800:12345-0@lo:400:kworker.0 Request processed in 27us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579315.046082:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789579315.046092:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789579315.046098:0:22680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876509277293312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579315.046122:0:22680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876509277293312:12345-0@lo:400:kworker.0 Request processed in 24us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579315.046128:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789579315.046137:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789579315.046143:0:22680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876509277293184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579315.046187:0:22680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876509277293184:12345-0@lo:400:kworker.0 Request processed in 44us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579315.046193:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789579315.046231:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930486f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876509277293184:0@lo:400:kworker.0 00000100:00100000:2.0:1789579315.046241:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39addb08-5233-4b30-82ca-229405d26fae:3616:1876509277291776:0@lo:400:kworker.0 00000100:00100000:2.0:1789579315.046249:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277292288:0@lo:400:kworker.0 00000100:00100000:2.0:1789579315.046256:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876509277292800:0@lo:400:kworker.0 00010000:00080000:2.0:1789579315.046266:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93930486d880 x1876509277293312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579315.046277:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930486d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876509277293312:0@lo:400:kworker.0 00000100:00100000:3.0:1789579315.047111:0:24187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277292032 00000100:00100000:3.0:1789579315.047120:0:24187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277292032 00000100:00100000:3.0:1789579315.047179:0:24187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277292544 00000100:00100000:3.0:1789579315.047183:0:24187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277292544 00000100:00100000:3.0:1789579315.047197:0:24187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277292160 00000100:00100000:3.0:1789579315.047200:0:24187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277292160 00000100:00100000:3.0:1789579315.047210:0:24187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277292672 00000100:00100000:3.0:1789579315.047213:0:24187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277292672 00000100:00100000:3.0:1789579315.047226:0:24187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789579315.047234:0:24187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277292032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579315.047285:0:24187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277292032:12345-0@lo:400:kworker.0 Request processed in 52us (2273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579315.047292:0:24187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789579315.047314:0:24187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789579315.047320:0:24187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277292544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579315.047372:0:24187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277292544:12345-0@lo:400:kworker.0 Request processed in 29us (2284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579315.047379:0:24187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789579315.047391:0:24187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789579315.047407:0:24187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277292160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579315.047441:0:24187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277292160:12345-0@lo:400:kworker.0 Request processed in 45us (1881us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579315.047447:0:24187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789579315.047458:0:24187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789579315.047463:0:24187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277292672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579315.047488:0:24187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277292672:12345-0@lo:400:kworker.0 Request processed in 25us (1871us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579315.047494:0:24187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1789579315.047532:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789579315.047536:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789579315.047538:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789579315.047541:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789579315.048032:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277292160:0@lo:400:kworker.0 00000100:00100000:0.0:1789579315.048045:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277292672:0@lo:400:kworker.0 00000100:00100000:2.0:1789579315.048108:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579315.048376:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277292416:0@lo:400:kworker.0 00000100:00100000:2.0:1789579315.048420:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579315.048481:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876509277292928:0@lo:400:kworker.0 00000100:00100000:2.0:1789579315.048504:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579315.048538:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277292032:0@lo:400:kworker.0 00000100:00100000:2.0:1789579315.048549:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277292544:0@lo:400:kworker.0 00010000:00080000:2.0:1789579315.048561:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93930486e680 x1876509277293056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579315.048571:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930486e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876509277293056:0@lo:400:kworker.0 00000100:00100000:1.0:1789579315.048683:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277292928 00000100:00100000:1.0:1789579315.048688:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277292928 00000100:00100000:1.0:1789579315.048749:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789579315.048757:0:22680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876509277292928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579315.048796:0:22680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876509277292928:12345-0@lo:400:kworker.0 Request processed in 40us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579315.048803:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789579315.049470:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277291904 00000100:00100000:0.0:1789579315.049477:0:23423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277291904 00000100:00100000:0.0:1789579315.049518:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277292416 00000100:00100000:0.0:1789579315.049521:0:23423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277292416 00000100:00100000:0.0:1789579315.049536:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789579315.049542:0:23423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277291904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579315.049586:0:23423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277291904:12345-0@lo:400:kworker.0 Request processed in 44us (1478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579315.049593:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789579315.049605:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789579315.049610:0:23423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277292416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579315.049635:0:23423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277292416:12345-0@lo:400:kworker.0 Request processed in 25us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579315.049640:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1789579315.050378:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789579315.050431:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277291904:0@lo:400:kworker.0 00000100:00100000:2.0:1789579315.050445:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277292416:0@lo:400:kworker.0 00000100:00100000:2.0:1789579315.050455:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876509277292928:0@lo:400:kworker.0 10000000:01000000:2.0:1789579315.811532:0:22677:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789579315.811539:0:22677:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93942e142800 from 13 10000000:01000000:2.0:1789579315.811545:0:22677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789579315.811594:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939400030200/0xd90373d592f22ce0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579315.811605:0:22677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939400030200/0xd90373d592f22ce0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579315.811620:0:22677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939400030200/0xd90373d592f22ce0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579315.811663:0:22677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277293440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789579315.811730:0:22677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579315.811780:0:22677:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408f64240 going to sleep for 11 seconds 00000100:00100000:3.0:1789579315.813045:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277293440 00000100:00100000:3.0:1789579315.813055:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277293440 00000100:00100000:3.0:1789579315.813118:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789579315.814053:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+20:22677:x1876509277293440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789579315.814073:0:22673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579315.814096:0:22673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939304367a00/0xd90373d592f22ce7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f22ce0 expref: -99 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579315.814142:0:22673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939304367a00/0xd90373d592f22ce7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f22ce0 expref: 21 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579315.814154:0:22673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939304367a00/0xd90373d592f22ce7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f22ce0 expref: 21 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579315.814162:0:22673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939304367a00, rc 0) 00000100:00100000:3.0:1789579315.814253:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+21:22677:x1876509277293440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1126us (2522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579315.814261:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789579315.814576:0:22677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277293440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789579315.814594:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939400030200/0xd90373d592f22ce0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22ce7 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579315.814604:0:22677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939400030200/0xd90373d592f22ce0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f22ce7 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579315.814671:0:22677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277293568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789579315.814702:0:22677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579315.814743:0:22677:0:(client.c:2716:ptlrpc_set_wait()) set ffff93930201e240 going to sleep for 11 seconds 00000100:00100000:1.0:1789579315.814814:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277293568 00000100:00100000:1.0:1789579315.814820:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277293568 00000100:00100000:1.0:1789579315.814876:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789579315.814884:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+21:22677:x1876509277293568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789579315.815012:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+21:22677:x1876509277293568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579315.815020:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789579315.815187:0:22677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277293568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789579315.815222:0:22677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277293696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789579315.815262:0:22677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579315.815283:0:22677:0:(client.c:2716:ptlrpc_set_wait()) set ffff93930201e240 going to sleep for 11 seconds 00000100:00100000:2.0:1789579315.815435:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277293696 00000100:00100000:2.0:1789579315.815440:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277293696 00000100:00100000:2.0:1789579315.815474:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789579315.815481:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+21:22677:x1876509277293696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789579315.815570:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+21:22677:x1876509277293696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579315.815578:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789579315.816022:0:22677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277293696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789579315.817331:0:25727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789579315.823025:0:22677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789579315.823061:0:22677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789579315.823073:0:22677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939400030200/0xd90373d592f22ce0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22ce7 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579315.823085:0:22677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939400030200/0xd90373d592f22ce0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22ce7 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789579315.823096:0:22677:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789579315.823098:0:22677:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff939403daf000 from 13 10000000:01000000:2.0:1789579315.823101:0:22677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789579315.823139:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939400031200/0xd90373d592f22cee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579315.823148:0:22677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939400031200/0xd90373d592f22cee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579315.823159:0:22677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939400031200/0xd90373d592f22cee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579315.823270:0:22677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277293824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789579315.823333:0:22677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579315.823410:0:22677:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408f64540 going to sleep for 11 seconds 00000100:00100000:1.0:1789579315.823702:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277293824 00000100:00100000:1.0:1789579315.823711:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277293824 00000100:00100000:1.0:1789579315.823763:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789579315.823772:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402b71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+21:22677:x1876509277293824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789579315.823785:0:22675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579315.823799:0:22675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394041daa00/0xd90373d592f22cf5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f22cee expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579315.823822:0:22675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394041daa00/0xd90373d592f22cf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f22cee expref: 22 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579315.823832:0:22675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394041daa00/0xd90373d592f22cf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f22cee expref: 22 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579315.823840:0:22675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394041daa00, rc 0) 00000100:00100000:1.0:1789579315.824566:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402b71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+22:22677:x1876509277293824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 790us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579315.824574:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789579315.825870:0:22677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277293824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789579315.825895:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939400031200/0xd90373d592f22cee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22cf5 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579315.825908:0:22677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939400031200/0xd90373d592f22cee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f22cf5 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579315.825997:0:22677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277293952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789579315.826042:0:22677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579315.826099:0:22677:0:(client.c:2716:ptlrpc_set_wait()) set ffff93930201e240 going to sleep for 11 seconds 00000100:00100000:3.0:1789579315.826321:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277293952 00000100:00100000:3.0:1789579315.826328:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277293952 00000100:00100000:3.0:1789579315.826377:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789579315.826386:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402b73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+22:22677:x1876509277293952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789579315.826521:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402b73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+22:22677:x1876509277293952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579315.826528:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789579315.826622:0:22677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277293952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789579315.826652:0:22677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277294080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789579315.826692:0:22677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579315.826723:0:22677:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408f64cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789579315.826834:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277294080 00000100:00100000:3.0:1789579315.826838:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277294080 00000100:00100000:3.0:1789579315.826869:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789579315.826876:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402b72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+22:22677:x1876509277294080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789579315.826955:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402b72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+22:22677:x1876509277294080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579315.826961:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789579315.827441:0:22677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277294080:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789579315.828524:0:25728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789579315.828728:0:22677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789579315.828750:0:22677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789579315.828760:0:22677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939400031200/0xd90373d592f22cee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22cf5 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579315.828771:0:22677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939400031200/0xd90373d592f22cee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22cf5 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789579315.828781:0:22677:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789579315.828784:0:22677:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93943f647000 from 13 10000000:01000000:2.0:1789579315.828787:0:22677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789579315.828816:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939400030e00/0xd90373d592f22cfc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579315.828825:0:22677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939400030e00/0xd90373d592f22cfc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579315.828834:0:22677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939400030e00/0xd90373d592f22cfc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579315.828865:0:22677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277294208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789579315.828912:0:22677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579315.828954:0:22677:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408f64cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789579315.829883:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277294208 00000100:00100000:3.0:1789579315.829892:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277294208 00000100:00100000:3.0:1789579315.830021:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789579315.830030:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402b70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+22:22677:x1876509277294208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789579315.830045:0:22674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579315.830059:0:22674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939304366a00/0xd90373d592f22d03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f22cfc expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579315.830084:0:22674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939304366a00/0xd90373d592f22d03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f22cfc expref: 23 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579315.830095:0:22674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939304366a00/0xd90373d592f22d03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f22cfc expref: 23 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579315.830105:0:22674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939304366a00, rc 0) 00000100:00100000:3.0:1789579315.830297:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402b70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+23:22677:x1876509277294208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 268us (1383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579315.830304:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789579315.830454:0:22677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277294208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789579315.830471:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939400030e00/0xd90373d592f22cfc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22d03 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579315.830481:0:22677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939400030e00/0xd90373d592f22cfc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f22d03 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579315.830544:0:22677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277294336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789579315.830573:0:22677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579315.830679:0:22677:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408f64cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789579315.831051:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277294336 00000100:00100000:1.0:1789579315.831058:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277294336 00000100:00100000:1.0:1789579315.831090:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789579315.831097:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402b73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+23:22677:x1876509277294336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789579315.831889:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402b73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+23:22677:x1876509277294336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 789us (1311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579315.831899:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789579315.832986:0:22677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277294336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789579315.833044:0:22677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277294464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789579315.833106:0:22677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579315.833187:0:22677:0:(client.c:2716:ptlrpc_set_wait()) set ffff93930201e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789579315.833229:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277294464 00000100:00100000:3.0:1789579315.833235:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277294464 00000100:00100000:3.0:1789579315.833316:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789579315.833325:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402b73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+23:22677:x1876509277294464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789579315.833458:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402b73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+23:22677:x1876509277294464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579315.833465:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789579315.833532:0:22677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277294464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789579315.834324:0:25729:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789579315.835475:0:22677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789579315.835500:0:22677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789579315.835510:0:22677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939400030e00/0xd90373d592f22cfc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22d03 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579315.835522:0:22677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939400030e00/0xd90373d592f22cfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22d03 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789579315.835532:0:22677:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789579315.835535:0:22677:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff939435d8b800 from 13 10000000:01000000:2.0:1789579315.835538:0:22677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789579315.835578:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939400031c00/0xd90373d592f22d0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579315.835601:0:22677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939400031c00/0xd90373d592f22d0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579315.835612:0:22677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939400031c00/0xd90373d592f22d0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579315.835635:0:22677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277294592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789579315.835688:0:22677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579315.835736:0:22677:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408f64f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789579315.835806:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277294592 00000100:00100000:3.0:1789579315.835812:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277294592 00000100:00100000:3.0:1789579315.835868:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789579315.835878:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303442c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+23:22677:x1876509277294592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789579315.835889:0:22674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579315.835907:0:22674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939304366000/0xd90373d592f22d11 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f22d0a expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579315.835930:0:22674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939304366000/0xd90373d592f22d11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f22d0a expref: 24 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579315.835940:0:22674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939304366000/0xd90373d592f22d11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f22d0a expref: 24 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579315.835948:0:22674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939304366000, rc 0) 00000100:00100000:3.0:1789579315.836095:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303442c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+24:22677:x1876509277294592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 218us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579315.836102:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789579315.840569:0:22677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277294592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789579315.840598:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939400031c00/0xd90373d592f22d0a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22d11 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579315.840611:0:22677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939400031c00/0xd90373d592f22d0a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f22d11 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579315.840694:0:22677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277294720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789579315.840753:0:22677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579315.840825:0:22677:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408f64f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789579315.841658:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277294720 00000100:00100000:3.0:1789579315.841667:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277294720 00000100:00100000:3.0:1789579315.841721:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789579315.841730:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303440050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+24:22677:x1876509277294720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789579315.842796:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303440050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39addb08-5233-4b30-82ca-229405d26fae+24:22677:x1876509277294720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1064us (2039us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579315.842813:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789579315.842895:0:22677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277294720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789579315.842942:0:22677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277294848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789579315.842993:0:22677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579315.843026:0:22677:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408f64f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789579315.843448:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277294848 00000100:00100000:3.0:1789579315.843455:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277294848 00000100:00100000:3.0:1789579315.843493:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789579315.843499:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303441450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+24:22677:x1876509277294848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789579315.843604:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303441450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39addb08-5233-4b30-82ca-229405d26fae+24:22677:x1876509277294848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579315.843611:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789579315.843912:0:22677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39addb08-5233-4b30-82ca-229405d26fae:22677:1876509277294848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789579315.844888:0:25730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789579315.845120:0:22677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789579315.845149:0:22677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789579315.845160:0:22677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939400031c00/0xd90373d592f22d0a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22d11 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579315.845171:0:22677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939400031c00/0xd90373d592f22d0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22d11 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579315.939535:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579316.343158:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579316.343330:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261460224 00000100:00100000:3.0:1789579316.343378:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261460224 00000100:00100000:3.0:1789579316.343726:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 158 00000100:00100000:3.0:1789579316.343738:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303443450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26ca68eb-fc53-4468-a753-d660cc98bf7c+11:18087:x1876509261460224:12345-192.168.203.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789579316.343755:0:22673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579316.343832:0:22673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939304366600/0xd90373d592f22d18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec588 expref: -99 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.343861:0:22673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939304366600/0xd90373d592f22d18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec588 expref: 12 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.343873:0:22673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939304366600/0xd90373d592f22d18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec588 expref: 12 pid: 22673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.343881:0:22673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939304366600, rc 0) 00000100:00100000:3.0:1789579316.343939:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303443450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26ca68eb-fc53-4468-a753-d660cc98bf7c+12:18087:x1876509261460224:12345-192.168.203.37@tcp:101:ll_cfg_requeue.0 Request processed in 203us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579316.343946:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 158 00000100:00100000:1.0:1789579316.346334:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579316.346522:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261460352 00000100:00100000:2.0:1789579316.346532:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261460352 00000100:00100000:2.0:1789579316.346593:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 159 00000100:00100000:2.0:1789579316.346604:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303441850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26ca68eb-fc53-4468-a753-d660cc98bf7c+12:18087:x1876509261460352:12345-192.168.203.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789579316.346805:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303441850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26ca68eb-fc53-4468-a753-d660cc98bf7c+12:18087:x1876509261460352:12345-192.168.203.37@tcp:501:ll_cfg_requeue.0 Request processed in 203us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579316.346813:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 159 00000100:00100000:2.0:1789579316.351613:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579316.351861:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261460480 00000100:00100000:3.0:1789579316.351871:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261460480 00000100:00100000:3.0:1789579316.351935:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 160 00000100:00100000:3.0:1789579316.351945:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303442450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26ca68eb-fc53-4468-a753-d660cc98bf7c+12:18087:x1876509261460480:12345-192.168.203.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789579316.352085:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303442450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26ca68eb-fc53-4468-a753-d660cc98bf7c+12:18087:x1876509261460480:12345-192.168.203.37@tcp:503:ll_cfg_requeue.0 Request processed in 141us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579316.352093:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 160 00000100:00100000:1.0:1789579316.368642:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579316.368951:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261460608 00000100:00100000:3.0:1789579316.368961:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261460608 00000100:00100000:3.0:1789579316.369020:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 161 00000100:00100000:3.0:1789579316.369031:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303443850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26ca68eb-fc53-4468-a753-d660cc98bf7c+12:18087:x1876509261460608:12345-192.168.203.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789579316.369063:0:22674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579316.369082:0:22674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939304366200/0xd90373d592f22d1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec58f expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.369110:0:22674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939304366200/0xd90373d592f22d1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec58f expref: 13 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.369123:0:22674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939304366200/0xd90373d592f22d1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec58f expref: 13 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.369132:0:22674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939304366200, rc 0) 00000100:00100000:3.0:1789579316.370307:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303443850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26ca68eb-fc53-4468-a753-d660cc98bf7c+13:18087:x1876509261460608:12345-192.168.203.37@tcp:101:ll_cfg_requeue.0 Request processed in 1271us (1666us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579316.370317:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 161 00000100:00100000:1.0:1789579316.381596:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579316.381957:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261460736 00000100:00100000:2.0:1789579316.381967:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261460736 00000100:00100000:2.0:1789579316.382025:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 162 00000100:00100000:2.0:1789579316.382035:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303440450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26ca68eb-fc53-4468-a753-d660cc98bf7c+13:18087:x1876509261460736:12345-192.168.203.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789579316.382190:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303440450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26ca68eb-fc53-4468-a753-d660cc98bf7c+13:18087:x1876509261460736:12345-192.168.203.37@tcp:501:ll_cfg_requeue.0 Request processed in 154us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579316.382200:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 162 00000100:00100000:2.0:1789579316.389478:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579316.389570:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261460864 00000100:00100000:3.0:1789579316.389580:0:22674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261460864 00000100:00100000:3.0:1789579316.389632:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 163 00000100:00100000:3.0:1789579316.389640:0:22674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303442050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26ca68eb-fc53-4468-a753-d660cc98bf7c+13:18087:x1876509261460864:12345-192.168.203.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789579316.389779:0:22674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303442050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26ca68eb-fc53-4468-a753-d660cc98bf7c+13:18087:x1876509261460864:12345-192.168.203.37@tcp:503:ll_cfg_requeue.0 Request processed in 138us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579316.389786:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 163 00000100:00100000:1.0:1789579316.481505:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579316.481598:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261460992 00000100:00100000:3.0:1789579316.481609:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261460992 00000100:00080000:2.0:1789579316.481748:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789579316.481950:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 23 00000100:00100000:3.0:1789579316.481963:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a10e13f9-13f2-441e-b716-61685111baf3+6:18708:x1876509261460992:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789579316.481984:0:22682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579316.482018:0:22682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f22d26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec596 expref: -99 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.482267:0:22682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f22d2d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.482629:0:22682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f22d2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.482642:0:22682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f22d2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.482658:0:22682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22d34 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.482665:0:22682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22d34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.482671:0:22682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22d34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.482747:0:22682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367400/0xd90373d592f22d3b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.482755:0:22682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304367400/0xd90373d592f22d3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.482762:0:22682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304367400/0xd90373d592f22d3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789579316.482791:0:22682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789579316.482794:0:22682:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789579316.482832:0:22682:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939304367400/0xd90373d592f22d3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.482852:0:22682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f22d2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.482858:0:22682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f22d2d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.482864:0:22682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f22d2d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.482870:0:22682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304367200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579316.482874:0:22682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f22d2d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.482881:0:22682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f22d2d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.482894:0:22682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93940905b200) 00010000:00010000:3.0:1789579316.482897:0:22682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789579316.482902:0:22682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f22d2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.482908:0:22682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f22d2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.482920:0:22682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22d34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.482926:0:22682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22d34 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.482932:0:22682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22d34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.482944:0:22682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304366800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579316.482947:0:22682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22d34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.482953:0:22682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22d34 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.482961:0:22682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff939441952d00) 00010000:00010000:3.0:1789579316.482963:0:22682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789579316.482966:0:22682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22d34 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.482971:0:22682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22d34 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.483007:0:22682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f22d26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec596 expref: 8 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.483022:0:22682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367400/0xd90373d592f22d3b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec596 expref: 7 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.483029:0:22682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff939441952b00) 00010000:00010000:3.0:1789579316.483032:0:22682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789579316.483034:0:22682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939304367400, rc 0) 00000100:00100000:3.0:1789579316.483159:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a10e13f9-13f2-441e-b716-61685111baf3+7:18708:x1876509261460992:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 1198us (1662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579316.483167:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 23 00000100:00100000:1.0:1789579316.495195:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579316.495333:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261461120 00000100:00100000:3.0:1789579316.495381:0:22692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261461120 00000100:00100000:3.0:1789579316.495448:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 5 00000100:00100000:3.0:1789579316.495459:0:22692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a10e13f9-13f2-441e-b716-61685111baf3+7:18708:x1876509261461120:12345-192.168.203.37@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789579316.495533:0:22692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a10e13f9-13f2-441e-b716-61685111baf3+7:18708:x1876509261461120:12345-192.168.203.37@tcp:900:lhsmtool_posix.0 Request processed in 76us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579316.495541:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 5 00000100:00100000:2.0:1789579316.507402:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579316.507487:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261461376 00000100:00100000:3.0:1789579316.507498:0:22681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261461376 00000100:00100000:3.0:1789579316.507559:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 24 00000100:00100000:3.0:1789579316.507570:0:22681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a10e13f9-13f2-441e-b716-61685111baf3+7:18708:x1876509261461376:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789579316.507590:0:22681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579316.507609:0:22681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f22d42 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec59d expref: -99 pid: 22681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.507681:0:22681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22d49 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.507694:0:22681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22d49 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.507705:0:22681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22d49 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.507720:0:22681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f22d50 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.507727:0:22681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f22d50 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.507733:0:22681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f22d50 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.507855:0:22681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367600/0xd90373d592f22d57 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.507864:0:22681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304367600/0xd90373d592f22d57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.507871:0:22681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304367600/0xd90373d592f22d57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789579316.507881:0:22681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1789579316.508050:0:22681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22d49 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.508058:0:22681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22d49 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.508066:0:22681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22d49 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.508072:0:22681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304366800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579316.508076:0:22681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22d49 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.508083:0:22681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22d49 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.508095:0:22681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff939441952b00) 00010000:00010000:3.0:1789579316.508098:0:22681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789579316.508103:0:22681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22d49 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.508120:0:22681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22d49 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.508134:0:22681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f22d50 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.508140:0:22681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f22d50 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.508145:0:22681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f22d50 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.508151:0:22681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304367200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579316.508153:0:22681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f22d50 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.508158:0:22681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f22d50 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.508166:0:22681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff939441952d00) 00010000:00010000:3.0:1789579316.508168:0:22681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789579316.508171:0:22681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f22d50 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.508176:0:22681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f22d50 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.509276:0:22681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f22d42 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec59d expref: 10 pid: 22681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.509715:0:22681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367600/0xd90373d592f22d57 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec59d expref: 9 pid: 22681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.509725:0:22681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff939441952500) 00010000:00010000:3.0:1789579316.509727:0:22681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789579316.509730:0:22681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939304367600, rc 0) 00000100:00100000:3.0:1789579316.509859:0:22681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a10e13f9-13f2-441e-b716-61685111baf3+9:18708:x1876509261461376:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 2287us (2504us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1789579316.509868:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 24 00000100:00100000:1.0:1789579316.526214:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579316.526305:0:24054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261461504 00000100:00100000:3.0:1789579316.526315:0:24054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261461504 00000100:00100000:3.0:1789579316.526408:0:24054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 25 00000100:00100000:3.0:1789579316.526418:0:24054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a10e13f9-13f2-441e-b716-61685111baf3+9:18708:x1876509261461504:12345-192.168.203.37@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789579316.526515:0:24054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a10e13f9-13f2-441e-b716-61685111baf3+9:18708:x1876509261461504:12345-192.168.203.37@tcp:59:lhsmtool_posix.0 Request processed in 98us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579316.526522:0:24054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 25 00000100:00100000:1.0:1789579316.534682:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579316.534877:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261461632 00000100:00100000:3.0:1789579316.534886:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261461632 00000100:00100000:3.0:1789579316.534962:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 26 00000100:00100000:3.0:1789579316.534974:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a10e13f9-13f2-441e-b716-61685111baf3+5:18708:x1876509261461632:12345-192.168.203.37@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1789579316.535263:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1789579316.536137:0:22682:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1115us 00000100:00100000:0.0:1789579316.556305:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a10e13f9-13f2-441e-b716-61685111baf3+5:18708:x1876509261461632:12345-192.168.203.37@tcp:59:lhsmtool_posix.0 Request processed in 21323us (21620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579316.556319:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 26 00000100:00100000:0.0:1789579316.579767:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394091ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277294976:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789579316.579835:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579316.579874:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789579316.579881:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277295104:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789579316.579905:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579316.579953:0:22686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277294976 00000100:00100000:0.0:1789579316.579961:0:22686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277294976 00000100:00100000:0.0:1789579316.580014:0:22686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277295104 00000100:00100000:0.0:1789579316.580017:0:22686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277295104 00000100:00100000:0.0:1789579316.580034:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789579316.580041:0:22686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277294976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789579316.580072:0:22686:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789579316.580117:0:22686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277294976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579316.580124:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789579316.580150:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789579316.580170:0:22686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277295104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789579316.580189:0:22686:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789579316.580219:0:22686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277295104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 49us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579316.580226:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789579316.580296:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277295104:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789579316.580310:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394091ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277294976:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789579316.580937:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277295232:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789579316.580986:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579316.581119:0:24190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277295232 00000100:00100000:2.0:1789579316.581125:0:24190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277295232 00000100:00100000:2.0:1789579316.581167:0:24190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789579316.581180:0:24190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277295232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789579316.581201:0:24190:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789579316.581239:0:24190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277295232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579316.581244:0:24190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789579316.581516:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277295232:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789579316.600486:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579316.600934:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261461760 00000100:00100000:0.0:1789579316.600944:0:22681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261461760 00000100:00100000:0.0:1789579316.601001:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 27 00000100:00100000:0.0:1789579316.601009:0:22681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a10e13f9-13f2-441e-b716-61685111baf3+9:18714:x1876509261461760:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:0.0:1789579316.601028:0:22681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579316.601047:0:22681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f22d65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec5a4 expref: -99 pid: 22681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.601109:0:22681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436e00/0xd90373d592f22d6c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.601130:0:22681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436e00/0xd90373d592f22d6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.601142:0:22681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436e00/0xd90373d592f22d6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.601155:0:22681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f22d73 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.601161:0:22681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f22d73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.601176:0:22681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f22d73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.601215:0:22681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436e00/0xd90373d592f22d6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.601221:0:22681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436e00/0xd90373d592f22d6c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.601227:0:22681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303436e00/0xd90373d592f22d6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.601233:0:22681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789579316.601238:0:22681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436e00/0xd90373d592f22d6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.601244:0:22681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436e00/0xd90373d592f22d6c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.601256:0:22681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93940905b200) 00010000:00010000:0.0:1789579316.601259:0:22681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789579316.601263:0:22681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303436e00/0xd90373d592f22d6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.601270:0:22681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436e00/0xd90373d592f22d6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.601283:0:22681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f22d73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.601289:0:22681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f22d73 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.601301:0:22681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f22d73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.601305:0:22681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789579316.601308:0:22681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f22d73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.601313:0:22681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f22d73 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.601320:0:22681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff939302356700) 00010000:00010000:0.0:1789579316.601322:0:22681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789579316.601324:0:22681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f22d73 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.601330:0:22681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f22d73 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.601403:0:22681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f22d65 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5a4 expref: 10 pid: 22681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.601413:0:22681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93940905b200) 00010000:00010000:0.0:1789579316.601415:0:22681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789579316.601418:0:22681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f22d65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5a4 expref: 10 pid: 22681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.601428:0:22681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303436200, rc 0) 00000100:00100000:0.0:1789579316.601488:0:22681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a10e13f9-13f2-441e-b716-61685111baf3+9:18714:x1876509261461760:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 479us (1010us total) trans 0 rc 301/301 00000100:00100000:0.0:1789579316.601503:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 27 00000100:00100000:1.0:1789579316.620674:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579316.621111:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261461888 00000100:00100000:2.0:1789579316.621122:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261461888 00000100:00100000:2.0:1789579316.621228:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 0 00000100:00100000:2.0:1789579316.621240:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a10e13f9-13f2-441e-b716-61685111baf3+9:18714:x1876509261461888:12345-192.168.203.37@tcp:700:lfs.0 00000100:00100000:2.0:1789579316.621346:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a10e13f9-13f2-441e-b716-61685111baf3+9:18714:x1876509261461888:12345-192.168.203.37@tcp:700:lfs.0 Request processed in 108us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579316.621409:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 0 00000100:00100000:1.0:1789579316.626341:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579316.626438:0:24487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261462144 00000100:00100000:0.0:1789579316.626450:0:24487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261462144 00000100:00100000:0.0:1789579316.626509:0:24487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 28 00000100:00100000:0.0:1789579316.626520:0:24487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a10e13f9-13f2-441e-b716-61685111baf3+9:18714:x1876509261462144:12345-192.168.203.37@tcp:36:lfs.0 00010000:00010000:0.0:1789579316.626575:0:24487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789579316.626601:0:24487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db200/0xd90373d592f22c93 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec511 expref: 9 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.626620:0:24487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93940905b200) 00010000:00010000:0.0:1789579316.626625:0:24487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789579316.626682:0:24487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f22d7a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.626696:0:24487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f22cd2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec581 expref: 5 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.626705:0:24487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f22d7a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.626746:0:24487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f22cd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec581 expref: 5 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.626761:0:24487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f22cd2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec581 expref: 5 pid: 22682 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579316.626775:0:24487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:24487:1876509277295360:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789579316.626874:0:24487:0:(client.c:2716:ptlrpc_set_wait()) set ffff93930201e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789579316.633597:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579316.634107:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261462272 00000100:00100000:2.0:1789579316.634117:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261462272 00000100:00100000:3.0:1789579316.634376:0:24487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:24487:1876509277295360:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789579316.634429:0:24487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f22d7a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579316.634550:0:22666:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f22cd2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec581 expref: 6 pid: 22682 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579316.634600:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 15 00000100:00100000:2.0:1789579316.634610:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7263f938-3275-4200-b80b-4135ea8c4f2d+6:2395:x1876509261462272:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789579316.634624:0:22666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579316.634630:0:22666:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f22cd2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec581 expref: 6 pid: 22682 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579316.634648:0:22666:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f22cd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec581 expref: 6 pid: 22682 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789579316.634666:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789579316.634672:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f22cd2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec581 expref: 6 pid: 22682 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579316.634690:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93940905b200) 00010000:00010000:2.0:1789579316.634694:0:22666:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f22d7a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579316.634702:0:22666:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f22d7a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579316.634708:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f22d7a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579316.634793:0:22666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789579316.635000:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7263f938-3275-4200-b80b-4135ea8c4f2d+5:2395:x1876509261462272:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 391us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579316.635007:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 15 00010000:00010000:3.0:1789579316.636307:0:24487:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f22d7a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.636318:0:24487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f22d7a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.636345:0:24487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f22d81 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.636550:0:24487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f22d81 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.636561:0:24487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f22d81 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.639817:0:24487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f22d88 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.639839:0:24487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f22d88 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.639850:0:24487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f22d88 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789579316.639867:0:24487:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000049a8d279 reply state 0000000088b5be93 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f22d88 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.639877:0:24487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f22d88 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.639891:0:24487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff939441952e00) 00010000:00010000:3.0:1789579316.639894:0:24487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789579316.639898:0:24487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789579316.639903:0:24487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789579316.639911:0:24487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f22d7a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.639928:0:24487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f22d7a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.639935:0:24487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f22d7a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.639942:0:24487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579316.639945:0:24487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f22d7a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.639953:0:24487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f22d7a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.639962:0:24487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93940905b200) 00010000:00010000:3.0:1789579316.639965:0:24487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789579316.639968:0:24487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f22d7a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.639975:0:24487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f22d7a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789579316.639994:0:24487:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000049a8d279 reply state 0000000088b5be93 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f22d81 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.640012:0:24487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f22d81 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.640018:0:24487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff939441952d00) 00010000:00010000:3.0:1789579316.640020:0:24487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789579316.640022:0:24487:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789579316.640111:0:24487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a10e13f9-13f2-441e-b716-61685111baf3+10:18714:x1876509261462144:12345-192.168.203.37@tcp:36:lfs.0 Request processed in 13590us (13776us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1789579316.640119:0:24487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 28 00000100:00100000:0.0:1789579316.752431:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579316.752590:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261462400 00000100:00100000:2.0:1789579316.752601:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261462400 00000100:00100000:2.0:1789579316.752663:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 29 00000100:00100000:2.0:1789579316.752672:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a10e13f9-13f2-441e-b716-61685111baf3+10:18722:x1876509261462400:12345-192.168.203.37@tcp:101:lctl.0 00010000:00010000:2.0:1789579316.752696:0:22682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579316.752721:0:22682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939400031e00/0xd90373d592f22d8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec5ab expref: -99 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579316.752803:0:22682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a000/0xd90373d592f22d96 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579316.752815:0:22682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a000/0xd90373d592f22d96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579316.752826:0:22682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a000/0xd90373d592f22d96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789579316.752865:0:22682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789579316.752869:0:22682:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789579316.752907:0:22682:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a000/0xd90373d592f22d96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579316.752931:0:22682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939400031e00/0xd90373d592f22d8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5ab expref: 12 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579316.752950:0:22682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a000/0xd90373d592f22d96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5ab expref: 11 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579316.752958:0:22682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93942ef59b00) 00010000:00010000:2.0:1789579316.752960:0:22682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789579316.752964:0:22682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939435d7a000, rc 0) 00000100:00100000:3.0:1789579316.753076:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a10e13f9-13f2-441e-b716-61685111baf3+11:18722:x1876509261462400:12345-192.168.203.37@tcp:101:lctl.0 Request processed in 402us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579316.753085:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 29 00000100:00100000:2.0:1789579316.792850:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579316.792952:0:24054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261462528 00000100:00100000:3.0:1789579316.792963:0:24054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261462528 00000100:00100000:3.0:1789579316.793022:0:24054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 30 00000100:00100000:3.0:1789579316.793033:0:24054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7263f938-3275-4200-b80b-4135ea8c4f2d+5:18723:x1876509261462528:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:3.0:1789579316.793063:0:24054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579316.793086:0:24054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22d9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec5b2 expref: -99 pid: 24054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.793150:0:24054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367e00/0xd90373d592f22da4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.793164:0:24054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304367e00/0xd90373d592f22da4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.793177:0:24054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304367e00/0xd90373d592f22da4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789579316.793235:0:24054:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789579316.793238:0:24054:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789579316.793257:0:24054:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939304367e00/0xd90373d592f22da4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.793281:0:24054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22d9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5b2 expref: 7 pid: 24054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.793298:0:24054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367e00/0xd90373d592f22da4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5b2 expref: 6 pid: 24054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.793306:0:24054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93942ef59b00) 00010000:00010000:3.0:1789579316.793309:0:24054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789579316.793312:0:24054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939304367e00, rc 0) 00000100:00100000:3.0:1789579316.793428:0:24054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7263f938-3275-4200-b80b-4135ea8c4f2d+6:18723:x1876509261462528:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 396us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579316.793436:0:24054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 30 00000100:00100000:1.0:1789579316.797727:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579316.797821:0:24487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261462656 00000100:00100000:3.0:1789579316.797994:0:24487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261462656 00000100:00100000:3.0:1789579316.798063:0:24487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 31 00000100:00100000:3.0:1789579316.798073:0:24487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7263f938-3275-4200-b80b-4135ea8c4f2d+6:18723:x1876509261462656:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:3.0:1789579316.798092:0:24487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579316.798112:0:24487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f22dab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec5b9 expref: -99 pid: 24487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.798171:0:24487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f22db2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.798202:0:24487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f22db2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.798213:0:24487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f22db2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.798574:0:24487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f22db9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.798584:0:24487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f22db9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.798593:0:24487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f22db9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.798676:0:24487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22dc0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.798684:0:24487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22dc0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.798691:0:24487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22dc0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789579316.798726:0:24487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789579316.798730:0:24487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789579316.798748:0:24487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22dc0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.798760:0:24487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f22db2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.798777:0:24487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f22db2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.798783:0:24487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f22db2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.798790:0:24487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304366e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579316.798794:0:24487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f22db2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.798801:0:24487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f22db2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.798813:0:24487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93942ef59b00) 00010000:00010000:3.0:1789579316.798816:0:24487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789579316.798820:0:24487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f22db2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.798841:0:24487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f22db2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.798855:0:24487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f22db9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.798861:0:24487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f22db9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.798865:0:24487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f22db9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.798870:0:24487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304366c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579316.798879:0:24487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f22db9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.798885:0:24487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f22db9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.798893:0:24487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff939441952d00) 00010000:00010000:3.0:1789579316.798895:0:24487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789579316.798898:0:24487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f22db9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.798903:0:24487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f22db9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.798931:0:24487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f22dab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5b9 expref: 8 pid: 24487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.798943:0:24487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22dc0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5b9 expref: 7 pid: 24487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.798950:0:24487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff939441952e00) 00010000:00010000:3.0:1789579316.798952:0:24487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789579316.798954:0:24487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939304366800, rc 0) 00000100:00100000:3.0:1789579316.799017:0:24487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7263f938-3275-4200-b80b-4135ea8c4f2d+7:18723:x1876509261462656:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 945us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579316.799024:0:24487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 31 00000100:00100000:0.0:1789579316.803641:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579316.803733:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261462784 00000100:00100000:3.0:1789579316.803743:0:22692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261462784 00000100:00100000:3.0:1789579316.803822:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 6 00000100:00100000:3.0:1789579316.803832:0:22692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7263f938-3275-4200-b80b-4135ea8c4f2d+5:18723:x1876509261462784:12345-192.168.203.37@tcp:900:lfs.0 00000100:00100000:3.0:1789579316.803927:0:22692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7263f938-3275-4200-b80b-4135ea8c4f2d+5:18723:x1876509261462784:12345-192.168.203.37@tcp:900:lfs.0 Request processed in 96us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579316.803935:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 6 00000100:00080000:2.0:1789579316.804032:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789579316.809596:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579316.809681:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261463040 00000100:00100000:3.0:1789579316.809691:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261463040 00000100:00100000:3.0:1789579316.809753:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 32 00000100:00100000:3.0:1789579316.809762:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7263f938-3275-4200-b80b-4135ea8c4f2d+7:18723:x1876509261463040:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:3.0:1789579316.809782:0:22682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579316.809801:0:22682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f22dc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec5c0 expref: -99 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789579316.809890:0:22682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789579316.810108:0:22682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f22dc7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5c0 expref: 9 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.810121:0:22682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93942ef59b00) 00010000:00010000:3.0:1789579316.810124:0:22682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789579316.810129:0:22682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f22dc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5c0 expref: 9 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.810141:0:22682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939304366400, rc 0) 00000100:00100000:3.0:1789579316.810200:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7263f938-3275-4200-b80b-4135ea8c4f2d+8:18723:x1876509261463040:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 439us (613us total) trans 12884901891 rc 301/301 00000100:00100000:3.0:1789579316.810208:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 32 00000100:00100000:1.0:1789579316.815830:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579316.815906:0:24054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261463296 00000100:00100000:3.0:1789579316.815930:0:24054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261463296 00000100:00100000:3.0:1789579316.815989:0:24054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 33 00000100:00100000:3.0:1789579316.816016:0:24054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7263f938-3275-4200-b80b-4135ea8c4f2d+8:18723:x1876509261463296:12345-192.168.203.37@tcp:36:lfs.0 00010000:00010000:3.0:1789579316.816071:0:24054:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789579316.816097:0:24054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22dc0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5b9 expref: 8 pid: 24487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.816114:0:24054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff939441952e00) 00010000:00010000:3.0:1789579316.816118:0:24054:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789579316.816137:0:24054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f22dd5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.816149:0:24054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f22dd5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.816157:0:24054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f22dd5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789579316.816338:0:24054:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000de29869b reply state 00000000065e5828 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f22dd5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.816403:0:24054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f22dd5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.816410:0:24054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff939441952e00) 00010000:00010000:3.0:1789579316.816415:0:24054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1789579316.816417:0:24054:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789579316.816426:0:24054:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789579316.816573:0:24054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7263f938-3275-4200-b80b-4135ea8c4f2d+9:18723:x1876509261463296:12345-192.168.203.37@tcp:36:lfs.0 Request processed in 559us (748us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1789579316.816590:0:24054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 33 00000100:00100000:0.0:1789579316.821464:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579316.821552:0:22684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261463552 00000100:00100000:2.0:1789579316.821563:0:22684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261463552 00000100:00100000:2.0:1789579316.821614:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 2 00000100:00100000:2.0:1789579316.821623:0:22684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7263f938-3275-4200-b80b-4135ea8c4f2d+9:18723:x1876509261463552:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:2.0:1789579316.821818:0:22684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7263f938-3275-4200-b80b-4135ea8c4f2d+10:18723:x1876509261463552:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 195us (363us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1789579316.821838:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 2 00000100:00100000:3.0:1789579316.824725:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579316.824819:0:24487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261463808 00000100:00100000:0.0:1789579316.824834:0:24487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261463808 00000100:00100000:0.0:1789579316.824885:0:24487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 34 00000100:00100000:0.0:1789579316.824895:0:24487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7263f938-3275-4200-b80b-4135ea8c4f2d+10:18723:x1876509261463808:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:0.0:1789579316.824927:0:24487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579316.824948:0:24487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f22ddc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec5c7 expref: -99 pid: 24487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.825012:0:24487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f22de3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.825025:0:24487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f22de3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.825037:0:24487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f22de3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.825047:0:24487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436000/0xd90373d592f22dea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.825054:0:24487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436000/0xd90373d592f22dea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.825059:0:24487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436000/0xd90373d592f22dea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789579316.825176:0:24487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789579316.825242:0:24487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f22de3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.825250:0:24487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f22de3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.825257:0:24487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f22de3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.825263:0:24487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789579316.825267:0:24487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f22de3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.825275:0:24487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f22de3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.825286:0:24487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93942ef59b00) 00010000:00010000:0.0:1789579316.825289:0:24487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789579316.825294:0:24487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f22de3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.825300:0:24487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f22de3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.825315:0:24487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436000/0xd90373d592f22dea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.825322:0:24487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436000/0xd90373d592f22dea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.825337:0:24487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303436000/0xd90373d592f22dea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.825342:0:24487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789579316.825345:0:24487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436000/0xd90373d592f22dea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.825408:0:24487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436000/0xd90373d592f22dea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.825417:0:24487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff939441952d00) 00010000:00010000:0.0:1789579316.825419:0:24487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789579316.825422:0:24487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303436000/0xd90373d592f22dea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.825428:0:24487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436000/0xd90373d592f22dea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.825461:0:24487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f22ddc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5c7 expref: 12 pid: 24487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.825471:0:24487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93942ef59b00) 00010000:00010000:0.0:1789579316.825474:0:24487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789579316.825478:0:24487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f22ddc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5c7 expref: 12 pid: 24487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.825487:0:24487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303436400, rc 0) 00000100:00100000:0.0:1789579316.825546:0:24487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7263f938-3275-4200-b80b-4135ea8c4f2d+11:18723:x1876509261463808:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 652us (828us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1789579316.825562:0:24487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 34 00000100:00100000:1.0:1789579316.835105:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579316.835206:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261463936 00000100:00100000:2.0:1789579316.835215:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261463936 00000100:00100000:2.0:1789579316.835271:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 35 00000100:00100000:2.0:1789579316.835282:0:22680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7263f938-3275-4200-b80b-4135ea8c4f2d+11:18723:x1876509261463936:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789579316.835305:0:22680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579316.835324:0:22680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7b000/0xd90373d592f22df8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec5ce expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579316.835457:0:22680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f22dff lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579316.835472:0:22680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f22dff lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579316.835485:0:22680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f22dff lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789579316.835510:0:22680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789579316.835513:0:22680:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789579316.835543:0:22680:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f22dff lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579316.835571:0:22680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7b000/0xd90373d592f22df8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5ce expref: 13 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579316.835590:0:22680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f22dff lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5ce expref: 12 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579316.835598:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff939441952e00) 00010000:00010000:2.0:1789579316.835601:0:22680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789579316.835605:0:22680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939435d7aa00, rc 0) 00000100:00100000:2.0:1789579316.835748:0:22680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7263f938-3275-4200-b80b-4135ea8c4f2d+12:18723:x1876509261463936:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 467us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579316.835754:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 35 00000100:00100000:2.0:1789579316.850059:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579316.851978:0:22684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261464064 00000100:00100000:0.0:1789579316.851991:0:22684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261464064 00000100:00100000:0.0:1789579316.852097:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 3 00000100:00100000:0.0:1789579316.852108:0:22684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7263f938-3275-4200-b80b-4135ea8c4f2d+12:18723:x1876509261464064:12345-192.168.203.37@tcp:37:lfs.0 00000100:00100000:0.0:1789579316.857566:0:22684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7263f938-3275-4200-b80b-4135ea8c4f2d+12:18723:x1876509261464064:12345-192.168.203.37@tcp:37:lfs.0 Request processed in 5450us (7505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579316.857579:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 3 00000100:00100000:1.0:1789579316.861702:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579316.861949:0:22683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261464320 00000100:00100000:2.0:1789579316.861959:0:22683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261464320 00000100:00100000:2.0:1789579316.862027:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 4 00000100:00100000:2.0:1789579316.862038:0:22683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942f025050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7263f938-3275-4200-b80b-4135ea8c4f2d+12:18723:x1876509261464320:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:2.0:1789579316.862269:0:22683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942f025050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7263f938-3275-4200-b80b-4135ea8c4f2d+13:18723:x1876509261464320:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 224us (567us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1789579316.862276:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 4 00000100:00100000:2.0:1789579316.938298:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579316.938621:0:24054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261464448 00000100:00100000:1.0:1789579316.938632:0:24054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261464448 00000100:00100000:1.0:1789579316.938699:0:24054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 36 00000100:00100000:1.0:1789579316.938709:0:24054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a10e13f9-13f2-441e-b716-61685111baf3+11:18729:x1876509261464448:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:1.0:1789579316.938728:0:24054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579316.938747:0:24054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394041dac00/0xd90373d592f22e06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec5d5 expref: -99 pid: 24054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579316.938813:0:24054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db400/0xd90373d592f22e0d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579316.938839:0:24054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db400/0xd90373d592f22e0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579316.938856:0:24054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db400/0xd90373d592f22e0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579316.938870:0:24054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394041da200/0xd90373d592f22e14 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579316.939005:0:24054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394041da200/0xd90373d592f22e14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579316.939017:0:24054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394041da200/0xd90373d592f22e14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579316.939558:0:24054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394041dae00/0xd90373d592f22e1b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579316.939566:0:24054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394041dae00/0xd90373d592f22e1b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579316.939571:0:24054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394041dae00/0xd90373d592f22e1b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789579316.939600:0:24054:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789579316.939603:0:24054:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789579316.939639:0:24054:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9394041dae00/0xd90373d592f22e1b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579316.939652:0:24054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db400/0xd90373d592f22e0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579316.939664:0:24054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db400/0xd90373d592f22e0d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579316.939671:0:24054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db400/0xd90373d592f22e0d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579316.939677:0:24054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394041db400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579316.939680:0:24054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db400/0xd90373d592f22e0d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579316.939688:0:24054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db400/0xd90373d592f22e0d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579316.939700:0:24054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93942ef59b00) 00010000:00010000:1.0:1789579316.939703:0:24054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579316.939708:0:24054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db400/0xd90373d592f22e0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579316.939714:0:24054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db400/0xd90373d592f22e0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579316.939728:0:24054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394041da200/0xd90373d592f22e14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579316.939735:0:24054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394041da200/0xd90373d592f22e14 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579316.939739:0:24054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394041da200/0xd90373d592f22e14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579316.939744:0:24054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394041da200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579316.939753:0:24054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394041da200/0xd90373d592f22e14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579316.939759:0:24054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394041da200/0xd90373d592f22e14 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579316.939767:0:24054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff939441952d00) 00010000:00010000:1.0:1789579316.939769:0:24054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579316.939772:0:24054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394041da200/0xd90373d592f22e14 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579316.939778:0:24054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394041da200/0xd90373d592f22e14 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579316.939805:0:24054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394041dac00/0xd90373d592f22e06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5d5 expref: 13 pid: 24054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579316.939819:0:24054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394041dae00/0xd90373d592f22e1b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5d5 expref: 12 pid: 24054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579316.939859:0:24054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff939441952e00) 00010000:00010000:1.0:1789579316.939861:0:24054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789579316.939864:0:24054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394041dae00, rc 0) 00000100:00100000:1.0:1789579316.940040:0:24054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a10e13f9-13f2-441e-b716-61685111baf3+12:18729:x1876509261464448:12345-192.168.203.37@tcp:101:bash.0 Request processed in 1331us (1751us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579316.940056:0:24054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 36 00000100:00100000:3.0:1789579316.944606:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579316.944784:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261464576 00000100:00100000:2.0:1789579316.944863:0:22692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261464576 00000100:00100000:2.0:1789579316.945252:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:2.0:1789579316.945510:0:22692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a10e13f9-13f2-441e-b716-61685111baf3+5:18729:x1876509261464576:12345-192.168.203.37@tcp:900:bash.0 00000100:00100000:2.0:1789579316.945638:0:22692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a10e13f9-13f2-441e-b716-61685111baf3+5:18729:x1876509261464576:12345-192.168.203.37@tcp:900:bash.0 Request processed in 376us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579316.945646:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:3.0:1789579316.953042:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579316.953182:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261464832 00000100:00100000:0.0:1789579316.953193:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261464832 00000100:00100000:0.0:1789579316.953253:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 37 00000100:00100000:0.0:1789579316.953273:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a10e13f9-13f2-441e-b716-61685111baf3+12:18729:x1876509261464832:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:0.0:1789579316.953294:0:22682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579316.953313:0:22682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436000/0xd90373d592f22e22 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec5dc expref: -99 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.953461:0:22682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f22e29 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.953477:0:22682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f22dff lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5ce expref: 12 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.953485:0:22682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f22e29 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.953518:0:22682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f22dff lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5ce expref: 12 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579316.953549:0:22682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f22dff lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5ce expref: 12 pid: 22680 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579316.953564:0:22682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22682:1876509277295488:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789579316.953645:0:22682:0:(client.c:2716:ptlrpc_set_wait()) set ffff93930201e900 going to sleep for 11 seconds 00000100:00100000:0.0:1789579316.958566:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579316.958656:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261464960 00000100:00100000:2.0:1789579316.958665:0:22665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261464960 00010000:00010000:2.0:1789579316.958711:0:22665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f22dff lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5ce expref: 13 pid: 22680 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579316.958750:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:2.0:1789579316.958760:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7263f938-3275-4200-b80b-4135ea8c4f2d+13:2394:x1876509261464960:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789579316.958774:0:22665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579316.958780:0:22665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f22dff lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5ce expref: 13 pid: 22680 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579316.958793:0:22665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f22dff lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5ce expref: 13 pid: 22680 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579316.958814:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff939441952e00) 00010000:00010000:2.0:1789579316.958820:0:22665:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f22e29 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579316.958841:0:22665:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f22e29 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579316.958849:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f22e29 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579316.958868:0:22665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789579316.958958:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7263f938-3275-4200-b80b-4135ea8c4f2d+13:2394:x1876509261464960:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 199us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579316.958965:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 16 00010000:00010000:3.0:1789579316.960075:0:22682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f22dff lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5ce expref: 12 pid: 22680 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579316.960107:0:22682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22682:1876509277295488:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789579316.960132:0:22682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f22e29 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.960141:0:22682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f22e29 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.960147:0:22682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f22e29 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.960189:0:22682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22e30 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.960200:0:22682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22e30 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.960208:0:22682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22e30 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.961330:0:22682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f22e37 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.961345:0:22682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f22e37 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.961373:0:22682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f22e37 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789579316.961394:0:22682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789579316.961421:0:22682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f22e29 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.961433:0:22682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f22e29 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.961440:0:22682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f22e29 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.961445:0:22682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579316.961450:0:22682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f22e29 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.961457:0:22682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f22e29 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.961469:0:22682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff939441952e00) 00010000:00010000:3.0:1789579316.961472:0:22682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789579316.961477:0:22682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f22e29 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.961482:0:22682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f22e29 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789579316.961497:0:22682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ffc98974 reply state 000000002b69b79b transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22e30 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.961506:0:22682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22e30 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.961512:0:22682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff939441952200) 00010000:00010000:3.0:1789579316.961515:0:22682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789579316.961517:0:22682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789579316.961553:0:22682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436000/0xd90373d592f22e22 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5dc expref: 15 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.961575:0:22682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f22e37 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5dc expref: 14 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579316.961582:0:22682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff939441952000) 00010000:00010000:3.0:1789579316.961585:0:22682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789579316.961587:0:22682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939304366c00, rc 0) 00000100:00100000:3.0:1789579316.961655:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a10e13f9-13f2-441e-b716-61685111baf3+15:18729:x1876509261464832:12345-192.168.203.37@tcp:101:bash.0 Request processed in 8393us (8623us total) trans 12884901896 rc 0/0 00000100:00100000:3.0:1789579316.961663:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 37 00010000:00010000:2.0:1789579316.964463:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579316.982486:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579316.982581:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261465088 00000100:00100000:2.0:1789579316.982592:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261465088 00000100:00100000:2.0:1789579316.982650:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 38 00000100:00100000:2.0:1789579316.982660:0:22680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a10e13f9-13f2-441e-b716-61685111baf3+15:18729:x1876509261465088:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:2.0:1789579316.982693:0:22680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579316.982714:0:22680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a800/0xd90373d592f22e45 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec5e3 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579316.982779:0:22680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f22e4c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579316.982792:0:22680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f22e4c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579316.982801:0:22680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f22e4c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789579316.982845:0:22680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789579316.982849:0:22680:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789579316.983042:0:22680:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f22e4c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579316.983055:0:22680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f22e4c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579316.983082:0:22680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a800/0xd90373d592f22e45 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5e3 expref: 17 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579316.983197:0:22680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f22e4c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5e3 expref: 16 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579316.983207:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff939441952000) 00010000:00010000:2.0:1789579316.983210:0:22680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789579316.983214:0:22680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939435d7aa00, rc 0) 00000100:00100000:2.0:1789579316.983416:0:22680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a10e13f9-13f2-441e-b716-61685111baf3+16:18729:x1876509261465088:12345-192.168.203.37@tcp:101:bash.0 Request processed in 757us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579316.983423:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 38 00000100:00100000:2.0:1789579316.993138:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579316.993332:0:22683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261465344 00000100:00100000:0.0:1789579316.993342:0:22683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261465344 00000100:00100000:0.0:1789579316.993478:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 5 00000100:00100000:0.0:1789579316.993489:0:22683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a10e13f9-13f2-441e-b716-61685111baf3+16:18729:x1876509261465344:12345-192.168.203.37@tcp:35:bash.0 00000100:00100000:0.0:1789579316.993775:0:22683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a10e13f9-13f2-441e-b716-61685111baf3+17:18729:x1876509261465344:12345-192.168.203.37@tcp:35:bash.0 Request processed in 286us (645us total) trans 12884901897 rc 0/0 00000100:00100000:0.0:1789579316.993782:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 5 00000100:00100000:0.0:1789579317.091830:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394091fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277295616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789579317.091920:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579317.092184:0:25479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277295616 00000100:00100000:3.0:1789579317.092192:0:25479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277295616 00000100:00100000:3.0:1789579317.092257:0:25479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789579317.092267:0:25479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277295616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789579317.092293:0:25479:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789579317.092337:0:25479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277295616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579317.092345:0:25479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789579317.092836:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394091fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277295744:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789579317.092886:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579317.093122:0:24191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277295744 00000100:00100000:3.0:1789579317.093128:0:24191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277295744 00000100:00100000:3.0:1789579317.093164:0:24191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789579317.093171:0:24191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277295744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789579317.093184:0:24191:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789579317.093214:0:24191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277295744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579317.093220:0:24191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789579317.093341:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930486d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277295872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789579317.093398:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579317.093439:0:24190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277295872 00000100:00100000:1.0:1789579317.093449:0:24190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277295872 00000100:00100000:1.0:1789579317.093475:0:24190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789579317.093482:0:24190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277295872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789579317.093492:0:24190:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789579317.093522:0:24190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277295872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579317.093528:0:24190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789579317.093569:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930486d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277295872:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789579317.093760:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789579317.093765:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789579317.093793:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394091fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277295616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789579317.094108:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394091fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277295744:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789579317.101184:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579317.101286:0:24054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261465600 00000100:00100000:2.0:1789579317.101296:0:24054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261465600 00000100:00100000:2.0:1789579317.101392:0:24054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 39 00000100:00100000:2.0:1789579317.101402:0:24054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a10e13f9-13f2-441e-b716-61685111baf3+17:18739:x1876509261465600:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789579317.101427:0:24054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579317.101447:0:24054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a800/0xd90373d592f22e53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec5ea expref: -99 pid: 24054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789579317.101543:0:24054:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789579317.101640:0:24054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a800/0xd90373d592f22e53 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5ea expref: 19 pid: 24054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579317.101833:0:24054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93942ef59b00) 00010000:00010000:2.0:1789579317.101836:0:24054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789579317.101842:0:24054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a800/0xd90373d592f22e53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5ea expref: 19 pid: 24054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579317.101858:0:24054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939435d7a800, rc 0) 00000100:00100000:2.0:1789579317.102166:0:24054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a10e13f9-13f2-441e-b716-61685111baf3+18:18739:x1876509261465600:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 765us (991us total) trans 12884901898 rc 301/301 00000100:00100000:2.0:1789579317.102174:0:24054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 39 00000100:00100000:1.0:1789579317.112460:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579317.112587:0:22684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261465856 00000100:00100000:2.0:1789579317.112597:0:22684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261465856 00000100:00100000:2.0:1789579317.112651:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 6 00000100:00100000:2.0:1789579317.112661:0:22684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a10e13f9-13f2-441e-b716-61685111baf3+18:18739:x1876509261465856:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:2.0:1789579317.113193:0:22684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a10e13f9-13f2-441e-b716-61685111baf3+19:18739:x1876509261465856:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 532us (740us total) trans 12884901899 rc 0/0 00000100:00100000:2.0:1789579317.113202:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 6 00000100:00100000:2.0:1789579317.181779:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579317.182204:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261466112 00000100:00100000:3.0:1789579317.182217:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261466112 00000100:00100000:3.0:1789579317.182295:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 40 00000100:00100000:3.0:1789579317.182307:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a10e13f9-13f2-441e-b716-61685111baf3+19:18742:x1876509261466112:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:3.0:1789579317.182342:0:22682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579317.182423:0:22682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f22e61 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec5f1 expref: -99 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579317.182574:0:22682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f22e68 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579317.182593:0:22682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f22e68 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579317.182613:0:22682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f22e68 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789579317.182626:0:22682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789579317.186636:0:22682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f22e61 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5f1 expref: 22 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579317.186675:0:22682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f22e68 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5f1 expref: 21 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579317.186686:0:22682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff939441952000) 00010000:00010000:3.0:1789579317.186689:0:22682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789579317.186693:0:22682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939304367000, rc 0) 00000100:00100000:3.0:1789579317.186887:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a10e13f9-13f2-441e-b716-61685111baf3+21:18742:x1876509261466112:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 4581us (5119us total) trans 12884901900 rc 0/0 00000100:00100000:3.0:1789579317.186930:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 40 00000100:00100000:0.0:1789579317.204116:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579317.204264:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579317.204390:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261466368 00000100:00100000:1.0:1789579317.204404:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261466368 00000100:00100000:1.0:1789579317.204481:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 41 00000100:00100000:1.0:1789579317.204494:0:22680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a10e13f9-13f2-441e-b716-61685111baf3+21:18742:x1876509261466368:12345-192.168.203.37@tcp:54:lfs.0 00010000:00010000:1.0:1789579317.204582:0:22680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22e76 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579317.204604:0:22680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22e76 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579317.204618:0:22680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22e76 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579317.204663:0:22680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22e76 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579317.204670:0:22680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22e76 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579317.204677:0:22680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22e76 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579317.204696:0:22680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394041db800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579317.204702:0:22680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22e76 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579317.204710:0:22680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22e76 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579317.204725:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff939441952000) 00010000:00010000:1.0:1789579317.204729:0:22680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789579317.204735:0:22680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22e76 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579317.204741:0:22680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22e76 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579317.204837:0:22680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a10e13f9-13f2-441e-b716-61685111baf3+21:18742:x1876509261466368:12345-192.168.203.37@tcp:54:lfs.0 Request processed in 345us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579317.204845:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 41 00000100:00100000:1.0:1789579317.209508:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579317.209623:0:22684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261466624 00000100:00100000:0.0:1789579317.209637:0:22684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261466624 00000100:00100000:0.0:1789579317.209712:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:0.0:1789579317.209726:0:22684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a10e13f9-13f2-441e-b716-61685111baf3+21:18742:x1876509261466624:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:2.0:1789579317.209865:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261466240 00000100:00100000:2.0:1789579317.209873:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261466240 00000100:00100000:2.0:1789579317.209919:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 0 00000100:00100000:2.0:1789579317.209928:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a10e13f9-13f2-441e-b716-61685111baf3+23:2395:x1876509261466240:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789579317.209942:0:22666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579317.209973:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f22e68 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5f1 expref: 23 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579317.210009:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff939441952000) 00010000:00010000:2.0:1789579317.210016:0:22666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789579317.210045:0:22684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a10e13f9-13f2-441e-b716-61685111baf3+22:18742:x1876509261466624:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 321us (550us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1789579317.210052:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a10e13f9-13f2-441e-b716-61685111baf3+22:2395:x1876509261466240:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 123us (5949us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579317.210059:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:2.0:1789579317.210064:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 0 00000040:00080000:2.0:1789579317.285640:0:22718:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789579317.476105:0:23440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789579317.573601:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579317.573735:0:24054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261466880 00000100:00100000:2.0:1789579317.573749:0:24054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261466880 00000100:00100000:2.0:1789579317.573846:0:24054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 42 00000100:00100000:2.0:1789579317.573858:0:24054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a10e13f9-13f2-441e-b716-61685111baf3+21:18773:x1876509261466880:12345-192.168.203.37@tcp:101:cat.0 00010000:00010000:2.0:1789579317.573891:0:24054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579317.573930:0:24054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a800/0xd90373d592f22e7d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec5f8 expref: -99 pid: 24054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579317.574288:0:24054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7ba00/0xd90373d592f22e84 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579317.574307:0:24054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7ba00/0xd90373d592f22e84 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579317.574321:0:24054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7ba00/0xd90373d592f22e84 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789579317.574334:0:24054:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789579317.574551:0:24054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a800/0xd90373d592f22e7d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5f8 expref: 24 pid: 24054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579317.574595:0:24054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7ba00/0xd90373d592f22e84 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5f8 expref: 23 pid: 24054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579317.574604:0:24054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff939441952000) 00010000:00010000:2.0:1789579317.574608:0:24054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789579317.574612:0:24054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939435d7ba00, rc 0) 00000100:00100000:2.0:1789579317.575979:0:24054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a10e13f9-13f2-441e-b716-61685111baf3+23:18773:x1876509261466880:12345-192.168.203.37@tcp:101:cat.0 Request processed in 2110us (2379us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1789579317.575995:0:24054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 42 00000100:00100000:0.0:1789579317.587561:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579317.587618:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579317.587710:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261467008 00000100:00100000:3.0:1789579317.587723:0:22667:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261467008 00000100:00100000:3.0:1789579317.587816:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 1 00000100:00100000:3.0:1789579317.587829:0:22667:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a10e13f9-13f2-441e-b716-61685111baf3+23:2395:x1876509261467008:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789579317.587860:0:22667:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789579317.587895:0:22667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7ba00/0xd90373d592f22e84 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5f8 expref: 23 pid: 24054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579317.587940:0:22667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff939441952000) 00010000:00010000:3.0:1789579317.587947:0:22667:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789579317.588021:0:22667:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a10e13f9-13f2-441e-b716-61685111baf3+22:2395:x1876509261467008:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 194us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579317.588029:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 1 00000100:00100000:2.0:1789579317.590537:0:22684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261467264 00000100:00100000:2.0:1789579317.590559:0:22684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261467264 00000100:00100000:2.0:1789579317.590643:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 8 00000100:00100000:2.0:1789579317.590655:0:22684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a10e13f9-13f2-441e-b716-61685111baf3+22:18773:x1876509261467264:12345-192.168.203.37@tcp:35:cat.0 00000100:00100000:2.0:1789579317.591090:0:22684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a10e13f9-13f2-441e-b716-61685111baf3+23:18773:x1876509261467264:12345-192.168.203.37@tcp:35:cat.0 Request processed in 436us (3469us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1789579317.591103:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 8 00000100:00100000:3.0:1789579317.658909:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579317.659403:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261467520 00000100:00100000:0.0:1789579317.659417:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261467520 00000100:00100000:0.0:1789579317.659499:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 43 00000100:00100000:0.0:1789579317.659512:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a10e13f9-13f2-441e-b716-61685111baf3+23:18779:x1876509261467520:12345-192.168.203.37@tcp:101:dd.0 00010000:00010000:0.0:1789579317.659548:0:22682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579317.659578:0:22682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437400/0xd90373d592f22e92 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec5ff expref: -99 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579317.659727:0:22682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f22e99 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579317.659759:0:22682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f22e37 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5dc expref: 24 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579317.659768:0:22682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f22e4c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5e3 expref: 24 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579317.659777:0:22682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f22e99 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579317.659820:0:22682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f22e4c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5e3 expref: 24 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579317.659866:0:22682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f22e4c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5e3 expref: 24 pid: 22680 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579317.659882:0:22682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22682:1876509277296000:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789579317.660085:0:22682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f22e37 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5dc expref: 24 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579317.660100:0:22682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f22e37 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5dc expref: 24 pid: 22682 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579317.660111:0:22682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22682:1876509277296128:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789579317.660138:0:22682:0:(client.c:2716:ptlrpc_set_wait()) set ffff93930201e600 going to sleep for 11 seconds 00000100:00100000:3.0:1789579317.664082:0:22682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22682:1876509277296000:192.168.203.37@tcp:104: 00000100:00100000:3.0:1789579317.664101:0:22682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22682:1876509277296128:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789579317.664145:0:22682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f22e99 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579317.666300:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579317.666347:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579317.666712:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261467648 00000100:00100000:2.0:1789579317.666725:0:22665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261467648 00010000:00010000:2.0:1789579317.666780:0:22665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f22e4c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5e3 expref: 25 pid: 22680 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579317.666822:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261467776 00000100:00100000:2.0:1789579317.666832:0:22665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261467776 00010000:00010000:2.0:1789579317.666852:0:22665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f22e37 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5dc expref: 26 pid: 22682 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579317.666893:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 17 00000100:00100000:2.0:1789579317.666903:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a10e13f9-13f2-441e-b716-61685111baf3+26:2395:x1876509261467648:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789579317.666931:0:22665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579317.666940:0:22665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f22e4c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5e3 expref: 26 pid: 22680 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579317.666953:0:22665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f22e4c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5e3 expref: 26 pid: 22680 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579317.666979:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f22e4c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5e3 expref: 26 pid: 22680 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579317.666999:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff939441952000) 00010000:00010000:2.0:1789579317.667005:0:22665:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f22e99 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579317.667015:0:22665:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f22e99 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579317.667022:0:22665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789579317.667090:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a10e13f9-13f2-441e-b716-61685111baf3+25:2395:x1876509261467648:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 188us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579317.667097:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 17 00000100:00100000:2.0:1789579317.667115:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 18 00000100:00100000:2.0:1789579317.667120:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393037cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a10e13f9-13f2-441e-b716-61685111baf3+24:2394:x1876509261467776:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789579317.667136:0:22665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579317.667141:0:22665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f22e37 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5dc expref: 24 pid: 22682 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579317.667151:0:22665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f22e37 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5dc expref: 24 pid: 22682 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579317.667163:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f22e37 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5dc expref: 24 pid: 22682 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579317.667173:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff939441952000) 00010000:00010000:2.0:1789579317.667177:0:22665:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f22e99 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579317.667185:0:22665:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f22e99 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579317.667193:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f22e99 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579317.667221:0:22665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789579317.667240:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393037cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a10e13f9-13f2-441e-b716-61685111baf3+23:2394:x1876509261467776:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 120us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579317.667247:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 18 00010000:00010000:3.0:1789579317.667880:0:22682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f22e99 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579317.667893:0:22682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f22e99 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789579317.667937:0:22682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789579317.668137:0:22682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437400/0xd90373d592f22e92 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5ff expref: 24 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579317.668158:0:22682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f22e99 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec5ff expref: 23 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579317.668167:0:22682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff939441952000) 00010000:00010000:3.0:1789579317.668170:0:22682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789579317.668173:0:22682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303437e00, rc 0) 00000100:00100000:3.0:1789579317.668229:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a10e13f9-13f2-441e-b716-61685111baf3+23:18779:x1876509261467520:12345-192.168.203.37@tcp:101:dd.0 Request processed in 8720us (9335us total) trans 12884901904 rc 0/0 00000100:00100000:3.0:1789579317.668236:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 43 00000100:00100000:3.0:1789579317.672979:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579317.673218:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261467904 00000100:00100000:0.0:1789579317.673231:0:22681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261467904 00000100:00100000:0.0:1789579317.673303:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 44 00000100:00100000:0.0:1789579317.673315:0:22681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a10e13f9-13f2-441e-b716-61685111baf3+23:18779:x1876509261467904:12345-192.168.203.37@tcp:101:dd.0 00010000:00010000:0.0:1789579317.673394:0:22681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579317.673421:0:22681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f22ea7 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec606 expref: -99 pid: 22681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579317.673463:0:22681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f22eae lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579317.673479:0:22681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f22eae lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579317.673515:0:22681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f22eae lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579317.673658:0:22681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f22ea7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec606 expref: 25 pid: 22681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579317.673679:0:22681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f22eae lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec606 expref: 24 pid: 22681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579317.673688:0:22681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff939441952000) 00010000:00010000:0.0:1789579317.673691:0:22681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789579317.673696:0:22681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303436a00, rc 0) 00000100:00100000:0.0:1789579317.673925:0:22681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a10e13f9-13f2-441e-b716-61685111baf3+24:18779:x1876509261467904:12345-192.168.203.37@tcp:101:dd.0 Request processed in 611us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579317.673933:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 44 00000100:00100000:0.0:1789579317.679584:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579317.679694:0:24054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261468160 00000100:00100000:2.0:1789579317.679708:0:24054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261468160 00000100:00100000:2.0:1789579317.680112:0:24054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 45 00000100:00100000:2.0:1789579317.680126:0:24054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a10e13f9-13f2-441e-b716-61685111baf3+24:18779:x1876509261468160:12345-192.168.203.37@tcp:36:dd.0 00010000:00010000:2.0:1789579317.680530:0:24054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a400/0xd90373d592f22eb5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579317.680556:0:24054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a400/0xd90373d592f22eb5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579317.680570:0:24054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a400/0xd90373d592f22eb5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789579317.680627:0:24054:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:2.0:1789579317.680655:0:24054:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001dab8f46 reply state 00000000927b87e5 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a400/0xd90373d592f22eb5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579317.680669:0:24054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a400/0xd90373d592f22eb5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579317.680677:0:24054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff939441952000) 00010000:00010000:2.0:1789579317.680680:0:24054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789579317.680686:0:24054:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789579317.681188:0:24054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a10e13f9-13f2-441e-b716-61685111baf3+27:18779:x1876509261468160:12345-192.168.203.37@tcp:36:dd.0 Request processed in 1061us (1614us total) trans 12884901906 rc 0/0 00000100:00100000:2.0:1789579317.681197:0:24054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 45 00000020:00080000:2.0:1789579317.681204:0:24054:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789579317.683557:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579317.683680:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261468288 00000100:00100000:0.0:1789579317.683693:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261468288 00000100:00100000:0.0:1789579317.683775:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 46 00000100:00100000:0.0:1789579317.683787:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a10e13f9-13f2-441e-b716-61685111baf3+27:18779:x1876509261468288:12345-192.168.203.37@tcp:101:dd.0 00010000:00010000:0.0:1789579317.683817:0:22682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579317.683844:0:22682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f22ebc lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec60d expref: -99 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579317.683930:0:22682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f22ebc lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec60d expref: 28 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579317.683971:0:22682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f22ebc lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec60d expref: 28 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579317.683994:0:22682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff939441952000) 00010000:00010000:0.0:1789579317.683997:0:22682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789579317.684001:0:22682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303437a00, rc 0) 00000100:00100000:0.0:1789579317.684078:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a10e13f9-13f2-441e-b716-61685111baf3+28:18779:x1876509261468288:12345-192.168.203.37@tcp:101:dd.0 Request processed in 292us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579317.684085:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 46 00000100:00100000:3.0:1789579317.699853:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579317.700141:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261468544 00000100:00100000:2.0:1789579317.700154:0:22665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261468544 00000100:00100000:2.0:1789579317.700236:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 2 00000100:00100000:2.0:1789579317.700249:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a10e13f9-13f2-441e-b716-61685111baf3+28:18779:x1876509261468544:12345-192.168.203.37@tcp:103:dd.0 00010000:00010000:2.0:1789579317.700279:0:22665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579317.700313:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f22ebc lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec60d expref: 28 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579317.700417:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff939441952000) 00010000:00010000:2.0:1789579317.700424:0:22665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789579317.700501:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a10e13f9-13f2-441e-b716-61685111baf3+27:18779:x1876509261468544:12345-192.168.203.37@tcp:103:dd.0 Request processed in 254us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579317.700508:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 2 00000100:00100000:3.0:1789579317.703758:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579317.704202:0:24487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261468672 00000100:00100000:0.0:1789579317.704216:0:24487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261468672 00000100:00100000:0.0:1789579317.704298:0:24487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 47 00000100:00100000:0.0:1789579317.704310:0:24487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a10e13f9-13f2-441e-b716-61685111baf3+27:18779:x1876509261468672:12345-192.168.203.37@tcp:58:dd.0 00010000:00010000:0.0:1789579317.704490:0:24487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436800/0xd90373d592f22ec3 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579317.704512:0:24487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436800/0xd90373d592f22ec3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579317.704526:0:24487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436800/0xd90373d592f22ec3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789579317.707292:0:24487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789579317.707326:0:24487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1789579317.709387:0:24487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1789579317.709882:0:24487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a10e13f9-13f2-441e-b716-61685111baf3+27:18779:x1876509261468672:12345-192.168.203.37@tcp:58:dd.0 Request processed in 5567us (6142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579317.710614:0:24487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 47 00000100:00100000:3.0:1789579317.713524:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579317.713858:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261468800 00000100:00100000:0.0:1789579317.713869:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261468800 00000100:00100000:0.0:1789579317.713939:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 48 00000100:00100000:0.0:1789579317.713950:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a10e13f9-13f2-441e-b716-61685111baf3+27:18779:x1876509261468800:12345-192.168.203.37@tcp:101:dd.0 00010000:00010000:0.0:1789579317.713970:0:22682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579317.713989:0:22682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f22eca lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec614 expref: -99 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579317.714042:0:22682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436800/0xd90373d592f22ec3 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579317.714052:0:22682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f22eca lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec614 expref: 28 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579317.714069:0:22682:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff939303436800/0xd90373d592f22ec3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579317.714082:0:22682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f22eca lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec614 expref: 28 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579317.714092:0:22682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff939441952000) 00010000:00010000:0.0:1789579317.714095:0:22682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789579317.714099:0:22682:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f22eca lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec614 expref: 28 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579317.714105:0:22682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303437c00, rc 0) 00000100:00100000:0.0:1789579317.714180:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a10e13f9-13f2-441e-b716-61685111baf3+28:18779:x1876509261468800:12345-192.168.203.37@tcp:101:dd.0 Request processed in 231us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579317.714187:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 48 00000100:00100000:0.0:1789579317.882530:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579317.882575:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579317.882755:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579317.882790:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579317.882814:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579317.882878:0:24187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261469184 00000100:00100000:1.0:1789579317.882887:0:24187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261469184 00000100:00100000:1.0:1789579317.882943:0:24187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261469312 00000100:00100000:1.0:1789579317.882947:0:24187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261469312 00000100:00100000:1.0:1789579317.882969:0:24187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 20 00000100:00100000:1.0:1789579317.882978:0:24187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a10e13f9-13f2-441e-b716-61685111baf3+5:2393:x1876509261469184:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789579317.883056:0:24187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a10e13f9-13f2-441e-b716-61685111baf3+5:2393:x1876509261469184:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 78us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579317.883091:0:24187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 20 00000100:00100000:1.0:1789579317.883109:0:24187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 21 00000100:00100000:1.0:1789579317.883116:0:24187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a10e13f9-13f2-441e-b716-61685111baf3+5:2392:x1876509261469312:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789579317.883140:0:24187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a10e13f9-13f2-441e-b716-61685111baf3+5:2392:x1876509261469312:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 25us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579317.883147:0:24187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 21 00000100:00080000:1.0:1789579317.883177:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789579317.883181:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789579317.884037:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261468928 00000100:00100000:2.0:1789579317.884046:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261468928 00000100:00100000:2.0:1789579317.884096:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 164 00000100:00100000:2.0:1789579317.884106:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303442850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26ca68eb-fc53-4468-a753-d660cc98bf7c+13:2393:x1876509261468928:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789579317.884146:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303442850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26ca68eb-fc53-4468-a753-d660cc98bf7c+13:2393:x1876509261468928:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 41us (1628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579317.884154:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 164 00000100:00100000:0.0:1789579317.888240:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579317.888282:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579317.888324:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579317.889145:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261469056 00000100:00100000:2.0:1789579317.889156:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261469056 00000100:00100000:1.0:1789579317.889373:0:24736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261469696 00000100:00100000:1.0:1789579317.889388:0:24736:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261469696 00000100:00100000:1.0:1789579317.889429:0:24736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261469824 00000100:00100000:1.0:1789579317.889432:0:24736:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261469824 00000100:00100000:1.0:1789579317.889456:0:24736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 22 00000100:00100000:1.0:1789579317.889479:0:24736:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304887480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7263f938-3275-4200-b80b-4135ea8c4f2d+5:2393:x1876509261469696:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789579317.889550:0:24736:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304887480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7263f938-3275-4200-b80b-4135ea8c4f2d+5:2393:x1876509261469696:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 74us (1266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579317.889558:0:24736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 22 00000100:00100000:1.0:1789579317.889576:0:24736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 23 00000100:00100000:1.0:1789579317.889583:0:24736:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7263f938-3275-4200-b80b-4135ea8c4f2d+5:2392:x1876509261469824:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789579317.889607:0:24736:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7263f938-3275-4200-b80b-4135ea8c4f2d+5:2392:x1876509261469824:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 25us (1283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579317.889613:0:24736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 23 00000100:00080000:1.0:1789579317.889635:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789579317.889639:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789579317.889693:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261469440 00000100:00100000:2.0:1789579317.889698:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261469440 00000100:00100000:0.0:1789579317.891051:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261469568 00000100:00100000:0.0:1789579317.891060:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261469568 00000100:00100000:0.0:1789579317.891281:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 58 00000100:00100000:0.0:1789579317.891292:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a10e13f9-13f2-441e-b716-61685111baf3+5:2392:x1876509261469056:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789579317.891363:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a10e13f9-13f2-441e-b716-61685111baf3+5:2392:x1876509261469056:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 59us (8774us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579317.891371:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 58 00000100:00100000:0.0:1789579317.891403:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 59 00000100:00100000:0.0:1789579317.891411:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7263f938-3275-4200-b80b-4135ea8c4f2d+12:2393:x1876509261469440:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789579317.891457:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7263f938-3275-4200-b80b-4135ea8c4f2d+12:2393:x1876509261469440:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 47us (8642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579317.891463:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 59 00000100:00100000:0.0:1789579317.891478:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 60 00000100:00100000:0.0:1789579317.891484:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7263f938-3275-4200-b80b-4135ea8c4f2d+5:2392:x1876509261469568:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789579317.891544:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7263f938-3275-4200-b80b-4135ea8c4f2d+5:2392:x1876509261469568:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 60us (3314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579317.891551:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 60 00010000:00010000:3.0:1789579317.987631:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789579318.307558:0:22718:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789579318.307566:0:22718:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789579318.307591:0:22718:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1789579318.307602:0:22718:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1789579318.307771:0:22718:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394091fce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22718:1876509277296256:192.168.203.37@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789579318.307907:0:22718:0:(client.c:2716:ptlrpc_set_wait()) set ffff939404229780 going to sleep for 11 seconds 00000100:00100000:3.0:1789579318.317917:0:22718:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394091fce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22718:1876509277296256:192.168.203.37@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789579318.323109:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579318.325394:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261469952 00000100:00100000:3.0:1789579318.325411:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261469952 00000100:00100000:3.0:1789579318.325503:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 49 00000100:00100000:3.0:1789579318.325516:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a10e13f9-13f2-441e-b716-61685111baf3+28:18780:x1876509261469952:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789579318.325549:0:22682:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789579318.325697:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a10e13f9-13f2-441e-b716-61685111baf3+28:18780:x1876509261469952:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 Request processed in 184us (2595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579318.325705:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 49 00000100:00080000:1.0:1789579318.325815:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789579318.347121:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579318.347796:0:24487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261470080 00000100:00100000:1.0:1789579318.347807:0:24487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261470080 00000100:00100000:1.0:1789579318.347922:0:24487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 50 00000100:00100000:1.0:1789579318.347934:0:24487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a10e13f9-13f2-441e-b716-61685111baf3+28:18780:x1876509261470080:12345-192.168.203.37@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789579318.348971:0:24487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394041da000/0xd90373d592f22ed1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.348990:0:24487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394041da000/0xd90373d592f22ed1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.349001:0:24487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394041da000/0xd90373d592f22ed1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.349062:0:24487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db000/0xd90373d592f22ed8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.349070:0:24487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db000/0xd90373d592f22ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.349077:0:24487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db000/0xd90373d592f22ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.349099:0:24487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22edf lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.349107:0:24487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22edf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.349113:0:24487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22edf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789579318.349159:0:24487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789579318.349187:0:24487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789579318.349204:0:24487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22edf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.349467:0:24487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394041da000/0xd90373d592f22ed1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.349474:0:24487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394041da000/0xd90373d592f22ed1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.349480:0:24487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394041da000/0xd90373d592f22ed1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.349486:0:24487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394041da000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579318.349490:0:24487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394041da000/0xd90373d592f22ed1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.349497:0:24487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394041da000/0xd90373d592f22ed1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.349509:0:24487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff939441952500) 00010000:00010000:1.0:1789579318.349512:0:24487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579318.349517:0:24487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394041da000/0xd90373d592f22ed1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.349523:0:24487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394041da000/0xd90373d592f22ed1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.349537:0:24487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db000/0xd90373d592f22ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.349542:0:24487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db000/0xd90373d592f22ed8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.349558:0:24487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db000/0xd90373d592f22ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.349562:0:24487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394041db000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579318.349565:0:24487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db000/0xd90373d592f22ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.349570:0:24487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db000/0xd90373d592f22ed8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.349577:0:24487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff93940905b100) 00010000:00010000:1.0:1789579318.349580:0:24487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579318.349582:0:24487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db000/0xd90373d592f22ed8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.349588:0:24487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db000/0xd90373d592f22ed8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.349605:0:24487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22edf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.349611:0:24487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22edf lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.349616:0:24487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22edf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.349620:0:24487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394041db800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579318.349622:0:24487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22edf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.349636:0:24487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22edf lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.349644:0:24487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff939441952000) 00010000:00010000:1.0:1789579318.349646:0:24487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579318.349649:0:24487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22edf lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.349655:0:24487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22edf lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579318.349740:0:24487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a10e13f9-13f2-441e-b716-61685111baf3+28:18780:x1876509261470080:12345-192.168.203.37@tcp:34:lhsmtool_posix.0 Request processed in 1806us (2625us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579318.349749:0:24487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 50 00000100:00100000:2.0:1789579318.353343:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579318.353518:0:24054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261470336 00000100:00100000:0.0:1789579318.353528:0:24054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261470336 00000100:00100000:0.0:1789579318.353586:0:24054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 51 00000100:00100000:0.0:1789579318.353596:0:24054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a10e13f9-13f2-441e-b716-61685111baf3+28:18780:x1876509261470336:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789579318.353615:0:24054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579318.353635:0:24054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f22ee6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec61b expref: -99 pid: 24054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.353742:0:24054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f22eed lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.353757:0:24054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f22eed lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.353768:0:24054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f22eed lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789579318.353779:0:24054:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789579318.353861:0:24054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f22eed lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.353869:0:24054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f22eed lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.353875:0:24054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f22eed lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.353893:0:24054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789579318.353897:0:24054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f22eed lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.353903:0:24054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f22eed lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.353915:0:24054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff939441952000) 00010000:00010000:0.0:1789579318.353918:0:24054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789579318.353923:0:24054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f22eed lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.353928:0:24054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f22eed lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.353986:0:24054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f22ee6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec61b expref: 30 pid: 24054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.353997:0:24054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff939441952500) 00010000:00010000:0.0:1789579318.354000:0:24054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789579318.354004:0:24054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f22ee6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec61b expref: 30 pid: 24054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.354015:0:24054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303436600, rc 0) 00000100:00100000:0.0:1789579318.354181:0:24054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a10e13f9-13f2-441e-b716-61685111baf3+29:18780:x1876509261470336:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 585us (846us total) trans 12884901907 rc 301/301 00000100:00100000:0.0:1789579318.354188:0:24054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 51 00000100:00100000:0.0:1789579318.360651:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579318.360767:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261470464 00000100:00100000:3.0:1789579318.360777:0:22681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261470464 00000100:00100000:3.0:1789579318.360828:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 52 00000100:00100000:3.0:1789579318.360838:0:22681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a10e13f9-13f2-441e-b716-61685111baf3+29:18780:x1876509261470464:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789579318.360873:0:22681:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789579318.361002:0:22681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a10e13f9-13f2-441e-b716-61685111baf3+29:18780:x1876509261470464:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 Request processed in 165us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579318.361011:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 52 00000100:00100000:0.0:1789579318.368675:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579318.369102:0:24054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261470720 00000100:00100000:3.0:1789579318.369113:0:24054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261470720 00000100:00100000:3.0:1789579318.369228:0:24054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 53 00000100:00100000:3.0:1789579318.369239:0:24054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a10e13f9-13f2-441e-b716-61685111baf3+29:18780:x1876509261470720:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789579318.369260:0:24054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579318.369280:0:24054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f22efb lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec622 expref: -99 pid: 24054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789579318.369697:0:24054:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =59 00000004:00080000:3.0:1789579318.369704:0:24054:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+59 in llog 00000004:00080000:3.0:1789579318.369738:0:24054:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:3.0:1789579318.369890:0:24054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367c00/0xd90373d592f22f02 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.369905:0:24054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304367c00/0xd90373d592f22f02 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.369917:0:24054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304367c00/0xd90373d592f22f02 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.369988:0:24054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f22efb lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec622 expref: 32 pid: 24054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.370006:0:24054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367c00/0xd90373d592f22f02 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec622 expref: 31 pid: 24054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.370014:0:24054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff939441952800) 00010000:00010000:3.0:1789579318.370017:0:24054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789579318.370020:0:24054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939304367c00, rc 0) 00000100:00100000:3.0:1789579318.370081:0:24054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a10e13f9-13f2-441e-b716-61685111baf3+31:18780:x1876509261470720:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 844us (1416us total) trans 12884901908 rc 0/0 00000100:00100000:3.0:1789579318.370089:0:24054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 53 00000100:00100000:0.0:1789579318.374301:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579318.375683:0:24487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261470976 00000100:00100000:1.0:1789579318.375697:0:24487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261470976 00000100:00100000:1.0:1789579318.375808:0:24487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 54 00000100:00100000:1.0:1789579318.375820:0:24487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a10e13f9-13f2-441e-b716-61685111baf3+31:18780:x1876509261470976:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789579318.375883:0:24487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789579318.375911:0:24487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367c00/0xd90373d592f22f02 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec622 expref: 31 pid: 24054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.375932:0:24487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff939441952800) 00010000:00010000:1.0:1789579318.375942:0:24487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789579318.375978:0:24487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22f10 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.375992:0:24487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22f10 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.376019:0:24487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22f10 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.376084:0:24487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db000/0xd90373d592f22f17 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xe1e60f2f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.376093:0:24487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db000/0xd90373d592f22f17 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xe1e60f2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.376100:0:24487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db000/0xd90373d592f22f17 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xe1e60f2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.376147:0:24487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22f10 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.376153:0:24487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22f10 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.376160:0:24487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22f10 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.376166:0:24487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394041db800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579318.376171:0:24487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22f10 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.376179:0:24487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22f10 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.376187:0:24487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff939441952e00) 00010000:00010000:1.0:1789579318.376189:0:24487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579318.376193:0:24487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22f10 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.376204:0:24487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22f10 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.376580:0:24487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db000/0xd90373d592f22f17 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xe1e60f2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.376586:0:24487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db000/0xd90373d592f22f17 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xe1e60f2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.376592:0:24487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db000/0xd90373d592f22f17 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xe1e60f2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.376597:0:24487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394041db000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579318.376601:0:24487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db000/0xd90373d592f22f17 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xe1e60f2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.376606:0:24487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db000/0xd90373d592f22f17 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xe1e60f2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.376614:0:24487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xe1e60f2f (ffff93940905b100) 00010000:00010000:1.0:1789579318.376616:0:24487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579318.376619:0:24487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db000/0xd90373d592f22f17 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xe1e60f2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.376625:0:24487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db000/0xd90373d592f22f17 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xe1e60f2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579318.376708:0:24487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a10e13f9-13f2-441e-b716-61685111baf3+30:18780:x1876509261470976:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 Request processed in 890us (2415us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789579318.376715:0:24487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 54 00000100:00100000:1.0:1789579318.380842:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579318.381340:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261471104 00000100:00100000:2.0:1789579318.381460:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261471104 00000100:00100000:2.0:1789579318.381555:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 55 00000100:00100000:2.0:1789579318.381565:0:22680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a10e13f9-13f2-441e-b716-61685111baf3+30:18780:x1876509261471104:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789579318.381585:0:22680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579318.381604:0:22680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a600/0xd90373d592f22f1e lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec629 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.381636:0:22680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7ac00/0xd90373d592f22f25 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.381661:0:22680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7ac00/0xd90373d592f22f25 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.381672:0:22680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7ac00/0xd90373d592f22f25 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.381775:0:22680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a600/0xd90373d592f22f1e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec629 expref: 32 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.381793:0:22680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7ac00/0xd90373d592f22f25 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec629 expref: 31 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.381801:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93942ef59700) 00010000:00010000:2.0:1789579318.381804:0:22680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789579318.381807:0:22680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939435d7ac00, rc 0) 00000100:00100000:2.0:1789579318.381870:0:22680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a10e13f9-13f2-441e-b716-61685111baf3+31:18780:x1876509261471104:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 307us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579318.381877:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 55 00000100:00100000:0.0:1789579318.385544:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579318.385604:0:24054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261471360 00000100:00100000:3.0:1789579318.385613:0:24054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261471360 00000100:00100000:3.0:1789579318.385685:0:24054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 56 00000100:00100000:3.0:1789579318.385693:0:24054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a10e13f9-13f2-441e-b716-61685111baf3+31:18780:x1876509261471360:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789579318.385760:0:24054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f22f2c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.385793:0:24054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f22f2c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.385805:0:24054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f22f2c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789579318.386070:0:24054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:3.0:1789579318.386081:0:24054:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 673518730160ns, next at 674518727862ns, rc = 0 00000004:00010000:3.0:1789579318.386128:0:24054:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000015100165 reply state 0000000012080e7b transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f22f2c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.386141:0:24054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f22f2c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.386148:0:24054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93942ef59700) 00010000:00010000:3.0:1789579318.386151:0:24054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789579318.386155:0:24054:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789579318.386319:0:24054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a10e13f9-13f2-441e-b716-61685111baf3+33:18780:x1876509261471360:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 Request processed in 625us (782us total) trans 12884901909 rc 0/0 00000100:00100000:3.0:1789579318.386327:0:24054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 56 00000100:00100000:0.0:1789579318.392413:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579318.392486:0:24487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261471488 00000100:00100000:1.0:1789579318.392498:0:24487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261471488 00000100:00100000:1.0:1789579318.392559:0:24487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 57 00000100:00100000:1.0:1789579318.392569:0:24487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a10e13f9-13f2-441e-b716-61685111baf3+33:18780:x1876509261471488:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789579318.392591:0:24487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579318.392609:0:24487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22f33 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec630 expref: -99 pid: 24487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.392663:0:24487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22f33 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec630 expref: 34 pid: 24487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.392677:0:24487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22f33 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec630 expref: 34 pid: 24487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.392694:0:24487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93942ef59700) 00010000:00010000:1.0:1789579318.392697:0:24487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789579318.392701:0:24487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394041db800, rc 0) 00000100:00100000:1.0:1789579318.392758:0:24487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a10e13f9-13f2-441e-b716-61685111baf3+34:18780:x1876509261471488:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 190us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579318.392773:0:24487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 57 00000100:00100000:1.0:1789579318.401733:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579318.405408:0:25077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261471616 00000100:00100000:3.0:1789579318.405423:0:25077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261471616 00000100:00100000:3.0:1789579318.405542:0:25077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 20 00000100:00100000:3.0:1789579318.405553:0:25077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a10e13f9-13f2-441e-b716-61685111baf3+5:2395:x1876509261471616:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789579318.405780:0:25077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a10e13f9-13f2-441e-b716-61685111baf3+6:2395:x1876509261471616:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 Request processed in 229us (4057us total) trans 12884901891 rc 0/0 00000100:00100000:3.0:1789579318.405787:0:25077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 20 00000100:00100000:0.0:1789579318.410890:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579318.410997:0:22684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261471872 00000100:00100000:2.0:1789579318.411008:0:22684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261471872 00000100:00100000:2.0:1789579318.411060:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 9 00000100:00100000:2.0:1789579318.411070:0:22684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a10e13f9-13f2-441e-b716-61685111baf3+34:18780:x1876509261471872:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789579318.411650:0:22684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a10e13f9-13f2-441e-b716-61685111baf3+35:18780:x1876509261471872:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 Request processed in 207us (394us total) trans 12884901910 rc 0/0 00000100:00100000:2.0:1789579318.411659:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 9 00000100:00100000:0.0:1789579318.417206:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579318.417325:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261472128 00000100:00100000:2.0:1789579318.417348:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261472128 00000100:00100000:2.0:1789579318.417444:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 58 00000100:00100000:2.0:1789579318.417455:0:22680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a10e13f9-13f2-441e-b716-61685111baf3+35:18780:x1876509261472128:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789579318.417574:0:22680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a10e13f9-13f2-441e-b716-61685111baf3+35:18780:x1876509261472128:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 120us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579318.417581:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 58 00000100:00100000:3.0:1789579318.423187:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579318.424204:0:24054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261472256 00000100:00100000:0.0:1789579318.424223:0:24054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261472256 00000100:00100000:0.0:1789579318.424443:0:24054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 59 00000100:00100000:0.0:1789579318.424455:0:24054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a10e13f9-13f2-441e-b716-61685111baf3+35:18780:x1876509261472256:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789579318.424474:0:24054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579318.424493:0:24054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f22f3a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec637 expref: -99 pid: 24054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.424568:0:24054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436e00/0xd90373d592f22f41 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.424582:0:24054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436e00/0xd90373d592f22f41 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.424593:0:24054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436e00/0xd90373d592f22f41 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789579318.424645:0:24054:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789579318.424663:0:24054:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939303436e00/0xd90373d592f22f41 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.424688:0:24054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f22f3a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec637 expref: 37 pid: 24054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.424720:0:24054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436e00/0xd90373d592f22f41 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec637 expref: 36 pid: 24054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.424729:0:24054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93942ef59700) 00010000:00010000:0.0:1789579318.424732:0:24054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789579318.424736:0:24054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303436e00, rc 0) 00000100:00100000:0.0:1789579318.424803:0:24054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a10e13f9-13f2-441e-b716-61685111baf3+36:18780:x1876509261472256:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 351us (1627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579318.424810:0:24054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 59 00000100:00100000:3.0:1789579318.429123:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579318.429544:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261472384 00000100:00100000:2.0:1789579318.429554:0:24188:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261472384 00000100:00100000:2.0:1789579318.429612:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 21 00000100:00100000:2.0:1789579318.429848:0:24188:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a10e13f9-13f2-441e-b716-61685111baf3+6:2394:x1876509261472384:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789579318.429867:0:24188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579318.429886:0:24188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000165ad199/0xd90373d592f22f48 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec63e expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789579318.429925:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aaad035, blocks: 0x0 00010000:00010000:2.0:1789579318.429948:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=673s v=(0 0) 00010000:00010000:2.0:1789579318.429953:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789579318.429962:0:24188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000165ad199/0xd90373d592f22f48 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec63e expref: 7 pid: 24188 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.429981:0:24188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000165ad199/0xd90373d592f22f48 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec63e expref: 7 pid: 24188 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.429993:0:24188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939435d7ae00, rc 0) 00000100:00100000:2.0:1789579318.430053:0:24188:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a10e13f9-13f2-441e-b716-61685111baf3+7:2394:x1876509261472384:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 209us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579318.434793:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 21 00000100:00100000:0.0:1789579318.435040:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579318.435123:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261472640 00000100:00100000:3.0:1789579318.435133:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261472640 00000100:00100000:3.0:1789579318.435218:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 60 00000100:00100000:3.0:1789579318.435228:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a10e13f9-13f2-441e-b716-61685111baf3+36:18780:x1876509261472640:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789579318.435342:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a10e13f9-13f2-441e-b716-61685111baf3+36:18780:x1876509261472640:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 115us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579318.435386:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 60 00000100:00100000:0.0:1789579318.439815:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579318.440016:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261472768 00000100:00100000:3.0:1789579318.440026:0:22681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261472768 00000100:00100000:3.0:1789579318.440114:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 61 00000100:00100000:3.0:1789579318.440125:0:22681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a10e13f9-13f2-441e-b716-61685111baf3+36:18780:x1876509261472768:12345-192.168.203.37@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789579318.442561:0:22660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:0.0:1789579318.442578:0:22660:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:2.0:1789579318.442685:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f22d81 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.442697:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f22d81 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.442705:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f22d81 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.442711:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304367800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579318.442715:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f22d81 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.442722:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f22d81 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.442738:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff939441952d00) 00010000:00010000:2.0:1789579318.442741:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789579318.442746:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f22d81 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.442753:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f22d81 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.442774:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f22d88 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.442781:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f22d88 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.442800:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f22d88 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.442806:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304367200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579318.442809:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f22d88 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.442815:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f22d88 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.442823:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff939441952e00) 00010000:00010000:2.0:1789579318.442826:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789579318.442829:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f22d88 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.442835:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f22d88 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.442848:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22e30 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.442854:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22e30 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.442860:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22e30 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.442865:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304366800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579318.442868:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22e30 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.442885:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22e30 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.442894:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff939441952200) 00010000:00010000:2.0:1789579318.442896:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789579318.442900:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22e30 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.442922:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f22e30 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.442938:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a400/0xd90373d592f22eb5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.442944:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a400/0xd90373d592f22eb5 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.442950:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a400/0xd90373d592f22eb5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.442954:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939435d7a400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579318.442957:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a400/0xd90373d592f22eb5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.442963:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a400/0xd90373d592f22eb5 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.442971:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff939441952000) 00010000:00010000:2.0:1789579318.442973:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789579318.442976:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a400/0xd90373d592f22eb5 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.442988:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a400/0xd90373d592f22eb5 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.443001:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f22f2c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.443007:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f22f2c lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.443012:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f22f2c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.443017:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304366e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579318.443020:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f22f2c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.443025:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f22f2c lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.443034:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93942ef59700) 00010000:00010000:2.0:1789579318.443036:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789579318.443039:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f22f2c lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579318.443045:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f22f2c lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579318.445243:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789579318.445264:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277296384:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789579318.445368:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579318.445830:0:24187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277296384 00000100:00100000:2.0:1789579318.445838:0:24187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277296384 00000100:00100000:2.0:1789579318.445889:0:24187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789579318.445899:0:24187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394045e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277296384:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789579318.446153:0:24187:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789579318.446157:0:24187:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1789579318.446159:0:24187:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789579318.446161:0:24187:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1789579317 -> 1789579317 00002000:00010000:2.0:1789579318.446164:0:24187:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1789579318.446209:0:24187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394045e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3616:x1876509277296384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 311us (860us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1789579318.446217:0:24187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:1.0:1789579318.447061:0:3616:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff939303a30000/2, rc 0, transno 12884901892 00000100:00100000:1.0:1789579318.447070:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277296384:0@lo:2:osp-syn-0-0.0 00000001:00080000:0.0:1789579318.447269:0:22660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:1.0:1789579318.447528:0:22681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a10e13f9-13f2-441e-b716-61685111baf3+15:18780:x1876509261472768:12345-192.168.203.37@tcp:44:lhsmtool_posix.0 Request processed in 7402us (7719us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579318.447543:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 61 00010000:00010000:3.0:1789579318.449439:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f22dd5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.449456:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f22dd5 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.449464:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f22dd5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.449470:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304366400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579318.449474:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f22dd5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.449481:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f22dd5 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.449495:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff939441952e00) 00010000:00010000:3.0:1789579318.449509:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1789579318.449514:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f22dd5 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.449520:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f22dd5 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579318.451875:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579318.452705:0:25077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261472896 00000100:00100000:3.0:1789579318.452716:0:25077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261472896 00000100:00100000:2.0:1789579318.452877:0:25077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 23 00000100:00100000:2.0:1789579318.452887:0:25077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a10e13f9-13f2-441e-b716-61685111baf3+7:2395:x1876509261472896:12345-192.168.203.37@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789579318.453007:0:25077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a10e13f9-13f2-441e-b716-61685111baf3+7:2395:x1876509261472896:12345-192.168.203.37@tcp:16:lhsmtool_posix.0 Request processed in 121us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579318.453014:0:25077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 23 00000100:00100000:0.0:1789579318.456294:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579318.456454:0:24054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261473152 00000100:00100000:3.0:1789579318.456464:0:24054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261473152 00000100:00100000:3.0:1789579318.456569:0:24054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 62 00000100:00100000:3.0:1789579318.456581:0:24054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a10e13f9-13f2-441e-b716-61685111baf3+15:18780:x1876509261473152:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789579318.456642:0:24054:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789579318.456666:0:24054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436e00/0xd90373d592f22f41 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec637 expref: 15 pid: 24054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.456683:0:24054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93942ef59700) 00010000:00010000:3.0:1789579318.456687:0:24054:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789579318.456712:0:24054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f22f4f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.456725:0:24054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f22f4f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.456734:0:24054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f22f4f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789579318.456846:0:24054:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000225e8df3 reply state 000000005f0f7dd6 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f22f4f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.456879:0:24054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f22f4f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.456885:0:24054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93942ef59700) 00010000:00010000:3.0:1789579318.456887:0:24054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789579318.456890:0:24054:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789579318.457120:0:24054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a10e13f9-13f2-441e-b716-61685111baf3+16:18780:x1876509261473152:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 Request processed in 540us (834us total) trans 12884901911 rc 0/0 00000100:00100000:3.0:1789579318.457127:0:24054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 62 00000100:00100000:0.0:1789579318.462487:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579318.462706:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261473280 00000100:00100000:1.0:1789579318.462715:0:24188:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261473280 00000100:00100000:1.0:1789579318.462804:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 24 00000100:00100000:1.0:1789579318.462815:0:24188:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a10e13f9-13f2-441e-b716-61685111baf3+7:2394:x1876509261473280:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789579318.463033:0:24188:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789579318.463037:0:24188:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1789579316 00002000:00010000:1.0:1789579318.463040:0:24188:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1789579316 00002000:00010000:1.0:1789579318.463042:0:24188:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1789579317 -> 1789579316 00002000:00010000:1.0:1789579318.463044:0:24188:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1789579318.463107:0:24188:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a10e13f9-13f2-441e-b716-61685111baf3+8:2394:x1876509261473280:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 Request processed in 292us (626us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1789579318.463115:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 24 00000100:00100000:0.0:1789579318.467719:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579318.467825:0:24736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261473408 00000100:00100000:1.0:1789579318.467836:0:24736:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261473408 00000100:00100000:1.0:1789579318.468053:0:24736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 25 00000100:00100000:1.0:1789579318.468065:0:24736:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a10e13f9-13f2-441e-b716-61685111baf3+8:2395:x1876509261473408:12345-192.168.203.37@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789579318.468112:0:24736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d72b0f1/0xd90373d592f22f56 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.468129:0:24736:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789579318.468133:0:24736:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789579318.468139:0:24736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d72b0f1/0xd90373d592f22f56 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.468174:0:24736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d72b0f1/0xd90373d592f22f56 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.468199:0:24736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d72b0f1/0xd90373d592f22f56 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.468208:0:24736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d72b0f1/0xd90373d592f22f56 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.468217:0:24736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d72b0f1/0xd90373d592f22f56 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.468223:0:24736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394041db400 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579318.468228:0:24736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d72b0f1/0xd90373d592f22f56 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.468236:0:24736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d72b0f1/0xd90373d592f22f56 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.468249:0:24736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d72b0f1/0xd90373d592f22f56 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.468258:0:24736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d72b0f1/0xd90373d592f22f56 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579318.468434:0:24736:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a10e13f9-13f2-441e-b716-61685111baf3+8:2395:x1876509261473408:12345-192.168.203.37@tcp:1:lhsmtool_posix.0 Request processed in 371us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579318.468442:0:24736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 25 00000100:00100000:0.0:1789579318.472430:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579318.472660:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261473664 00000100:00100000:3.0:1789579318.472669:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261473664 00000100:00100000:3.0:1789579318.472721:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 63 00000100:00100000:3.0:1789579318.472732:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a10e13f9-13f2-441e-b716-61685111baf3+16:18780:x1876509261473664:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789579318.472812:0:22682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367c00/0xd90373d592f22f5d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.472829:0:22682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f22eae lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec606 expref: 16 pid: 22681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.472839:0:22682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304367c00/0xd90373d592f22f5d lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.472873:0:22682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f22eae lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec606 expref: 16 pid: 22681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.472886:0:22682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f22eae lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec606 expref: 16 pid: 22681 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579318.472938:0:22682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394091ff100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22682:1876509277296512:192.168.203.37@tcp:104: 00000100:00100000:3.0:1789579318.473010:0:22682:0:(client.c:2716:ptlrpc_set_wait()) set ffff939404229540 going to sleep for 11 seconds 00000100:00100000:0.0:1789579318.477475:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579318.477685:0:22682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394091ff100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22682:1876509277296512:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789579318.477713:0:22682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939304367c00/0xd90373d592f22f5d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579318.477791:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261473792 00000100:00100000:1.0:1789579318.477799:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261473792 00010000:00010000:1.0:1789579318.477835:0:22666:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f22eae lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec606 expref: 17 pid: 22681 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579318.477871:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 19 00000100:00100000:1.0:1789579318.477879:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a10e13f9-13f2-441e-b716-61685111baf3+17:2394:x1876509261473792:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789579318.477894:0:22666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789579318.477900:0:22666:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f22eae lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec606 expref: 17 pid: 22681 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.477911:0:22666:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f22eae lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec606 expref: 17 pid: 22681 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.477933:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f22eae lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec606 expref: 17 pid: 22681 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.477948:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff939441952000) 00010000:00010000:1.0:1789579318.477953:0:22666:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f22eca lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec614 expref: 16 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.477974:0:22666:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff939304367c00/0xd90373d592f22f5d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.477996:0:22666:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367c00/0xd90373d592f22f5d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.478004:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304367c00/0xd90373d592f22f5d lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.478078:0:22682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939304367c00/0xd90373d592f22f5d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.478087:0:22682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304367c00/0xd90373d592f22f5d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.478097:0:22666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789579318.478150:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a10e13f9-13f2-441e-b716-61685111baf3+16:2394:x1876509261473792:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 271us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579318.478158:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 19 00010000:00010000:3.0:1789579318.478282:0:22682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f22f64 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.478296:0:22682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22f33 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec630 expref: 16 pid: 24487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.478304:0:22682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f22f64 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.478332:0:22682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22f33 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec630 expref: 16 pid: 24487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.478344:0:22682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22f33 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec630 expref: 16 pid: 24487 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579318.478385:0:22682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394091ff100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22682:1876509277296640:192.168.203.37@tcp:104: 00000100:00100000:3.0:1789579318.478448:0:22682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394042296c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789579318.484482:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579318.484572:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261473920 00000100:00100000:1.0:1789579318.484581:0:22667:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261473920 00010000:00010000:1.0:1789579318.484621:0:22667:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22f33 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec630 expref: 17 pid: 24487 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579318.484665:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 20 00000100:00100000:1.0:1789579318.484676:0:22667:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a10e13f9-13f2-441e-b716-61685111baf3+17:2394:x1876509261473920:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789579318.484691:0:22667:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789579318.484697:0:22667:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22f33 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec630 expref: 17 pid: 24487 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.484711:0:22667:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22f33 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec630 expref: 17 pid: 24487 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.484733:0:22667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93942ef59700) 00010000:00010000:1.0:1789579318.484739:0:22667:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f22f64 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.484765:0:22667:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f22f64 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.484774:0:22667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f22f64 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.484795:0:22667:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789579318.484898:0:22667:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a10e13f9-13f2-441e-b716-61685111baf3+17:2394:x1876509261473920:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 224us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579318.484921:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 20 00010000:00010000:3.0:1789579318.485296:0:22682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db800/0xd90373d592f22f33 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec630 expref: 16 pid: 24487 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579318.485314:0:22682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394091ff100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22682:1876509277296640:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789579318.485335:0:22682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f22f64 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.485344:0:22682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f22f64 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.485491:0:22682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f22f64 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789579318.485655:0:22682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:3.0:1789579318.485765:0:22682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:3.0:1789579318.485802:0:22682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:3.0:1789579318.486060:0:22682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394091ff100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22682:1876509277296768:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789579318.486112:0:22682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579318.486201:0:22682:0:(client.c:2716:ptlrpc_set_wait()) set ffff939404229840 going to sleep for 11 seconds 00000100:00100000:1.0:1789579318.487818:0:22686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277296768 00000100:00100000:1.0:1789579318.488090:0:22686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277296768 00000100:00100000:2.0:1789579318.488727:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789579318.488739:0:22686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22682:x1876509277296768:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789579318.488882:0:22686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22682:x1876509277296768:12345-0@lo:1000:mdt00_002.0 Request processed in 145us (2768us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579318.488890:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789579318.488971:0:22682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394091ff100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22682:1876509277296768:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1789579318.489181:0:22682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:3.0:1789579318.489251:0:22682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394091ff100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22682:1876509277296896:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789579318.489288:0:22682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579318.489799:0:22682:0:(client.c:2716:ptlrpc_set_wait()) set ffff939404229f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789579318.489884:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277296896 00000100:00100000:0.0:1789579318.489891:0:22685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277296896 00000100:00100000:0.0:1789579318.489936:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789579318.489944:0:22685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22682:x1876509277296896:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789579318.490082:0:22685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22682:x1876509277296896:12345-0@lo:1000:mdt00_002.0 Request processed in 138us (792us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1789579318.490098:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789579318.490284:0:22682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394091ff100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22682:1876509277296896:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1789579318.490322:0:22682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f22f64 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.490340:0:22682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f22f64 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.490348:0:22682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f22f64 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.490392:0:22682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304366c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579318.490396:0:22682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f22f64 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.490404:0:22682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f22f64 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.490420:0:22682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93942ef59700) 00010000:00010000:3.0:1789579318.490423:0:22682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789579318.490428:0:22682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f22f64 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.490434:0:22682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f22f64 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.490464:0:22682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436800/0xd90373d592f22ec3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.490471:0:22682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436800/0xd90373d592f22ec3 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.490478:0:22682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303436800/0xd90373d592f22ec3 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.490484:0:22682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579318.490493:0:22682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436800/0xd90373d592f22ec3 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.490500:0:22682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436800/0xd90373d592f22ec3 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.490509:0:22682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff939441952000) 00010000:00010000:3.0:1789579318.490512:0:22682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789579318.490518:0:22682:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f22eca lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec614 expref: 19 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.490530:0:22682:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f22eca lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec614 expref: 19 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.490551:0:22682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f22eca lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec614 expref: 19 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.490604:0:22682:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f22eca lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec614 expref: 19 pid: 22682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579318.490617:0:22682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394091ff800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22682:1876509277297024:192.168.203.37@tcp:105: 00000100:00100000:3.0:1789579318.490676:0:22682:0:(client.c:2716:ptlrpc_set_wait()) set ffff939404229900 going to sleep for 11 seconds 00000100:00100000:0.0:1789579318.494673:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579318.494758:0:22682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394091ff800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22682:1876509277297024:192.168.203.37@tcp:105: 00010000:00010000:3.0:1789579318.494786:0:22682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303436800/0xd90373d592f22ec3 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.494795:0:22682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436800/0xd90373d592f22ec3 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 24487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.494842:0:22682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f22f6b lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.494854:0:22682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f22f6b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.494864:0:22682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f22f6b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.494875:0:22682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f22f6b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.494881:0:22682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f22f6b lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.494888:0:22682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f22f6b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.494894:0:22682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304367000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579318.494897:0:22682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f22f6b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.494919:0:22682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f22f6b lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.494928:0:22682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff939441952000) 00010000:00010000:3.0:1789579318.494931:0:22682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789579318.494934:0:22682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f22f6b lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.494939:0:22682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f22f6b lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.494954:0:22682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367c00/0xd90373d592f22f5d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.494959:0:22682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304367c00/0xd90373d592f22f5d lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.494965:0:22682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304367c00/0xd90373d592f22f5d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.494969:0:22682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304367c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579318.494972:0:22682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367c00/0xd90373d592f22f5d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.494977:0:22682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367c00/0xd90373d592f22f5d lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.494984:0:22682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff939441952000) 00010000:00010000:3.0:1789579318.494986:0:22682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789579318.494989:0:22682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304367c00/0xd90373d592f22f5d lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.494995:0:22682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367c00/0xd90373d592f22f5d lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579318.495145:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a10e13f9-13f2-441e-b716-61685111baf3+19:18780:x1876509261473664:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 22414us (22724us total) trans 12884901916 rc 0/0 00000100:00100000:3.0:1789579318.495155:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 63 00000020:00080000:3.0:1789579318.495161:0:22682:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789579318.495684:0:22718:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1789579318.495689:0:22718:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789579318.495705:0:22718:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1789579318.495711:0:22718:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1789579318.495930:0:22684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261474048 00000100:00100000:3.0:1789579318.495937:0:22684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261474048 00000100:00100000:3.0:1789579318.495992:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 10 00000100:00100000:3.0:1789579318.496001:0:22684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942f027c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a10e13f9-13f2-441e-b716-61685111baf3+19:18779:x1876509261474048:12345-192.168.203.37@tcp:49:dd.0 00000100:00100000:3.0:1789579318.496091:0:22684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942f027c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a10e13f9-13f2-441e-b716-61685111baf3+19:18779:x1876509261474048:12345-192.168.203.37@tcp:49:dd.0 Request processed in 90us (1427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579318.496098:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 10 00000100:00100000:0.0:1789579318.503597:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579318.503637:0:22684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261474304 00000100:00100000:0.0:1789579318.503646:0:22684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261474304 00000100:00100000:0.0:1789579318.503693:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 11 00000100:00100000:0.0:1789579318.503701:0:22684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a10e13f9-13f2-441e-b716-61685111baf3+19:18780:x1876509261474304:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789579318.503964:0:22684:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789579318.503997:0:22684:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:0.0:1789579318.504029:0:22684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f22f72 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.504046:0:22684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f22f72 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.504057:0:22684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f22f72 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.504065:0:22684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f22f72 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.504071:0:22684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f22f72 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.504077:0:22684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f22f72 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.504108:0:22684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789579318.504137:0:22668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789579318.504143:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f22f72 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.504150:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436600 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:0.0:1789579318.504154:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f22f72 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.504162:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f22f72 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.504173:0:22668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93942ef59700) 00010000:00010000:0.0:1789579318.504176:0:22668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789579318.504180:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f22f72 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.504187:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f22f72 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.504201:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579318.504203:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579318.504204:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579318.504269:0:22684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a10e13f9-13f2-441e-b716-61685111baf3+21:18780:x1876509261474304:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 Request processed in 568us (680us total) trans 12884901918 rc 0/0 00000100:00100000:0.0:1789579318.504278:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 11 00000020:00080000:0.0:1789579318.504282:0:22684:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789579318.504330:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579318.506167:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261474432 00000100:00100000:1.0:1789579318.506182:0:22681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261474432 00000100:00100000:1.0:1789579318.506241:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 64 00000100:00100000:1.0:1789579318.506250:0:22681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a10e13f9-13f2-441e-b716-61685111baf3+21:18779:x1876509261474432:12345-192.168.203.37@tcp:101:dd.0 00010000:00010000:1.0:1789579318.506269:0:22681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579318.506289:0:22681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db400/0xd90373d592f22f79 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec645 expref: -99 pid: 22681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.506320:0:22681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394041da200/0xd90373d592f22f80 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.506333:0:22681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394041da200/0xd90373d592f22f80 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.506343:0:22681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394041da200/0xd90373d592f22f80 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.506496:0:22681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394041db400/0xd90373d592f22f79 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec645 expref: 23 pid: 22681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.506515:0:22681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394041da200/0xd90373d592f22f80 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec645 expref: 22 pid: 22681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.506523:0:22681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff939441952000) 00010000:00010000:1.0:1789579318.506526:0:22681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789579318.506529:0:22681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394041da200, rc 0) 00000040:00080000:2.0:1789579318.507202:0:23440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789579318.507478:0:22681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a10e13f9-13f2-441e-b716-61685111baf3+22:18779:x1876509261474432:12345-192.168.203.37@tcp:101:dd.0 Request processed in 1227us (3146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579318.507487:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 64 00000100:00100000:0.0:1789579318.676765:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579318.676949:0:24192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261474560 00000100:00100000:1.0:1789579318.676959:0:24192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261474560 00000100:00100000:1.0:1789579318.677039:0:24192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 0 00000100:00100000:1.0:1789579318.677051:0:24192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a10e13f9-13f2-441e-b716-61685111baf3+8:2394:x1876509261474560:12345-192.168.203.37@tcp:4:dd.0 00010000:00010000:1.0:1789579318.677087:0:24192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d72b0f1/0xd90373d592f22f87 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.677108:0:24192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000165ad199/0xd90373d592f22f48 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec63e expref: 8 pid: 24188 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.677117:0:24192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789579318.677121:0:24192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789579318.677125:0:24192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d72b0f1/0xd90373d592f22f87 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.677174:0:24192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000165ad199/0xd90373d592f22f48 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec63e expref: 8 pid: 24188 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.677189:0:24192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000165ad199/0xd90373d592f22f48 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec63e expref: 8 pid: 24188 timeout: 773 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579318.677204:0:24192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930486dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:24192:1876509277297152:192.168.203.37@tcp:104: 00000100:00100000:1.0:1789579318.677297:0:24192:0:(client.c:2716:ptlrpc_set_wait()) set ffff939409288840 going to sleep for 11 seconds 00000100:00100000:2.0:1789579318.682452:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579318.682481:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579318.682580:0:24194:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1789579318.682602:0:24194:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1789579318.683150:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261474816 00000100:00100000:3.0:1789579318.683161:0:22665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261474816 00010000:00010000:3.0:1789579318.683197:0:22665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000165ad199/0xd90373d592f22f48 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec63e expref: 9 pid: 24188 timeout: 773 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579318.683286:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 21 00000100:00100000:3.0:1789579318.683297:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a10e13f9-13f2-441e-b716-61685111baf3+9:2394:x1876509261474816:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789579318.683310:0:22665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789579318.683331:0:22665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000165ad199/0xd90373d592f22f48 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec63e expref: 9 pid: 24188 timeout: 773 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.683345:0:22665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000165ad199/0xd90373d592f22f48 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec63e expref: 9 pid: 24188 timeout: 773 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.683410:0:22665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579318.683414:0:22665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579318.683419:0:22665:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d72b0f1/0xd90373d592f22f87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.683429:0:22665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d72b0f1/0xd90373d592f22f87 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579318.683463:0:22665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789579318.683516:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a10e13f9-13f2-441e-b716-61685111baf3+9:2394:x1876509261474816:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 221us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579318.683523:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 21 00000100:00100000:0.0:1789579318.683612:0:24194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261474688 00000100:00100000:0.0:1789579318.683617:0:24194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261474688 00000100:00100000:0.0:1789579318.684066:0:25732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 1 00000100:00100000:0.0:1789579318.684075:0:25732:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a10e13f9-13f2-441e-b716-61685111baf3+9:2395:x1876509261474688:12345-192.168.203.37@tcp:4:dd.0 00010000:00010000:0.0:1789579318.684107:0:25732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003a9d201/0xd90373d592f22f8e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.684118:0:25732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789579318.684121:0:25732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789579318.684125:0:25732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003a9d201/0xd90373d592f22f8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.684136:0:25732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003a9d201/0xd90373d592f22f8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.687307:0:24192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000165ad199/0xd90373d592f22f48 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec63e expref: 9 pid: 24188 timeout: 773 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579318.687333:0:24192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930486dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:24192:1876509277297152:192.168.203.37@tcp:104: 00010000:00010000:1.0:1789579318.687402:0:24192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d72b0f1/0xd90373d592f22f87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.687415:0:24192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d72b0f1/0xd90373d592f22f87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579318.687421:0:24192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d72b0f1/0xd90373d592f22f87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789579318.776092:0:24183:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:1.0:1789579318.776109:0:24183:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00002000:00010000:0.0:1789579318.776666:0:25732:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:0.0:1789579318.776672:0:25732:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 1789579316 -> 1789579317 00002000:00010000:0.0:1789579318.776675:0:25732:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1789579316 -> 1789579317 00002000:00010000:0.0:1789579318.776677:0:25732:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:0.0:1789579318.776698:0:25732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003a9d201/0xd90373d592f22f8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.776723:0:25732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003a9d201/0xd90373d592f22f8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.776733:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003a9d201/0xd90373d592f22f8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.776757:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436600 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:0.0:1789579318.776763:0:25732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003a9d201/0xd90373d592f22f8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.776773:0:25732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003a9d201/0xd90373d592f22f8e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.776798:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003a9d201/0xd90373d592f22f8e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.776806:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003a9d201/0xd90373d592f22f8e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579318.776911:0:25732:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a10e13f9-13f2-441e-b716-61685111baf3+7:2395:x1876509261474688:12345-192.168.203.37@tcp:4:dd.0 Request processed in 92833us (94465us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1789579318.776921:0:25732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 1 00000001:00080000:1.0:1789579318.848734:0:24183:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00002000:00010000:0.0:1789579318.851500:0:24192:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:0.0:1789579318.851524:0:24192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d72b0f1/0xd90373d592f22f87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.851549:0:24192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d72b0f1/0xd90373d592f22f87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.851559:0:24192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d72b0f1/0xd90373d592f22f87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.851588:0:24192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394041db400 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:0.0:1789579318.851593:0:24192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d72b0f1/0xd90373d592f22f87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.851602:0:24192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d72b0f1/0xd90373d592f22f87 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.851623:0:24192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d72b0f1/0xd90373d592f22f87 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579318.851631:0:24192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d72b0f1/0xd90373d592f22f87 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579318.851745:0:24192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a10e13f9-13f2-441e-b716-61685111baf3+5:2394:x1876509261474560:12345-192.168.203.37@tcp:4:dd.0 Request processed in 174692us (174984us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1789579318.851755:0:24192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 0 00010000:00010000:2.0:1789579319.011524:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579320.036925:0:22669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579320.168127:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437205500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277297664:0@lo:400:kworker.0 00000100:00100000:0.0:1789579320.168127:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437206680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277297408:0@lo:400:kworker.0 00000100:00100000:1.0:1789579320.168198:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394091ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39addb08-5233-4b30-82ca-229405d26fae:3616:1876509277297280:0@lo:400:kworker.0 00000100:00100000:2.0:1789579320.168266:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579320.168299:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579320.168305:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437205c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277298176:0@lo:400:kworker.0 00000100:00100000:0.0:1789579320.168317:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277297920:0@lo:400:kworker.0 00000100:00100000:2.0:1789579320.168337:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579320.168337:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579320.168403:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277297408 00000100:00100000:0.0:1789579320.168410:0:22685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277297408 00000100:00100000:0.0:1789579320.168468:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277297920 00000100:00100000:0.0:1789579320.168503:0:22685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277297920 00000100:00100000:0.0:1789579320.168523:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789579320.168531:0:22685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277297408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579320.168601:0:22685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277297408:12345-0@lo:400:kworker.0 Request processed in 70us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579320.168609:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789579320.168626:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789579320.168633:0:22685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277297920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579320.168928:0:22685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277297920:12345-0@lo:400:kworker.0 Request processed in 26us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579320.168934:0:25077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277297664 00000100:00100000:0.0:1789579320.168939:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789579320.168941:0:25077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277297664 00000100:00100000:0.0:1789579320.168991:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437204e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277297536:0@lo:400:kworker.0 00000100:00100000:2.0:1789579320.169014:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277298688:0@lo:400:kworker.0 00000100:00100000:0.0:1789579320.169019:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579320.169073:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579320.169120:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277297920:0@lo:400:kworker.0 00000100:00100000:2.0:1789579320.169127:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876509277298432:0@lo:400:kworker.0 00000100:00100000:2.0:1789579320.169148:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579320.183188:0:25077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277298176 00000100:00100000:3.0:1789579320.183204:0:25077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277298176 00000100:00100000:3.0:1789579320.183234:0:24186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277297536 00000100:00100000:3.0:1789579320.183237:0:24186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277297536 00000100:00100000:3.0:1789579320.185083:0:24186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789579320.185099:0:24186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277297664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579320.185177:0:24186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277297664:12345-0@lo:400:kworker.0 Request processed in 83us (16910us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579320.185184:0:24186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789579320.185206:0:24186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789579320.185213:0:24186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437357800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277297536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579320.185234:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437207100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277298048:0@lo:400:kworker.0 00000100:00100000:0.0:1789579320.185276:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579320.185296:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876509277298560:0@lo:400:kworker.0 00000100:00100000:3.0:1789579320.185303:0:24186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437357800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277297536:12345-0@lo:400:kworker.0 Request processed in 88us (16280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579320.185309:0:24186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789579320.185321:0:24186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277298048 00000100:00100000:0.0:1789579320.185329:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579320.185346:0:24186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277298048 00000100:00100000:3.0:1789579320.185462:0:24186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789579320.185468:0:24186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437356d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277298048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579320.185502:0:24186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437356d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277298048:12345-0@lo:400:kworker.0 Request processed in 34us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579320.185520:0:24186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789579320.185544:0:24054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277298688 00000100:00100000:3.0:1789579320.185548:0:24054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277298688 00000100:00100000:3.0:1789579320.185577:0:24054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277298432 00000100:00100000:3.0:1789579320.185580:0:24054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277298432 00000100:00100000:3.0:1789579320.185596:0:24054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277298560 00000100:00100000:3.0:1789579320.185599:0:24054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277298560 00000100:00100000:3.0:1789579320.185614:0:24054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789579320.185620:0:24054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277298688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579320.185656:0:24054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277298688:12345-0@lo:400:kworker.0 Request processed in 36us (16583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579320.185661:0:24054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789579320.185672:0:24054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789579320.185677:0:24054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876509277298432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579320.185701:0:24054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876509277298432:12345-0@lo:400:kworker.0 Request processed in 25us (16554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579320.185707:0:24054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789579320.185717:0:24054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789579320.185723:0:24054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876509277298560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579320.185748:0:24054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876509277298560:12345-0@lo:400:kworker.0 Request processed in 26us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579320.185754:0:24054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789579320.185985:0:24186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789579320.185991:0:24186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277298176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579320.186027:0:24186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277298176:12345-0@lo:400:kworker.0 Request processed in 37us (17689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579320.186042:0:24186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789579320.186101:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277298688:0@lo:400:kworker.0 00000100:00100000:3.0:1789579320.186133:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437205500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277297664:0@lo:400:kworker.0 00000100:00100000:3.0:1789579320.186144:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437205c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277298176:0@lo:400:kworker.0 00000100:00100000:2.0:1789579320.186168:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876509277298432:0@lo:400:kworker.0 00000100:00080000:3.0:1789579320.186191:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789579320.186197:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789579320.186200:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789579320.186203:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437206680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277297408:0@lo:400:kworker.0 00000100:00080000:3.0:1789579320.186204:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789579320.186484:0:3618:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:0.0:1789579320.186490:0:3618:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff939303a30000, transno 12884901892 00000004:00080000:0.0:1789579320.186501:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:0.0:1789579320.186516:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437204e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277297536:0@lo:400:kworker.0 00000100:00100000:0.0:1789579320.186623:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437207100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277298048:0@lo:400:kworker.0 00010000:00080000:0.0:1789579320.186635:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939304334a80 x1876509277298560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579320.186644:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876509277298560:0@lo:400:kworker.0 00000100:00100000:0.0:1789579320.186766:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579320.186795:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277297280 00000100:00100000:0.0:1789579320.186801:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277297280 00000100:00100000:0.0:1789579320.186831:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789579320.186837:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303440850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+24:3616:x1876509277297280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579320.186870:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303440850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39addb08-5233-4b30-82ca-229405d26fae+24:3616:x1876509277297280:12345-0@lo:400:kworker.0 Request processed in 32us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579320.186876:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789579320.186918:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394091ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39addb08-5233-4b30-82ca-229405d26fae:3616:1876509277297280:0@lo:400:kworker.0 00000100:00100000:0.0:1789579320.186927:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437204a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277297792:0@lo:400:kworker.0 00000100:00100000:0.0:1789579320.186951:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579320.186973:0:24054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277297792 00000100:00100000:0.0:1789579320.186977:0:24054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277297792 00000100:00100000:0.0:1789579320.187000:0:24054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789579320.187007:0:24054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277297792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579320.187034:0:24054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277297792:12345-0@lo:400:kworker.0 Request processed in 28us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579320.187040:0:24054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789579320.187065:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437204a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277297792:0@lo:400:kworker.0 00000100:00100000:0.0:1789579320.187073:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437207b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876509277298304:0@lo:400:kworker.0 00000100:00100000:0.0:1789579320.187093:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579320.187113:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277298304 00000100:00100000:0.0:1789579320.187116:0:22681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277298304 00000100:00100000:0.0:1789579320.187139:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789579320.187144:0:22681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876509277298304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579320.187173:0:22681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876509277298304:12345-0@lo:400:kworker.0 Request processed in 28us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579320.187185:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789579320.187213:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437207b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876509277298304:0@lo:400:kworker.0 00000100:00100000:0.0:1789579320.187221:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876509277298816:0@lo:400:kworker.0 00000100:00100000:0.0:1789579320.187246:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579320.187264:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277298816 00000100:00100000:0.0:1789579320.187268:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277298816 00000100:00100000:0.0:1789579320.187332:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789579320.187338:0:22680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876509277298816:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789579320.187821:0:22676:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789579320.188471:0:22680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876509277298816:12345-0@lo:400:kworker.0 Request processed in 1129us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579320.188479:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:0.0:1789579320.188525:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939304335180 x1876509277298816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579320.188537:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876509277298816:0@lo:400:kworker.0 00000001:02000400:1.0:1789579320.320266:0:25769:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1789579321.059817:0:22668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579321.700458:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789579321.700482:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277298944:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789579321.700551:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579321.700597:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277298944 00000100:00100000:0.0:1789579321.700604:0:22685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277298944 00000100:00100000:0.0:1789579321.700649:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789579321.700657:0:22685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277298944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789579321.700702:0:22685:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:0.0:1789579321.700746:0:22685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277298944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579321.700769:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789579321.700817:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277298944:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789579321.701849:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789579321.701861:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277299072:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789579321.701913:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579321.702128:0:22686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277299072 00000100:00100000:2.0:1789579321.702134:0:22686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277299072 00000100:00100000:2.0:1789579321.702164:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789579321.702172:0:22686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277299072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789579321.702426:0:22686:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789579321.702473:0:22686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277299072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 302us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579321.702481:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789579321.702521:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277299072:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789579321.702799:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277299200:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789579321.702833:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579321.702881:0:24190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277299200 00000100:00100000:3.0:1789579321.702886:0:24190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277299200 00000100:00100000:3.0:1789579321.702915:0:24190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789579321.702924:0:24190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304337b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277299200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789579321.702953:0:24190:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1789579321.702994:0:24190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304337b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277299200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579321.703004:0:24190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789579321.703038:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277299200:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789579322.087433:0:25081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 13989 lines, 13989 kept, 0 dropped, 0 bad.