00000100:00100000:3.0F:1790772436.334984:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772436.335060:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772436.335107:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772436.335130:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772436.335152:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772436.335215:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772436.335235:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772436.335257:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772436.335284:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772436.335331:0:17193:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481045760 00000100:00100000:3.0:1790772436.335342:0:17193:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481045760 00000100:00100000:3.0:1790772436.335423:0:17193:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481046272 00000100:00100000:3.0:1790772436.335427:0:17193:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481046272 00000100:00100000:3.0:1790772436.335445:0:17193:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481045632 00000100:00100000:3.0:1790772436.335447:0:17193:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481045632 00000100:00100000:3.0:1790772436.335463:0:17193:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481046144 00000100:00100000:3.0:1790772436.335466:0:17193:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481046144 00000100:00100000:3.0:1790772436.335499:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 68 00000100:00100000:3.0:1790772436.335510:0:17193:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc308dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6fc10b0-a0f6-4852-8b53-26173a9eb237+5:2393:x1877760481045760:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1790772436.335604:0:17193:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc308dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6fc10b0-a0f6-4852-8b53-26173a9eb237+5:2393:x1877760481045760:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 96us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772436.335614:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 68 00000100:00100000:3.0:1790772436.335635:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 69 00000100:00100000:3.0:1790772436.335642:0:17193:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc308ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5087553-5805-43ba-a063-2c518ab209a7+5:2393:x1877760481046272:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1790772436.335670:0:17193:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc308ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5087553-5805-43ba-a063-2c518ab209a7+5:2393:x1877760481046272:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 29us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772436.335678:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 69 00000100:00100000:3.0:1790772436.335691:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 70 00000100:00100000:3.0:1790772436.335696:0:17193:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc308d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6fc10b0-a0f6-4852-8b53-26173a9eb237+22:2393:x1877760481045632:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1790772436.335738:0:17193:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc308d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6fc10b0-a0f6-4852-8b53-26173a9eb237+22:2393:x1877760481045632:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 42us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772436.335745:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 70 00000100:00100000:3.0:1790772436.335761:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 71 00000100:00100000:3.0:1790772436.335767:0:17193:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc308c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5087553-5805-43ba-a063-2c518ab209a7+6:2393:x1877760481046144:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1790772436.335795:0:17193:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc308c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5087553-5805-43ba-a063-2c518ab209a7+6:2393:x1877760481046144:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 28us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772436.335800:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 71 00000100:00100000:3.0:1790772436.335819:0:19248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481046016 00000100:00100000:3.0:1790772436.335823:0:19248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481046016 00000100:00100000:3.0:1790772436.335852:0:19248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481046528 00000100:00100000:3.0:1790772436.335855:0:19248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481046528 00000100:00100000:3.0:1790772436.335873:0:19248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481045888 00000100:00100000:3.0:1790772436.335875:0:19248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481045888 00000100:00100000:3.0:1790772436.335889:0:19248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481046400 00000100:00100000:3.0:1790772436.335892:0:19248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481046400 00000100:00100000:3.0:1790772436.335907:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 29 00000100:00100000:3.0:1790772436.335914:0:19248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc308f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f6fc10b0-a0f6-4852-8b53-26173a9eb237+5:2393:x1877760481046016:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1790772436.335945:0:19248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc308f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f6fc10b0-a0f6-4852-8b53-26173a9eb237+5:2393:x1877760481046016:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 30us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772436.335951:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 29 00000100:00100000:3.0:1790772436.335964:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 30 00000100:00100000:3.0:1790772436.335970:0:19248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc308d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5087553-5805-43ba-a063-2c518ab209a7+5:2393:x1877760481046528:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1790772436.335995:0:19248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc308d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5087553-5805-43ba-a063-2c518ab209a7+5:2393:x1877760481046528:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 26us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772436.336013:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 30 00000100:00100000:3.0:1790772436.336026:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 31 00000100:00100000:3.0:1790772436.336032:0:19248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc308fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f6fc10b0-a0f6-4852-8b53-26173a9eb237+5:2393:x1877760481045888:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1790772436.336059:0:19248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc308fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f6fc10b0-a0f6-4852-8b53-26173a9eb237+5:2393:x1877760481045888:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 27us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772436.336066:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 31 00000100:00100000:3.0:1790772436.336077:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 32 00000100:00100000:3.0:1790772436.336084:0:19248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc308f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5087553-5805-43ba-a063-2c518ab209a7+5:2393:x1877760481046400:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1790772436.336107:0:19248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc308f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5087553-5805-43ba-a063-2c518ab209a7+5:2393:x1877760481046400:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 23us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772436.336114:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 32 00000100:00080000:3.0:1790772436.336148:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790772436.336153:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790772436.336156:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790772436.336159:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0F:1790772436.336851:0:17186:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481045504 00000100:00100000:0.0:1790772436.336868:0:17186:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481045504 00000100:00100000:0.0:1790772436.336922:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 167 00000100:00100000:0.0:1790772436.336930:0:17186:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdefc1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a49d2df-ad4f-4a29-bdf0-60f3d602d0d1+13:2393:x1877760481045504:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:0.0:1790772436.336980:0:17186:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdefc1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a49d2df-ad4f-4a29-bdf0-60f3d602d0d1+13:2393:x1877760481045504:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 51us (2011us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772436.336986:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 167 00000100:00100000:3.0:1790772436.756573:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1877760506289280:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790772436.756642:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772436.758489:0:18700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506289280 00000100:00100000:3.0:1790772436.758502:0:18700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506289280 00000100:00100000:3.0:1790772436.758570:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790772436.758579:0:18700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc308d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1877760506289280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790772436.758610:0:18700:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1790772436.758676:0:18700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc308d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1877760506289280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (2034us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772436.758683:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1790772436.758717:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790772436.758754:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1877760506289280:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0F:1790772436.762113:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0F:1790772437.269300:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506289408:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790772437.269394:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772437.269462:0:17197:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506289408 00000100:00100000:2.0:1790772437.269469:0:17197:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506289408 00000100:00100000:2.0:1790772437.271558:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790772437.271575:0:17197:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc35a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506289408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790772437.271614:0:17197:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1790772437.271680:0:17197:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc35a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506289408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (2286us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772437.271687:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790772437.271892:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1877760506289536:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790772437.272076:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772437.272452:0:17197:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506289536 00000100:00100000:0.0:1790772437.272459:0:17197:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506289536 00000100:00100000:0.0:1790772437.272490:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790772437.272497:0:17197:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf8093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877760506289536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790772437.272520:0:17197:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790772437.272561:0:17197:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf8093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877760506289536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772437.272567:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790772437.272634:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1877760506289536:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790772437.272666:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506289408:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1790772437.791911:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790772438.488206:0:17944:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790772438.805280:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506289664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790772438.805358:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772438.805425:0:19986:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506289664 00000100:00100000:0.0:1790772438.805432:0:19986:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506289664 00000100:00100000:0.0:1790772438.805485:0:19986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790772438.805494:0:19986:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeec53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1877760506289664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790772438.805522:0:19986:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1790772438.805568:0:19986:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeec53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1877760506289664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772438.805575:0:19986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790772438.805621:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506289664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790772438.808453:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3e93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1877760506290176:0@lo:400:kworker.0 00000100:00100000:1.0:1790772438.808516:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772438.808548:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc440d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1877760506290688:0@lo:400:kworker.0 00000100:00100000:1.0:1790772438.808571:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772438.808588:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3cb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1877760506291200:0@lo:400:kworker.0 00000100:00100000:1.0:1790772438.808609:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772438.808632:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1790772438.808638:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e96364ee-79c0-4114-891b-7127f484e910:3645:1877760506289792:0@lo:400:kworker.0 00000100:00100000:1.0:1790772438.808666:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772438.808692:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdfaa85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506290304:0@lo:400:kworker.0 00000100:00100000:1.0:1790772438.808715:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772438.808734:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc440ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1877760506290816:0@lo:400:kworker.0 00000100:00100000:1.0:1790772438.808755:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772438.808772:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3cb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506291328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790772438.808810:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772438.808846:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1877760506289920:0@lo:400:kworker.0 00000100:00100000:1.0:1790772438.808870:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772438.808886:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdfaa85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506290432:0@lo:400:kworker.0 00000100:00100000:1.0:1790772438.808907:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772438.808932:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc440ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1877760506290944:0@lo:400:kworker.0 00000100:00100000:1.0:1790772438.808953:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772438.808972:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1790772438.808978:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1877760506290048:0@lo:400:kworker.0 00000100:00100000:1.0:1790772438.808998:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772438.809016:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdfaa87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506290560:0@lo:400:kworker.0 00000100:00100000:1.0:1790772438.809035:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772438.809052:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3cb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1877760506291072:0@lo:400:kworker.0 00000100:00100000:1.0:1790772438.809072:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790772438.809094:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772438.809106:0:17193:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506290176 00000100:00100000:1.0:1790772438.809112:0:17193:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506290176 00000100:00100000:1.0:1790772438.809144:0:17193:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506290688 00000100:00100000:1.0:1790772438.809147:0:17193:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506290688 00000100:00100000:1.0:1790772438.809157:0:17193:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506291200 00000100:00100000:1.0:1790772438.809160:0:17193:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506291200 00000100:00100000:1.0:1790772438.809193:0:17193:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506290816 00000100:00100000:1.0:1790772438.809196:0:17193:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506290816 00000100:00100000:1.0:1790772438.809206:0:17193:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506290944 00000100:00100000:1.0:1790772438.809208:0:17193:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506290944 00000100:00100000:1.0:1790772438.809220:0:17193:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506291072 00000100:00100000:1.0:1790772438.809222:0:17193:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506291072 00000100:00100000:1.0:1790772438.809235:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790772438.809242:0:17193:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1877760506290176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772438.809294:0:17193:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1877760506290176:12345-0@lo:400:kworker.0 Request processed in 51us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772438.809301:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790772438.809318:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790772438.809324:0:17193:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3cb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1877760506290688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772438.809372:0:17193:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3cb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1877760506290688:12345-0@lo:400:kworker.0 Request processed in 48us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772438.809379:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790772438.809393:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790772438.809399:0:17193:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1877760506291200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772438.809425:0:17193:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1877760506291200:12345-0@lo:400:kworker.0 Request processed in 28us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772438.809431:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790772438.809442:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790772438.809448:0:17193:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc23ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1877760506290816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772438.809474:0:17193:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc23ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1877760506290816:12345-0@lo:400:kworker.0 Request processed in 27us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772438.809479:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790772438.809490:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790772438.809496:0:17193:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc369c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877760506290944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772438.809527:0:17193:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc369c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877760506290944:12345-0@lo:400:kworker.0 Request processed in 32us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772438.809533:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790772438.809545:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790772438.809551:0:17193:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc369e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1877760506291072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772438.809577:0:17193:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc369e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1877760506291072:12345-0@lo:400:kworker.0 Request processed in 27us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772438.809583:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790772438.809609:0:17187:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506289792 00000100:00100000:1.0:1790772438.809612:0:17187:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506289792 00000100:00100000:1.0:1790772438.809647:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1790772438.809653:0:17187:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdefc1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e96364ee-79c0-4114-891b-7127f484e910+24:3645:x1877760506289792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772438.809685:0:17187:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdefc1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e96364ee-79c0-4114-891b-7127f484e910+24:3645:x1877760506289792:12345-0@lo:400:kworker.0 Request processed in 32us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772438.809691:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1790772438.809717:0:17197:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506290304 00000100:00100000:1.0:1790772438.809721:0:17197:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506290304 00000100:00100000:1.0:1790772438.809736:0:17197:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506289920 00000100:00100000:1.0:1790772438.809739:0:17197:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506289920 00000100:00100000:1.0:1790772438.809750:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790772438.809756:0:17197:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc23e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506290304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772438.809788:0:17197:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc23e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506290304:12345-0@lo:400:kworker.0 Request processed in 32us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772438.809795:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790772438.809806:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790772438.809812:0:17197:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc23e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1877760506289920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772438.809840:0:17197:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc23e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1877760506289920:12345-0@lo:400:kworker.0 Request processed in 28us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772438.809845:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790772438.809866:0:18700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506291328 00000100:00100000:1.0:1790772438.809869:0:18700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506291328 00000100:00100000:1.0:1790772438.809894:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790772438.809901:0:18700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc23ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506291328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790772438.809921:0:18700:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1790772438.809953:0:18700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc23ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506291328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772438.809959:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790772438.809985:0:19248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506290432 00000100:00100000:1.0:1790772438.809989:0:19248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506290432 00000100:00100000:1.0:1790772438.810021:0:19248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506290048 00000100:00100000:1.0:1790772438.810024:0:19248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506290048 00000100:00100000:1.0:1790772438.810042:0:19248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506290560 00000100:00100000:1.0:1790772438.810044:0:19248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506290560 00000100:00100000:1.0:1790772438.810058:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790772438.810065:0:19248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc369ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506290432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772438.810098:0:19248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc369ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506290432:12345-0@lo:400:kworker.0 Request processed in 34us (1190us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772438.810104:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790772438.810119:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790772438.810125:0:19248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc369c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1877760506290048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772438.810153:0:19248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc369c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1877760506290048:12345-0@lo:400:kworker.0 Request processed in 29us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772438.810159:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790772438.810195:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790772438.810202:0:19248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc369dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506290560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772438.810232:0:19248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc369dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506290560:12345-0@lo:400:kworker.0 Request processed in 32us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772438.810238:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790772438.810284:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e96364ee-79c0-4114-891b-7127f484e910:3645:1877760506289792:0@lo:400:kworker.0 00000100:00100000:1.0:1790772438.810297:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdfaa85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506290304:0@lo:400:kworker.0 00000100:00100000:1.0:1790772438.810309:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc440ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1877760506290816:0@lo:400:kworker.0 00000100:00100000:1.0:1790772438.810325:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3cb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506291328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790772438.810361:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3e93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1877760506290176:0@lo:400:kworker.0 00000100:00100000:1.0:1790772438.810373:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc440d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1877760506290688:0@lo:400:kworker.0 00010000:00080000:1.0:1790772438.810384:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9eccc3cb6a00 x1877760506291200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772438.810394:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3cb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1877760506291200:0@lo:400:kworker.0 00000100:00100000:1.0:1790772438.810452:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1877760506290048:0@lo:400:kworker.0 00000100:00100000:1.0:1790772438.810461:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdfaa87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506290560:0@lo:400:kworker.0 00000100:00100000:1.0:1790772438.810469:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3cb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1877760506291072:0@lo:400:kworker.0 00000100:00100000:1.0:1790772438.810482:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1877760506289920:0@lo:400:kworker.0 00000100:00100000:1.0:1790772438.810490:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdfaa85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506290432:0@lo:400:kworker.0 00010000:00080000:1.0:1790772438.810499:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9eccc440ca80 x1877760506290944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772438.810507:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc440ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1877760506290944:0@lo:400:kworker.0 00000100:00080000:3.0:1790772438.815992:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790772438.816002:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790772438.816005:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790772438.816007:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790772438.816675:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790772438.816700:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1877760506291456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790772438.817760:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772438.820272:0:19986:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506291456 00000100:00100000:3.0:1790772438.820283:0:19986:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506291456 00000100:00100000:3.0:1790772438.820387:0:19986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790772438.820398:0:19986:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc369d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877760506291456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790772438.820422:0:19986:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1790772438.820496:0:19986:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc369d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877760506291456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (2738us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772438.820503:0:19986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790772438.822073:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1877760506291456:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1790772438.822519:0:17172:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:1.0:1790772438.822531:0:17172:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ecde012b000 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:1.0:1790772438.822536:0:17172:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ecdfbab6600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ecde012b300 00000020:00080000:1.0:1790772438.822547:0:17172:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ecdfbab6100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9eccc2445e00 00010000:00010000:1.0:1790772438.822584:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdc29cd200/0x418ffb1c3bcc93bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772438.822594:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdc29cd200/0x418ffb1c3bcc93bb lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772438.822602:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdc29cd200/0x418ffb1c3bcc93bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772438.822607:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdc29cd200 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:1.0:1790772438.822612:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdc29cd200/0x418ffb1c3bcc93bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772438.822620:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdc29cd200/0x418ffb1c3bcc93bb lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772438.822634:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ecdfbacd700) 00010000:00010000:1.0:1790772438.822637:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772438.822641:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdc29cd200/0x418ffb1c3bcc93bb lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772438.822647:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdc29cd200/0x418ffb1c3bcc93bb lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1790772438.824537:0:17231:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:0.0:1790772438.824606:0:17231:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:0.0:1790772438.961384:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1790772438.961420:0:17193:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481046656 00000100:00100000:0.0:1790772438.961428:0:17193:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481046656 00000100:00100000:0.0:1790772438.961481:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 65 00000100:00100000:0.0:1790772438.961490:0:17193:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeec53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6fc10b0-a0f6-4852-8b53-26173a9eb237+13:15549:x1877760481046656:12345-192.168.206.14@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1790772438.961583:0:17193:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeec53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6fc10b0-a0f6-4852-8b53-26173a9eb237+13:15549:x1877760481046656:12345-192.168.206.14@tcp:60:lhsmtool_posix.0 Request processed in 93us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772438.961591:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 65 00000100:00080000:3.0:1790772438.961877:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772438.992773:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772438.993955:0:19816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481046784 00000100:00100000:2.0:1790772438.993967:0:19816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481046784 00000100:00100000:2.0:1790772438.994032:0:19816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 66 00000100:00100000:2.0:1790772438.994041:0:19816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeec50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f6fc10b0-a0f6-4852-8b53-26173a9eb237+5:15549:x1877760481046784:12345-192.168.206.14@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1790772438.994145:0:19816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeec50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f6fc10b0-a0f6-4852-8b53-26173a9eb237+5:15549:x1877760481046784:12345-192.168.206.14@tcp:60:lhsmtool_posix.0 Request processed in 104us (1382us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772438.994153:0:19816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 66 00000100:00080000:2.0:1790772438.994196:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790772439.010592:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1790772439.010652:0:17195:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481047040 00000100:00100000:0.0:1790772439.010661:0:17195:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481047040 00000100:00100000:0.0:1790772439.010722:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 12 00000100:00100000:0.0:1790772439.010733:0:17195:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc308c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f6fc10b0-a0f6-4852-8b53-26173a9eb237+13:15549:x1877760481047040:12345-192.168.206.14@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790772439.011083:0:17195:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc308c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f6fc10b0-a0f6-4852-8b53-26173a9eb237+14:15549:x1877760481047040:12345-192.168.206.14@tcp:35:lhsmtool_posix.0 Request processed in 351us (509us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1790772439.011091:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 12 00010000:00010000:3.0:1790772439.828601:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772440.855076:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790772440.904352:0:20569:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 08:47:18 (1790772438) 00000100:00100000:2.0:1790772441.455716:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772441.455770:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772441.455874:0:17194:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481047296 00000100:00100000:1.0:1790772441.455884:0:17194:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481047296 00000100:00100000:1.0:1790772441.455962:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 78 00000100:00100000:1.0:1790772441.455973:0:17194:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc35a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6fc10b0-a0f6-4852-8b53-26173a9eb237+14:2390:x1877760481047296:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1790772441.456495:0:17194:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc35a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6fc10b0-a0f6-4852-8b53-26173a9eb237+14:2390:x1877760481047296:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 524us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772441.456503:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 78 00000100:00080000:2.0:1790772441.456949:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772441.457009:0:17185:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481047168 00000100:00100000:0.0:1790772441.457015:0:17185:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481047168 00000100:00100000:0.0:1790772441.457062:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 169 00000100:00100000:0.0:1790772441.457069:0:17185:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdefc18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a49d2df-ad4f-4a29-bdf0-60f3d602d0d1+13:2390:x1877760481047168:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:0.0:1790772441.457115:0:17185:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdefc18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a49d2df-ad4f-4a29-bdf0-60f3d602d0d1+13:2390:x1877760481047168:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 46us (1410us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772441.457121:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 169 00000100:00100000:2.0:1790772441.458983:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772441.459030:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772441.459196:0:19248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481047552 00000100:00100000:1.0:1790772441.459205:0:19248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481047552 00000100:00100000:1.0:1790772441.459259:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 36 00000100:00100000:1.0:1790772441.459268:0:19248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc35a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f6fc10b0-a0f6-4852-8b53-26173a9eb237+5:2391:x1877760481047552:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1790772441.459342:0:19248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc35a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f6fc10b0-a0f6-4852-8b53-26173a9eb237+5:2391:x1877760481047552:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 63us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772441.459349:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 36 00000100:00080000:2.0:1790772441.459409:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790772441.459949:0:17192:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481047424 00000100:00100000:0.0:1790772441.459955:0:17192:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481047424 00000100:00100000:0.0:1790772441.460014:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 79 00000100:00100000:0.0:1790772441.460022:0:17192:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc35a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6fc10b0-a0f6-4852-8b53-26173a9eb237+5:2391:x1877760481047424:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:0.0:1790772441.460078:0:17192:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc35a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6fc10b0-a0f6-4852-8b53-26173a9eb237+5:2391:x1877760481047424:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 57us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772441.460085:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 79 00000100:00080000:2.0:1790772441.460150:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790772441.470145:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772441.470222:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772441.470271:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772441.470376:0:18466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481047936 00000100:00100000:3.0:1790772441.470385:0:18466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481047936 00000100:00100000:3.0:1790772441.470451:0:18466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481047808 00000100:00100000:3.0:1790772441.470454:0:18466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481047808 00000100:00100000:3.0:1790772441.470478:0:18466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 80 00000100:00100000:3.0:1790772441.470486:0:18466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc35a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5087553-5805-43ba-a063-2c518ab209a7+5:2391:x1877760481047936:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1790772441.470553:0:18466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc35a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5087553-5805-43ba-a063-2c518ab209a7+5:2391:x1877760481047936:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 67us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772441.470559:0:18466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 80 00000100:00100000:3.0:1790772441.470577:0:18466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 81 00000100:00100000:3.0:1790772441.470591:0:18466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc35a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5087553-5805-43ba-a063-2c518ab209a7+6:2391:x1877760481047808:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1790772441.470633:0:18466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc35a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5087553-5805-43ba-a063-2c518ab209a7+6:2391:x1877760481047808:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 43us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772441.470639:0:18466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 81 00000100:00080000:2.0:1790772441.472634:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790772441.472643:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790772441.472727:0:18698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481047680 00000100:00100000:1.0:1790772441.472735:0:18698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481047680 00000100:00100000:1.0:1790772441.472804:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 27 00000100:00100000:1.0:1790772441.472827:0:18698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc35a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f6fc10b0-a0f6-4852-8b53-26173a9eb237+5:2389:x1877760481047680:12345-192.168.206.14@tcp:9:kworker.0 00000020:00000080:1.0:1790772441.472855:0:18698:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc90f1 00000100:00080000:1.0:1790772441.472872:0:18698:0:(import.c:65:import_set_state_nolock()) ffff9ecdef355800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790772441.472916:0:18698:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1790772441.473066:0:18698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc35a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f6fc10b0-a0f6-4852-8b53-26173a9eb237+2:2389:x1877760481047680:12345-192.168.206.14@tcp:9:kworker.0 Request processed in 243us (2928us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772441.473073:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 27 00000100:00080000:2.0:1790772441.473527:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1790772441.473785:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772441.480285:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772441.480711:0:18697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481048064 00000100:00100000:3.0:1790772441.480720:0:18697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481048064 00000100:00100000:3.0:1790772441.480790:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 28 00000100:00100000:3.0:1790772441.480801:0:18697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc35a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5087553-5805-43ba-a063-2c518ab209a7+5:2389:x1877760481048064:12345-192.168.206.14@tcp:9:kworker.0 00000020:00000080:3.0:1790772441.480840:0:18697:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc9129 00000100:00080000:3.0:1790772441.480857:0:18697:0:(import.c:65:import_set_state_nolock()) ffff9eccc33f1000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790772441.480899:0:18697:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1790772441.481043:0:18697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc35a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5087553-5805-43ba-a063-2c518ab209a7+2:2389:x1877760481048064:12345-192.168.206.14@tcp:9:kworker.0 Request processed in 244us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772441.481051:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 28 00010000:00010000:1.0:1790772441.481302:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790772441.481609:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790772441.484618:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772441.484904:0:18699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481048192 00000100:00100000:1.0:1790772441.484913:0:18699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481048192 00000100:00100000:1.0:1790772441.484982:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 29 00000100:00100000:1.0:1790772441.484992:0:18699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc308e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5087553-5805-43ba-a063-2c518ab209a7+5:2389:x1877760481048192:12345-192.168.206.14@tcp:9:kworker.0 00000020:00000080:1.0:1790772441.485044:0:18699:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc9130 00000100:00080000:1.0:1790772441.485053:0:18699:0:(import.c:65:import_set_state_nolock()) ffff9ecdef375800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790772441.485107:0:18699:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1790772441.485266:0:18699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc308e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5087553-5805-43ba-a063-2c518ab209a7+2:2389:x1877760481048192:12345-192.168.206.14@tcp:9:kworker.0 Request processed in 275us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772441.485273:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 29 00000100:00080000:2.0:1790772441.485443:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1790772441.485908:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772441.876783:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772441.876901:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc369d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1877760506291584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790772441.876971:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772441.878541:0:18700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506291584 00000100:00100000:1.0:1790772441.878553:0:18700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506291584 00000100:00100000:1.0:1790772441.878646:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790772441.878656:0:18700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc35a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877760506291584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790772441.878685:0:18700:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1790772441.878755:0:18700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc35a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877760506291584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (1783us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772441.878762:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790772441.878811:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc369d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1877760506291584:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1790772441.879760:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790772442.390363:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc308c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506291712:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790772442.390474:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772442.390649:0:17197:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506291712 00000100:00100000:3.0:1790772442.390657:0:17197:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506291712 00000100:00100000:3.0:1790772442.390707:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790772442.390715:0:17197:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc35a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1877760506291712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790772442.390748:0:17197:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790772442.390828:0:17197:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc35a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1877760506291712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772442.390835:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790772442.392264:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc308c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506291712:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790772442.392289:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790772442.392298:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506291840:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790772442.392378:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772442.392413:0:17197:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506291840 00000100:00100000:2.0:1790772442.392418:0:17197:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506291840 00000100:00100000:2.0:1790772442.392450:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790772442.392457:0:17197:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc35a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506291840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790772442.392483:0:17197:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1790772442.392520:0:17197:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc35a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506291840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772442.392526:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790772442.392558:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506291840:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1790772442.901986:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790772443.733143:0:17227:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790772443.733153:0:17227:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790772443.733254:0:17227:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1790772443.733279:0:17227:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1790772443.855619:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1790772443.855870:0:17195:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481048448 00000100:00100000:0.0:1790772443.855881:0:17195:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481048448 00000100:00100000:0.0:1790772443.855973:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 13 00000100:00100000:0.0:1790772443.855987:0:17195:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc308ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f6fc10b0-a0f6-4852-8b53-26173a9eb237+14:16302:x1877760481048448:12345-192.168.206.14@tcp:35:umount.0 00000100:00080000:2.0:1790772443.855991:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1790772443.858697:0:17195:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1790772443.859244:0:17195:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:1.0:1790772443.861896:0:17172:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934624 is committed 00000020:00080000:1.0:1790772443.861916:0:17172:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:2.0:1790772443.861996:0:17231:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:2.0:1790772443.862009:0:17231:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000100:00100000:0.0:1790772443.863209:0:17195:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc308ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f6fc10b0-a0f6-4852-8b53-26173a9eb237+15:16302:x1877760481048448:12345-192.168.206.14@tcp:35:umount.0 Request processed in 7211us (7587us total) trans 8589934626 rc 0/0 00000100:00100000:0.0:1790772443.863227:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 13 00000020:00080000:0.0:1790772443.863237:0:17195:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1790772443.870441:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772443.870477:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772443.870514:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772443.870593:0:17178:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481048576 00000100:00100000:3.0:1790772443.870602:0:17178:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481048576 00000100:00100000:3.0:1790772443.870692:0:17178:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481048832 00000100:00100000:3.0:1790772443.870696:0:17178:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481048832 00000100:00100000:3.0:1790772443.870709:0:17178:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481048704 00000100:00100000:3.0:1790772443.870712:0:17178:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481048704 00000100:00100000:3.0:1790772443.870725:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 3 00000100:00100000:3.0:1790772443.870732:0:17178:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc35a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a49d2df-ad4f-4a29-bdf0-60f3d602d0d1+15:2392:x1877760481048576:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772443.870746:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772443.870778:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eccc3560000/0x418ffb1c3bcc90c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753852 expref: 15 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772443.870796:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772443.871034:0:17178:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc35a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a49d2df-ad4f-4a29-bdf0-60f3d602d0d1+14:2392:x1877760481048576:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 300us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772443.871042:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 3 00000100:00100000:3.0:1790772443.871060:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 4 00000100:00100000:3.0:1790772443.871066:0:17178:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff74b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a49d2df-ad4f-4a29-bdf0-60f3d602d0d1+13:2392:x1877760481048832:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772443.871073:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772443.871082:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ecdd1ad1800/0x418ffb1c3bcc918b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753939 expref: 13 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772443.871090:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772443.871107:0:17178:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff74b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a49d2df-ad4f-4a29-bdf0-60f3d602d0d1+12:2392:x1877760481048832:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 42us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772443.871112:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 4 00000100:00100000:3.0:1790772443.871124:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 5 00000100:00100000:3.0:1790772443.871142:0:17178:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc32c7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a49d2df-ad4f-4a29-bdf0-60f3d602d0d1+11:2392:x1877760481048704:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772443.871150:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772443.871158:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ecdc29ccc00/0x418ffb1c3bcc90ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753883 expref: 11 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772443.871216:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772443.871237:0:17178:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc32c7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a49d2df-ad4f-4a29-bdf0-60f3d602d0d1+10:2392:x1877760481048704:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 95us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772443.871243:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 5 00000100:00100000:2.0:1790772443.872683:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772443.872881:0:19556:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481048960 00000100:00100000:3.0:1790772443.872888:0:19556:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481048960 00000100:00100000:3.0:1790772443.872952:0:19556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 30 00000100:00100000:3.0:1790772443.872960:0:19556:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f6fc10b0-a0f6-4852-8b53-26173a9eb237+5:2389:x1877760481048960:12345-192.168.206.14@tcp:9:umount.0 00000020:00000080:3.0:1790772443.872992:0:19556:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc90ea 00000100:00080000:3.0:1790772443.873001:0:19556:0:(import.c:65:import_set_state_nolock()) ffff9ecdef350800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790772443.873049:0:19556:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1790772443.873162:0:19556:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f6fc10b0-a0f6-4852-8b53-26173a9eb237+2:2389:x1877760481048960:12345-192.168.206.14@tcp:9:umount.0 Request processed in 203us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772443.873197:0:19556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 30 00010000:00010000:3.0:1790772443.873214:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790772443.873294:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790772443.884732:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772443.885026:0:19816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481049856 00000100:00100000:1.0:1790772443.885035:0:19816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481049856 00000100:00100000:1.0:1790772443.885093:0:19816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 67 00000100:00100000:1.0:1790772443.885102:0:19816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f6fc10b0-a0f6-4852-8b53-26173a9eb237+15:2389:x1877760481049856:12345-192.168.206.14@tcp:39:umount.0 00000020:00000080:1.0:1790772443.885134:0:19816:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc90dc 00000020:00010000:1.0:1790772443.885149:0:19816:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9eccc24e9000: total 0 00000100:00080000:1.0:1790772443.885154:0:19816:0:(import.c:65:import_set_state_nolock()) ffff9eccc24ee000 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1790772443.885345:0:17181:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9eccc24e9000: total 0 00010000:00010000:0.0:1790772443.885393:0:17181:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9eccc24e9000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1790772443.885428:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eccc239e400) 00010000:00010000:0.0:1790772443.885432:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772443.885439:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdc29cc600/0x418ffb1c3bcc91c3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753947 expref: 14 pid: 18466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772443.885508:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ecdfbacdf00) 00010000:00010000:0.0:1790772443.885511:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790772443.885517:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdc29cca00/0x418ffb1c3bcc9305 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x42c6e081687539a9 expref: 13 pid: 18466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772443.885534:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ecdfbacde00) 00010000:00010000:0.0:1790772443.885536:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790772443.885540:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560600/0x418ffb1c3bcc9202 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753955 expref: 12 pid: 18466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772443.885554:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ecdfbacd700) 00010000:00010000:0.0:1790772443.885556:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790772443.885560:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdfbab0c00/0x418ffb1c3bcc9391 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x42c6e081687539d3 expref: 11 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772443.885575:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ecdfbacdf00) 00010000:00010000:0.0:1790772443.885577:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790772443.885581:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdfbab1600/0x418ffb1c3bcc93ec lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x42c6e081687539ef expref: 10 pid: 19816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772443.885595:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9eccc27f0c00) 00010000:00010000:0.0:1790772443.885597:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790772443.885601:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdd1ad1e00/0x418ffb1c3bcc91a7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753940 expref: 9 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772443.885632:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9eccc27f0700) 00010000:00010000:0.0:1790772443.885640:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790772443.885645:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd8000/0x418ffb1c3bcc9287 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x42c6e0816875397f expref: 8 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1790772443.887968:0:19816:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:1.0:1790772443.888214:0:19816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f6fc10b0-a0f6-4852-8b53-26173a9eb237+7:2389:x1877760481049856:12345-192.168.206.14@tcp:39:umount.0 Request processed in 3108us (3485us total) trans 8589934627 rc 0/0 00000100:00100000:1.0:1790772443.888225:0:19816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 67 00010000:00010000:0.0:1790772443.889139:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ecdfbacdf00) 00010000:00010000:0.0:1790772443.889144:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790772443.889152:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdc29cdc00/0x418ffb1c3bcc9336 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x42c6e081687539be expref: 6 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772443.889197:0:17181:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9eccc24e9000, canceled 8 locks, left on hash table 0. 00010000:00010000:0.0:1790772443.889227:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772443.889229:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772443.889231:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772443.899575:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772443.899691:0:17192:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481049984 00000100:00100000:3.0:1790772443.899702:0:17192:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481049984 00000100:00100000:3.0:1790772443.899773:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 68 00000100:00100000:3.0:1790772443.899782:0:17192:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff74bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6fc10b0-a0f6-4852-8b53-26173a9eb237+5:2389:x1877760481049984:12345-192.168.206.14@tcp:39:umount.0 00000020:00000080:3.0:1790772443.899819:0:17192:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc90e3 00000100:00080000:3.0:1790772443.899834:0:17192:0:(import.c:65:import_set_state_nolock()) ffff9eccc24e8000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790772443.899861:0:17192:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1790772443.900048:0:17192:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff74bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6fc10b0-a0f6-4852-8b53-26173a9eb237+3:2389:x1877760481049984:12345-192.168.206.14@tcp:39:umount.0 Request processed in 267us (480us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1790772443.900056:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 68 00010000:00010000:0.0:1790772443.900197:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790772443.900574:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790772443.924682:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1877760506291968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790772443.924784:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772443.925108:0:19986:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506291968 00000100:00100000:0.0:1790772443.925117:0:19986:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506291968 00000100:00100000:0.0:1790772443.925273:0:19986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790772443.925282:0:19986:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc308c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1877760506291968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790772443.925311:0:19986:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1790772443.925371:0:19986:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc308c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1877760506291968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772443.925378:0:19986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1790772443.925444:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790772443.925591:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc369d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1877760506292096:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790772443.925622:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772443.925658:0:18700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506292096 00000100:00100000:1.0:1790772443.925662:0:18700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506292096 00000100:00100000:1.0:1790772443.925689:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790772443.925696:0:18700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3e93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877760506292096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790772443.925710:0:18700:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790772443.925964:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdff74b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506292224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790772443.925993:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790772443.926026:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790772443.926034:0:19986:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506292224 00000100:00100000:2.0:1790772443.926037:0:19986:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506292224 00000100:00100000:2.0:1790772443.926060:0:19986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790772443.926065:0:19986:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf80e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1877760506292224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790772443.926074:0:19986:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790772443.926103:0:19986:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf80e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1877760506292224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772443.926109:0:19986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790772443.926145:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdff74b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506292224:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1790772443.926179:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790772443.926236:0:18700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3e93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877760506292096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772443.926243:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790772443.926288:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc369d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1877760506292096:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1790772443.926383:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772443.927140:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1877760506292608:0@lo:400:kworker.0 00000100:00100000:2.0:1790772443.927200:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772443.927225:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1877760506293120:0@lo:400:kworker.0 00000100:00100000:2.0:1790772443.927248:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772443.927280:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1790772443.927286:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1877760506292480:0@lo:400:kworker.0 00000100:00100000:2.0:1790772443.927310:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772443.927351:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877760506292992:0@lo:400:kworker.0 00000100:00100000:2.0:1790772443.927376:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772443.927392:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1877760506293504:0@lo:400:kworker.0 00000100:00100000:2.0:1790772443.927410:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772443.927439:0:17197:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506292480 00000100:00100000:2.0:1790772443.927444:0:17197:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506292480 00000100:00100000:2.0:1790772443.927476:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790772443.927484:0:17197:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf80e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877760506292480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772443.927528:0:17197:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf80e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877760506292480:12345-0@lo:400:kworker.0 Request processed in 46us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772443.927535:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790772443.927557:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506292736:0@lo:400:kworker.0 00000100:00100000:2.0:1790772443.927579:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772443.927594:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1877760506293248:0@lo:400:kworker.0 00000100:00100000:2.0:1790772443.927625:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772443.927639:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1790772443.927644:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e96364ee-79c0-4114-891b-7127f484e910:3645:1877760506292352:0@lo:400:kworker.0 00000100:00100000:2.0:1790772443.927667:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772443.927685:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506292864:0@lo:400:kworker.0 00000100:00100000:2.0:1790772443.927706:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772443.927720:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1877760506293376:0@lo:400:kworker.0 00000100:00100000:2.0:1790772443.927738:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772443.927776:0:17197:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506292736 00000100:00100000:2.0:1790772443.927781:0:17197:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506292736 00000100:00100000:2.0:1790772443.927801:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790772443.927807:0:17197:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf80ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506292736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772443.927840:0:17197:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf80ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506292736:12345-0@lo:400:kworker.0 Request processed in 34us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772443.927846:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790772443.927877:0:19816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506292608 00000100:00100000:2.0:1790772443.927881:0:19816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506292608 00000100:00100000:2.0:1790772443.927896:0:19816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506293120 00000100:00100000:2.0:1790772443.927899:0:19816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506293120 00000100:00100000:2.0:1790772443.927922:0:19816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506292992 00000100:00100000:2.0:1790772443.927924:0:19816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506292992 00000100:00100000:2.0:1790772443.927935:0:19816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506293504 00000100:00100000:2.0:1790772443.927938:0:19816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506293504 00000100:00100000:2.0:1790772443.927948:0:19816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506293248 00000100:00100000:2.0:1790772443.927951:0:19816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506293248 00000100:00100000:2.0:1790772443.927960:0:19816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506293376 00000100:00100000:2.0:1790772443.927962:0:19816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506293376 00000100:00100000:2.0:1790772443.927974:0:19816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790772443.927980:0:19816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf80e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1877760506292608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772443.928011:0:19816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf80e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1877760506292608:12345-0@lo:400:kworker.0 Request processed in 30us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772443.928017:0:19816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790772443.928223:0:19816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1790772443.928231:0:19816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf80ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1877760506293120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772443.928263:0:19816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf80ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1877760506293120:12345-0@lo:400:kworker.0 Request processed in 33us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772443.928269:0:19816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1790772443.928288:0:19816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790772443.928293:0:19816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf80e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877760506292992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772443.928333:0:19816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf80e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877760506292992:12345-0@lo:400:kworker.0 Request processed in 39us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772443.928339:0:19816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790772443.928350:0:19816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790772443.928355:0:19816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf80e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1877760506293504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772443.928381:0:19816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf80e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1877760506293504:12345-0@lo:400:kworker.0 Request processed in 26us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772443.928386:0:19816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790772443.928397:0:19816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790772443.928401:0:19816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf80eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1877760506293248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772443.928426:0:19816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf80eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1877760506293248:12345-0@lo:400:kworker.0 Request processed in 25us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772443.928431:0:19816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790772443.928441:0:19816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790772443.928446:0:19816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeed3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1877760506293376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772443.928645:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506292736:0@lo:400:kworker.0 00010000:00080000:0.0:1790772443.928659:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ecdf80e9c00 x1877760506293248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772443.928669:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1877760506293248:0@lo:400:kworker.0 00000100:00100000:0.0:1790772443.928769:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1877760506292480:0@lo:400:kworker.0 00000100:00100000:0.0:1790772443.928788:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877760506292992:0@lo:400:kworker.0 00010000:00080000:0.0:1790772443.928798:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ecdf80ebb80 x1877760506293504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772443.928805:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1877760506293504:0@lo:400:kworker.0 00000100:00100000:0.0:1790772443.928814:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1877760506292608:0@lo:400:kworker.0 00000100:00100000:0.0:1790772443.928822:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1877760506293120:0@lo:400:kworker.0 00000100:00080000:0.0:1790772443.928858:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790772443.928862:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772443.930097:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1877760506291968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790772443.930218:0:19816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeed3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1877760506293376:12345-0@lo:400:kworker.0 Request processed in 1766us (2473us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772443.930275:0:17186:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506292352 00000100:00100000:1.0:1790772443.930281:0:17186:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506292352 00000100:00100000:1.0:1790772443.930338:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1790772443.930354:0:17186:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdefc1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e96364ee-79c0-4114-891b-7127f484e910+24:3645:x1877760506292352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772443.930413:0:17186:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdefc1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e96364ee-79c0-4114-891b-7127f484e910+24:3645:x1877760506292352:12345-0@lo:400:kworker.0 Request processed in 63us (2745us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772443.930419:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1790772443.930453:0:19248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506292864 00000100:00100000:1.0:1790772443.930457:0:19248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506292864 00000100:00100000:1.0:1790772443.930487:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790772443.930493:0:19248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff74b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506292864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772443.930523:0:19248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff74b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506292864:12345-0@lo:400:kworker.0 Request processed in 31us (2816us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772443.930540:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790772443.930648:0:19816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1790772443.931085:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790772443.931110:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e96364ee-79c0-4114-891b-7127f484e910:3645:1877760506292352:0@lo:400:kworker.0 00000100:00100000:0.0:1790772443.931132:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506292864:0@lo:400:kworker.0 00000100:00100000:0.0:1790772443.931145:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1877760506293376:0@lo:400:kworker.0 00010000:00010000:0.0:1790772444.948517:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772445.580350:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772445.580392:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772445.580470:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772445.580592:0:17178:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481050368 00000100:00100000:3.0:1790772445.580600:0:17178:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481050368 00000100:00100000:0.0:1790772445.580646:0:17179:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481050112 00000100:00100000:0.0:1790772445.580650:0:17179:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481050112 00000100:00100000:3.0:1790772445.580653:0:17178:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481050240 00000100:00100000:3.0:1790772445.580655:0:17178:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481050240 00000100:00100000:3.0:1790772445.580670:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 6 00000100:00100000:3.0:1790772445.580749:0:17178:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeed3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a49d2df-ad4f-4a29-bdf0-60f3d602d0d1+12:2390:x1877760481050368:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772445.580765:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772445.580784:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eccc3561400/0x418ffb1c3bcc9184 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753932 expref: 12 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772445.580800:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772445.580853:0:17178:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeed3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a49d2df-ad4f-4a29-bdf0-60f3d602d0d1+11:2390:x1877760481050368:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 176us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772445.592045:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 6 00000100:00100000:3.0:1790772445.592092:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 7 00000100:00100000:3.0:1790772445.592107:0:17178:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeed3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a49d2df-ad4f-4a29-bdf0-60f3d602d0d1+10:2393:x1877760481050240:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772445.592126:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772445.592148:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ecdc29cc800/0x418ffb1c3bcc910d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x42c6e081687538f3 expref: 10 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772445.593016:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772445.593083:0:17178:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeed3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a49d2df-ad4f-4a29-bdf0-60f3d602d0d1+9:2393:x1877760481050240:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 982us (12612us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772445.593092:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 7 00000100:00100000:3.0:1790772445.593112:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 8 00000100:00100000:3.0:1790772445.593121:0:17178:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeed3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a49d2df-ad4f-4a29-bdf0-60f3d602d0d1+8:2393:x1877760481050112:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772445.593130:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772445.593143:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ecdd1ad1a00/0x418ffb1c3bcc9106 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x42c6e081687538c2 expref: 8 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772445.593152:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772445.593188:0:17178:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeed3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a49d2df-ad4f-4a29-bdf0-60f3d602d0d1+7:2393:x1877760481050112:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 68us (12795us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772445.593194:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 8 00000100:00100000:2.0:1790772445.598324:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1790772445.601603:0:17193:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481050624 00000100:00100000:0.0:1790772445.601616:0:17193:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481050624 00000100:00100000:1.0:1790772445.601762:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 69 00000100:00100000:1.0:1790772445.601772:0:17193:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeed3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5087553-5805-43ba-a063-2c518ab209a7+6:2389:x1877760481050624:12345-192.168.206.14@tcp:39:umount.0 00000020:00000080:1.0:1790772445.601976:0:17193:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc911b 00000020:00010000:1.0:1790772445.601986:0:17193:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9ecdf4bcf800: total 0 00000100:00080000:1.0:1790772445.601990:0:17193:0:(import.c:65:import_set_state_nolock()) ffff9ecdf4bcb000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790772445.602021:0:17193:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00080000:0.0:1790772445.602227:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772445.602353:0:17193:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeed3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5087553-5805-43ba-a063-2c518ab209a7+5:2389:x1877760481050624:12345-192.168.206.14@tcp:39:umount.0 Request processed in 582us (4047us total) trans 8589934628 rc 0/0 00000100:00100000:1.0:1790772445.602361:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 69 00000020:00010000:2.0:1790772445.602452:0:17181:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9ecdf4bcf800: total 0 00010000:00010000:2.0:1790772445.602456:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772445.602514:0:17181:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ecdf4bcf800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1790772445.602547:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ecdfbacde00) 00010000:00010000:2.0:1790772445.602551:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790772445.602558:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdd1ad0800/0x418ffb1c3bcc9210 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x42c6e0816875395c expref: 4 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772445.602581:0:17181:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ecdf4bcf800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1790772445.602592:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772445.602594:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772445.602596:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772445.615940:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772445.616022:0:17192:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481050752 00000100:00100000:3.0:1790772445.616032:0:17192:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481050752 00000100:00100000:3.0:1790772445.616114:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 70 00000100:00100000:3.0:1790772445.616122:0:17192:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeed3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5087553-5805-43ba-a063-2c518ab209a7+5:2389:x1877760481050752:12345-192.168.206.14@tcp:39:umount.0 00000100:00080000:0.0:1790772445.616488:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:2.0:1790772445.616640:0:17192:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc9122 00000100:00080000:2.0:1790772445.616651:0:17192:0:(import.c:65:import_set_state_nolock()) ffff9ecdf4bc8800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790772445.616715:0:17192:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1790772445.616856:0:17192:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeed3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5087553-5805-43ba-a063-2c518ab209a7+3:2389:x1877760481050752:12345-192.168.206.14@tcp:39:umount.0 Request processed in 733us (923us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1790772445.616864:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 70 00010000:00010000:0.0:1790772445.617400:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772445.645878:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772445.646786:0:17187:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481051008 00000100:00100000:1.0:1790772445.646797:0:17187:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481051008 00000100:00100000:1.0:1790772445.646863:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 171 00000100:00100000:1.0:1790772445.646872:0:17187:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdefc1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a49d2df-ad4f-4a29-bdf0-60f3d602d0d1+7:2389:x1877760481051008:12345-192.168.206.14@tcp:251:umount.0 00000020:00000080:1.0:1790772445.646916:0:17187:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc90b9 00000020:00010000:1.0:1790772445.646924:0:17187:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9eccc2276800: total 0 00000100:00080000:1.0:1790772445.646929:0:17187:0:(import.c:65:import_set_state_nolock()) ffff9eccc2273000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1790772445.647004:0:17187:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdefc1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a49d2df-ad4f-4a29-bdf0-60f3d602d0d1+3:2389:x1877760481051008:12345-192.168.206.14@tcp:251:umount.0 Request processed in 133us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772445.647013:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 171 00000020:00010000:0.0:1790772445.647258:0:17181:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9eccc2276800: total 0 00010000:00010000:0.0:1790772445.647317:0:17181:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9eccc2276800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1790772445.647349:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ecdd1ad0600/0x418ffb1c3bcc90c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x42c6e0816875384b expref: 2 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772445.647379:0:17181:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9eccc2276800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1790772445.647391:0:17181:0:(genops.c:885:class_export_put()) final put ffff9eccc2276800/2a49d2df-ad4f-4a29-bdf0-60f3d602d0d1 00010000:00010000:0.0:1790772445.647404:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772445.647406:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772445.647407:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790772445.648333:0:19463:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc2276800/2a49d2df-ad4f-4a29-bdf0-60f3d602d0d1 for MGS 00000020:00000080:1.0:1790772445.665261:0:19463:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eccc2273000 for MGS 00010000:00010000:1.0:1790772445.972778:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772446.998469:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790772446.998490:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeed3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506293632:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790772446.998813:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772446.998938:0:19986:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506293632 00000100:00100000:0.0:1790772446.998946:0:19986:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506293632 00000100:00100000:0.0:1790772446.999001:0:19986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790772446.999010:0:19986:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeed3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506293632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790772446.999037:0:19986:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1790772446.999083:0:19986:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeed3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506293632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772446.999089:0:19986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790772446.999130:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeed3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506293632:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1790772446.999201:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790772447.001652:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790772447.260128:0:20764:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1790772447.276634:0:20764:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1790772447.276687:0:20764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdf5012800/0x418ffb1c3bcc8c7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc8c83 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772447.276701:0:20764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdf5012800/0x418ffb1c3bcc8c7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc8c83 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772447.276709:0:20764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdf5012800/0x418ffb1c3bcc8c7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x418ffb1c3bcc8c83 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772447.276715:0:20764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.114@tcp lock: ffff9ecdf5012800/0x418ffb1c3bcc8c7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x418ffb1c3bcc8c83 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772447.276861:0:20764:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790772447.276868:0:20764:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1790772447.276891:0:20764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790772447.276895:0:20764:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1790772447.276901:0:20764:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790772447.276923:0:20764:0:(import.c:65:import_set_state_nolock()) ffff9ecdd0ee3800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1790772447.277011:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877760506293760:0@lo:39:umount.0 00000100:00100000:2.0:1790772447.277072:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772447.277155:0:19816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506293760 00000100:00100000:3.0:1790772447.277200:0:19816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506293760 00000100:00100000:3.0:1790772447.277245:0:19816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790772447.277254:0:19816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeed3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1877760506293760:12345-0@lo:39:umount.0 00000020:00000080:3.0:1790772447.277277:0:19816:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8cad 00000100:00080000:3.0:1790772447.277285:0:19816:0:(import.c:65:import_set_state_nolock()) ffff9ecdd0ee0800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1790772447.277417:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772447.277424:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9ecdf5012800/0x418ffb1c3bcc8c7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x418ffb1c3bcc8c83 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772447.277441:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf5012800 already unused, calling callback (ffffffffc11ffc20) 10000000:00010000:1.0:1790772447.277445:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9ecdf5012800/0x418ffb1c3bcc8c7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x418ffb1c3bcc8c83 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772447.277453:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9ecdf5012800/0x418ffb1c3bcc8c7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x418ffb1c3bcc8c83 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772447.277459:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9ecdf5012800/0x418ffb1c3bcc8c7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x418ffb1c3bcc8c83 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772447.277465:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790772447.277467:0:17180:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1790772447.277470:0:17180:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1790772447.277639:0:17180:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9ecdf5012800/0x418ffb1c3bcc8c7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x418ffb1c3bcc8c83 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772447.277647:0:17180:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790772447.277674:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9ecdf5012800/0x418ffb1c3bcc8c7c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x418ffb1c3bcc8c83 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772447.277681:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9ecdf5012800/0x418ffb1c3bcc8c7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x418ffb1c3bcc8c83 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772447.277694:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772447.277695:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772447.277697:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772447.277735:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e96364ee-79c0-4114-891b-7127f484e910:3645:1877760506293888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790772447.277768:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772447.277939:0:17177:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506293888 00000100:00100000:0.0:1790772447.277943:0:17177:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506293888 00000100:00100000:0.0:1790772447.277982:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790772447.277990:0:17177:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeed3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e96364ee-79c0-4114-891b-7127f484e910+24:3645:x1877760506293888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790772447.277999:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772447.278013:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ecdd1ad0a00/0x418ffb1c3bcc8c83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x418ffb1c3bcc8c7c expref: 24 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772447.278024:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772447.278076:0:17177:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeed3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e96364ee-79c0-4114-891b-7127f484e910+23:3645:x1877760506293888:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772447.278083:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790772447.278152:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e96364ee-79c0-4114-891b-7127f484e910:3645:1877760506293888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790772447.278380:0:19816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeed3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3642:x1877760506293760:12345-0@lo:39:umount.0 Request processed in 1127us (1307us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772447.278405:0:19816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:3.0:1790772447.278413:0:19816:0:(genops.c:885:class_export_put()) final put ffff9ecdd0ee4000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1790772447.278516:0:19463:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecdd0ee4000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1790772447.278565:0:19463:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ecdd0ee0800 for lustre-MDT0000 00000100:00080000:1.0:1790772447.278591:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ecdd0ee3800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1790772447.278600:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877760506293760:0@lo:39:umount.0 00010000:00010000:2.0:1790772447.278650:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790772447.278713:0:20764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790772447.278717:0:20764:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790772447.278721:0:20764:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1790772447.280008:0:20764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1a00/0x418ffb1c3bcc8bcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc8bd4 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772447.280023:0:20764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1a00/0x418ffb1c3bcc8bcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc8bd4 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772447.280031:0:20764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1a00/0x418ffb1c3bcc8bcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x418ffb1c3bcc8bd4 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772447.280038:0:20764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1a00/0x418ffb1c3bcc8bcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x418ffb1c3bcc8bd4 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772447.280249:0:20764:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772447.280257:0:20764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9eccc3560c00/0x418ffb1c3bcc90ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc90b2 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772447.280263:0:20764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9eccc3560c00/0x418ffb1c3bcc90ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc90b2 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772447.280269:0:20764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9eccc3560c00/0x418ffb1c3bcc90ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x418ffb1c3bcc90b2 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772447.280274:0:20764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.114@tcp lock: ffff9eccc3560c00/0x418ffb1c3bcc90ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x418ffb1c3bcc90b2 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772447.280571:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790772447.280578:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1a00/0x418ffb1c3bcc8bcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x418ffb1c3bcc8bd4 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772447.280585:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdfbab1a00 already unused, calling callback (ffffffffc11ffc20) 10000000:00010000:1.0:1790772447.280588:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1a00/0x418ffb1c3bcc8bcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x418ffb1c3bcc8bd4 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772447.280596:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1a00/0x418ffb1c3bcc8bcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x418ffb1c3bcc8bd4 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772447.280609:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1a00/0x418ffb1c3bcc8bcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x418ffb1c3bcc8bd4 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772447.280615:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790772447.280617:0:17180:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1790772447.280645:0:17180:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1a00/0x418ffb1c3bcc8bcd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x418ffb1c3bcc8bd4 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772447.280651:0:17180:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790772447.280682:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1a00/0x418ffb1c3bcc8bcd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x418ffb1c3bcc8bd4 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772447.280690:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1a00/0x418ffb1c3bcc8bcd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x418ffb1c3bcc8bd4 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772447.280702:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772447.280705:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9eccc3560c00/0x418ffb1c3bcc90ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x418ffb1c3bcc90b2 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772447.280710:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc3560c00 already unused, calling callback (ffffffffc11ffc20) 10000000:00010000:1.0:1790772447.280713:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9eccc3560c00/0x418ffb1c3bcc90ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x418ffb1c3bcc90b2 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772447.280720:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9eccc3560c00/0x418ffb1c3bcc90ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x418ffb1c3bcc90b2 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772447.280726:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9eccc3560c00/0x418ffb1c3bcc90ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x418ffb1c3bcc90b2 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772447.280731:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1790772447.280739:0:17180:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:1.0:1790772447.280753:0:17180:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9eccc3560c00/0x418ffb1c3bcc90ab lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x418ffb1c3bcc90b2 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772447.280757:0:17180:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790772447.280777:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9eccc3560c00/0x418ffb1c3bcc90ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x418ffb1c3bcc90b2 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772447.280797:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772447.280798:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772447.280801:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772447.280817:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3cb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e96364ee-79c0-4114-891b-7127f484e910:3643:1877760506294144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790772447.280871:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772447.280929:0:17178:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506294144 00000100:00100000:1.0:1790772447.280936:0:17178:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506294144 00000100:00100000:1.0:1790772447.280977:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790772447.280985:0:17178:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e96364ee-79c0-4114-891b-7127f484e910+23:3643:x1877760506294144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790772447.280997:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772447.281010:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ecdd1ad1400/0x418ffb1c3bcc90b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x418ffb1c3bcc90ab expref: 23 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772447.281023:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772447.281056:0:17178:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e96364ee-79c0-4114-891b-7127f484e910+22:3643:x1877760506294144:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772447.281062:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790772447.281096:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3cb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e96364ee-79c0-4114-891b-7127f484e910:3643:1877760506294144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790772447.281232:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790772447.281243:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc369d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e96364ee-79c0-4114-891b-7127f484e910:3645:1877760506294016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790772447.281269:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772447.281358:0:17179:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506294016 00000100:00100000:1.0:1790772447.281363:0:17179:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506294016 00000100:00100000:1.0:1790772447.281491:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790772447.281506:0:17179:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc4450a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e96364ee-79c0-4114-891b-7127f484e910+22:3645:x1877760506294016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790772447.281515:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772447.281523:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ecdfbab1800/0x418ffb1c3bcc8bd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x418ffb1c3bcc8bcd expref: 22 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772447.281532:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772447.281563:0:17179:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc4450a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e96364ee-79c0-4114-891b-7127f484e910+21:3645:x1877760506294016:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772447.281632:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc369d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e96364ee-79c0-4114-891b-7127f484e910:3645:1877760506294016:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790772447.281768:0:20764:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790772447.281774:0:20764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9eccc3560c00/0x418ffb1c3bcc90ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x418ffb1c3bcc90b2 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772447.281846:0:20764:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1790772447.281855:0:20764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9eccc3561200/0x418ffb1c3bcc9176 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc917d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772447.281863:0:20764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9eccc3561200/0x418ffb1c3bcc9176 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc917d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772447.281870:0:20764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9eccc3561200/0x418ffb1c3bcc9176 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x418ffb1c3bcc917d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772447.281877:0:20764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.114@tcp lock: ffff9eccc3561200/0x418ffb1c3bcc9176 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x418ffb1c3bcc917d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772447.281904:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772447.281910:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9eccc3561200/0x418ffb1c3bcc9176 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x418ffb1c3bcc917d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772447.281915:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc3561200 already unused, calling callback (ffffffffc11ffc20) 10000000:00010000:2.0:1790772447.281919:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9eccc3561200/0x418ffb1c3bcc9176 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x418ffb1c3bcc917d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772447.281926:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9eccc3561200/0x418ffb1c3bcc9176 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x418ffb1c3bcc917d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772447.281932:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9eccc3561200/0x418ffb1c3bcc9176 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x418ffb1c3bcc917d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772447.281938:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790772447.281940:0:17181:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1790772447.281956:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9eccc3561200/0x418ffb1c3bcc9176 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x418ffb1c3bcc917d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772447.281962:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790772447.281988:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9eccc3561200/0x418ffb1c3bcc9176 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x418ffb1c3bcc917d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772447.281996:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772447.281997:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772447.281999:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772447.282031:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790772447.282049:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790772447.282055:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeed3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e96364ee-79c0-4114-891b-7127f484e910:3643:1877760506294272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790772447.282082:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772447.282146:0:17177:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506294272 00000100:00100000:2.0:1790772447.282151:0:17177:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506294272 00000100:00100000:2.0:1790772447.282209:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790772447.282216:0:17177:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc32c5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e96364ee-79c0-4114-891b-7127f484e910+21:3643:x1877760506294272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790772447.282233:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772447.282242:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ecdd1ad0000/0x418ffb1c3bcc917d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x418ffb1c3bcc9176 expref: 21 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772447.282251:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772447.282280:0:17177:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc32c5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e96364ee-79c0-4114-891b-7127f484e910+20:3643:x1877760506294272:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772447.282286:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790772447.282404:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeed3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e96364ee-79c0-4114-891b-7127f484e910:3643:1877760506294272:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790772447.282625:0:20764:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790772447.282630:0:20764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9eccc3561200/0x418ffb1c3bcc9176 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x418ffb1c3bcc917d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772447.282639:0:20764:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1790772447.282646:0:20764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1e00/0x418ffb1c3bcc8bbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc8bc6 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772447.282653:0:20764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1e00/0x418ffb1c3bcc8bbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc8bc6 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772447.282659:0:20764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1e00/0x418ffb1c3bcc8bbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x418ffb1c3bcc8bc6 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772447.282671:0:20764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1e00/0x418ffb1c3bcc8bbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x418ffb1c3bcc8bc6 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772447.282701:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772447.282707:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1e00/0x418ffb1c3bcc8bbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x418ffb1c3bcc8bc6 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772447.282713:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdfbab1e00 already unused, calling callback (ffffffffc11ffc20) 10000000:00010000:1.0:1790772447.282716:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1e00/0x418ffb1c3bcc8bbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x418ffb1c3bcc8bc6 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772447.282723:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1e00/0x418ffb1c3bcc8bbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x418ffb1c3bcc8bc6 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772447.282729:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1e00/0x418ffb1c3bcc8bbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x418ffb1c3bcc8bc6 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772447.282734:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1790772447.282742:0:17180:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:1.0:1790772447.282758:0:17180:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1e00/0x418ffb1c3bcc8bbf lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x418ffb1c3bcc8bc6 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772447.282764:0:17180:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1790772447.282866:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3cb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e96364ee-79c0-4114-891b-7127f484e910:3645:1877760506294400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790772447.282895:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772447.282975:0:17179:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506294400 00000100:00100000:3.0:1790772447.282980:0:17179:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506294400 00000100:00100000:3.0:1790772447.283015:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790772447.283022:0:17179:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeed3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e96364ee-79c0-4114-891b-7127f484e910+20:3645:x1877760506294400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790772447.283030:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772447.283039:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ecdfbab0e00/0x418ffb1c3bcc8bc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x418ffb1c3bcc8bbf expref: 20 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772447.283047:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772447.283076:0:17179:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeed3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e96364ee-79c0-4114-891b-7127f484e910+19:3645:x1877760506294400:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772447.283082:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790772447.283142:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3cb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e96364ee-79c0-4114-891b-7127f484e910:3645:1877760506294400:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790772447.283257:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1e00/0x418ffb1c3bcc8bbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x418ffb1c3bcc8bc6 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772447.283266:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772447.283268:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772447.283270:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772447.283380:0:20764:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790772447.283385:0:20764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1e00/0x418ffb1c3bcc8bbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x418ffb1c3bcc8bc6 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772447.283401:0:20764:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:0.0:1790772447.283406:0:20764:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1790772447.283408:0:20764:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1790772447.283438:0:20764:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1790772447.283442:0:20764:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1790772447.283446:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790772447.283451:0:20764:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:0.0:1790772447.283455:0:20764:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9eccc2276000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790772447.283460:0:20764:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9eccc2244000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790772447.283464:0:20764:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9eccc3750800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790772447.283468:0:20764:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9ecde13c0800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790772447.283475:0:20764:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9ecdf4bcf800 e5087553-5805-43ba-a063-2c518ab209a7 192.168.206.14@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:0.0:1790772447.283479:0:20764:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9eccc24e9000 f6fc10b0-a0f6-4852-8b53-26173a9eb237 192.168.206.14@tcp 4 (0 4 0) 1 0 0 0: 0000000000000000 8589934624 stale:0 00000020:00080000:0.0:1790772447.283484:0:20764:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9ecdf5e7b380) has exports, disconnecting them 00000020:00080000:0.0:1790772447.283488:0:20764:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9eccc2276000), last request at 1790772443 00000020:00000080:0.0:1790772447.283494:0:20764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8ee4 00000100:00080000:0.0:1790772447.283509:0:20764:0:(import.c:65:import_set_state_nolock()) ffff9eccc2277000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1790772447.283602:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1790772447.283696:0:20764:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9eccc2276000): rc 0 00000020:00000080:0.0:1790772447.283707:0:20764:0:(genops.c:885:class_export_put()) final put ffff9eccc2276000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1790772447.283725:0:20764:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9eccc2244000), last request at 1790772443 00000020:00000080:0.0:1790772447.283729:0:20764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8e4a 00000100:00080000:0.0:1790772447.283734:0:20764:0:(import.c:65:import_set_state_nolock()) ffff9eccc2241800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1790772447.283761:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc2276000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1790772447.283817:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eccc2277000 for lustre-MDT0000 00010000:00010000:1.0:1790772447.283926:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1790772447.283983:0:20764:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9eccc2244000): rc 0 00000020:00000080:0.0:1790772447.283986:0:20764:0:(genops.c:885:class_export_put()) final put ffff9eccc2244000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1790772447.284001:0:20764:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9eccc3750800), last request at 1790772375 00000020:00000080:0.0:1790772447.284004:0:20764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8d9b 00000100:00080000:0.0:1790772447.284009:0:20764:0:(import.c:65:import_set_state_nolock()) ffff9eccc3756000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1790772447.284035:0:19463:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc2244000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1790772447.284065:0:19463:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eccc2241800 for lustre-MDT0000 00010000:00010000:2.0:1790772447.284109:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1790772447.284279:0:20764:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9eccc3750800): rc 0 00000020:00000080:0.0:1790772447.284281:0:20764:0:(genops.c:885:class_export_put()) final put ffff9eccc3750800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1790772447.284358:0:20764:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ecde13c0800), last request at 1790772375 00000020:00000080:0.0:1790772447.284363:0:20764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8d32 00000100:00080000:0.0:1790772447.284367:0:20764:0:(import.c:65:import_set_state_nolock()) ffff9ecdefcd2800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1790772447.284391:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc3750800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1790772447.284430:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eccc3756000 for lustre-MDT0000 00010000:00010000:1.0:1790772447.284568:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1790772447.284736:0:20764:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000020:00080000:0.0:1790772447.284821:0:20764:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ecde13c0800): rc 0 00000004:00000080:0.0:1790772447.284827:0:20764:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb37a00dabae0 00000100:00080000:0.0:1790772447.284843:0:20764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1790772447.284846:0:20764:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1790772447.285834:0:20764:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1790772447.285861:0:20764:0:(import.c:65:import_set_state_nolock()) ffff9ecdfc528000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1790772447.285956:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506294528:0@lo:39:umount.0 00000100:00100000:1.0:1790772447.286020:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790772447.286317:0:20764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1790772447.286321:0:20764:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:1.0:1790772447.286340:0:20764:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1790772447.286465:0:20764:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1790772447.286478:0:20764:0:(import.c:65:import_set_state_nolock()) ffff9eccc3ca8800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1790772447.286489:0:20764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1790772447.286492:0:20764:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:1.0:1790772447.286499:0:20764:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790772447.286567:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3cb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506294656:0@lo:9:umount.0 00000100:00100000:1.0:1790772447.286600:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790772447.286628:0:20764:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1790772447.286639:0:20764:0:(import.c:65:import_set_state_nolock()) ffff9eccc32c8800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1790772447.286654:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc440ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506294784:0@lo:9:umount.0 00000100:00100000:1.0:1790772447.286689:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1790772447.286743:0:20764:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9ecdf5e7b380) has no exports 00000100:00100000:3.0:1790772447.286818:0:18698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506294656 00000100:00100000:3.0:1790772447.286825:0:18698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506294656 00000100:00100000:3.0:1790772447.286881:0:18698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506294784 00000100:00100000:3.0:1790772447.286884:0:18698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506294784 00000100:00100000:3.0:1790772447.286906:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790772447.286915:0:18698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1877760506294656:12345-0@lo:9:umount.0 00000020:00000080:3.0:1790772447.286947:0:18698:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8f07 00000100:00080000:3.0:1790772447.286955:0:18698:0:(import.c:65:import_set_state_nolock()) ffff9eccc24eb000 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1790772447.286994:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790772447.286998:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790772447.287141:0:17197:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506294528 00000100:00100000:0.0:1790772447.287146:0:17197:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506294528 00000100:00100000:0.0:1790772447.287192:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790772447.287200:0:17197:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1877760506294528:12345-0@lo:39:umount.0 00000020:00000080:0.0:1790772447.287217:0:17197:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8dc5 00000100:00080000:0.0:1790772447.287223:0:17197:0:(import.c:65:import_set_state_nolock()) ffff9eccc35fe800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1790772447.287272:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1790772447.287896:0:18698:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1790772447.288032:0:18698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3642:x1877760506294656:12345-0@lo:9:umount.0 Request processed in 1117us (1430us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772447.288039:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790772447.288058:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790772447.288065:0:18698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc440d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1877760506294784:12345-0@lo:9:umount.0 00000020:00000080:3.0:1790772447.288080:0:18698:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8f0e 00000100:00080000:3.0:1790772447.288086:0:18698:0:(import.c:65:import_set_state_nolock()) ffff9eccc24ee800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790772447.288105:0:18698:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1790772447.288185:0:18698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc440d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3642:x1877760506294784:12345-0@lo:9:umount.0 Request processed in 122us (1495us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772447.288191:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1790772447.288810:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9eccc32c8800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1790772447.288821:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1790772447.288823:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790772447.288828:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc440ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506294784:0@lo:9:umount.0 00000100:00080000:3.0:1790772447.288840:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9eccc3ca8800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1790772447.288848:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1790772447.288849:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790772447.288852:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3cb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506294656:0@lo:9:umount.0 00000001:00000004:0.0:1790772447.289226:0:17197:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1790772447.289360:0:17197:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3642:x1877760506294528:12345-0@lo:39:umount.0 Request processed in 2160us (3338us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1790772447.289368:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00010000:1.0:1790772447.289494:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790772447.289606:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ecdfc528000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1790772447.289612:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506294528:0@lo:39:umount.0 00000001:00100000:3.0:1790772447.289802:0:19512:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790772447.289806:0:19512:0:(genops.c:885:class_export_put()) final put ffff9eccc24e8800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1790772447.289832:0:19512:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e5087553-5805-43ba-a063-2c518ab209a7 00000020:00000080:3.0:1790772447.289835:0:19512:0:(genops.c:885:class_export_put()) final put ffff9eccc33f3800/e5087553-5805-43ba-a063-2c518ab209a7 00000001:00100000:3.0:1790772447.289841:0:19512:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f6fc10b0-a0f6-4852-8b53-26173a9eb237 00000020:00000080:3.0:1790772447.289844:0:19512:0:(genops.c:885:class_export_put()) final put ffff9ecdef356800/f6fc10b0-a0f6-4852-8b53-26173a9eb237 00000020:00000080:1.0:1790772447.289886:0:19463:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc24e8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1790772447.289924:0:19463:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc33f3800/e5087553-5805-43ba-a063-2c518ab209a7 for lustre-OST0001 00000020:00000080:1.0:1790772447.289939:0:19463:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecdef356800/f6fc10b0-a0f6-4852-8b53-26173a9eb237 for lustre-OST0001 00000020:00000080:1.0:1790772447.289957:0:19463:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eccc24ee800 for lustre-OST0001 00000020:00000080:1.0:1790772447.289961:0:19463:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ecdef375800 for lustre-OST0001 00000020:00000080:1.0:1790772447.289964:0:19463:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ecdef355800 for lustre-OST0001 00010000:00010000:3.0:1790772447.290217:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790772447.291318:0:18693:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790772447.291324:0:18693:0:(genops.c:885:class_export_put()) final put ffff9eccc24ea800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1790772447.291348:0:18693:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f6fc10b0-a0f6-4852-8b53-26173a9eb237 00000020:00000080:0.0:1790772447.291351:0:18693:0:(genops.c:885:class_export_put()) final put ffff9ecde13c6000/f6fc10b0-a0f6-4852-8b53-26173a9eb237 00000001:00100000:0.0:1790772447.291358:0:18693:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e5087553-5805-43ba-a063-2c518ab209a7 00000020:00000080:0.0:1790772447.291361:0:18693:0:(genops.c:885:class_export_put()) final put ffff9eccc33f7800/e5087553-5805-43ba-a063-2c518ab209a7 00000020:00000080:3.0:1790772447.291409:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc24ea800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1790772447.291441:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecde13c6000/f6fc10b0-a0f6-4852-8b53-26173a9eb237 for lustre-OST0000 00000020:00000080:3.0:1790772447.291464:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc33f7800/e5087553-5805-43ba-a063-2c518ab209a7 for lustre-OST0000 00000020:00000080:3.0:1790772447.291478:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eccc24eb000 for lustre-OST0000 00000020:00000080:3.0:1790772447.291482:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ecdef350800 for lustre-OST0000 00000020:00000080:3.0:1790772447.291484:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eccc33f1000 for lustre-OST0000 00000020:00080000:1.0:1790772447.304287:0:20764:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9ecdf5e7b380) has no exports 00000020:00000080:1.0:1790772447.364597:0:20764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8c1a 00000020:00000080:1.0:1790772447.364614:0:20764:0:(genops.c:885:class_export_put()) final put ffff9eccc3cab800/lustre-QMT0000_UUID 00000020:01000000:1.0:1790772447.364684:0:20764:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1790772447.367220:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790772447.367234:0:20764:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790772447.367240:0:20764:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9ecdf5e7cd40) has no exports 00000020:00000080:0.0:1790772447.367656:0:20764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8c13 00000020:00000080:0.0:1790772447.367666:0:20764:0:(genops.c:885:class_export_put()) final put ffff9eccc32ca800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1790772447.367747:0:19463:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc3cab800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1790772447.371240:0:19463:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc32ca800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790772447.372446:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790772447.372461:0:20764:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1790772447.372467:0:20764:0:(genops.c:885:class_export_put()) final put ffff9eccc1b58800/lustre-QMT0000_UUID 00000020:00000080:0.0:1790772447.372472:0:20764:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc1b58800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1790772447.372481:0:20764:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:2.0:1790772447.512505:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1877760506294912:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790772447.512586:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772447.512711:0:17198:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506294912 00000100:00100000:1.0:1790772447.512719:0:17198:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506294912 00000100:00100000:1.0:1790772447.512769:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790772447.512776:0:17198:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeed3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1877760506294912:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1790772447.512791:0:17198:0:(tgt_handler.c:821:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1790772447.520013:0:17198:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeed3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1877760506294912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7228us (7419us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790772447.520029:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:02020000:2.0:1790772447.520161:0:3646:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1790772447.534286:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1790772447.534304:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9ecdfb8bd000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1790772447.534308:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1790772447.552804:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9ecdfb8bd000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790772447.552816:0:3646:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 476 00000100:00080000:2.0:1790772447.552832:0:3646:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9ecdfb8bd000 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:2.0:1790772447.552871:0:3646:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdeed3d500 x1877760506295040/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790772447.553144:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeed3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1877760506295040:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1790772447.553242:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772447.558917:0:17197:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506295040 00000100:00100000:2.0:1790772447.558930:0:17197:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506295040 00000100:00100000:2.0:1790772447.558973:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790772447.558981:0:17197:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeec52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1877760506295040:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1790772447.558999:0:17197:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1790772447.575399:0:17197:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeec52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1877760506295040:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 16408us (22148us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790772447.575414:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1790772447.575542:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ecdfb8bd000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790772447.575547:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790772447.575551:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeed3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1877760506295040:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:1.0:1790772448.020642:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790772448.725726:0:17944:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790772449.044929:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790772449.044952:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc440ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1877760506295168:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790772449.045015:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772449.045062:0:19985:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506295168 00000100:00100000:3.0:1790772449.045069:0:19985:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506295168 00000100:00100000:3.0:1790772449.045123:0:19985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790772449.045132:0:19985:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc4450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877760506295168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790772449.045160:0:19985:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1790772449.045219:0:19985:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc4450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877760506295168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772449.045227:0:19985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1790772449.045248:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790772449.045298:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc440ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1877760506295168:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1790772449.045322:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790772449.047881:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790772449.047888:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1790772449.047892:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ecdfb8bd000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790772449.047899:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 547 00000100:00080000:1.0:1790772449.047926:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:2.0:1790772449.047928:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc440ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e96364ee-79c0-4114-891b-7127f484e910:3644:1877760506295296:0@lo:400:kworker.0 00000100:00080000:1.0:1790772449.047938:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9ecdfb8bd000 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:1.0:1790772449.047959:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eccc440ca80 x1877760506295424/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790772449.047989:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772449.048032:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1877760506295936:0@lo:400:kworker.0 00000100:00100000:1.0:1790772449.048043:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdfaa87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1877760506295680:0@lo:400:kworker.0 00000100:00100000:2.0:1790772449.048058:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772449.048133:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdfaa85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506295552:0@lo:400:kworker.0 00000100:00100000:0.0:1790772449.048194:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdfaa85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1877760506295808:0@lo:400:kworker.0 00000100:00100000:1.0:1790772449.052002:0:17193:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506295936 00000100:00100000:1.0:1790772449.052017:0:17193:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506295936 00000100:00100000:1.0:1790772449.053620:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790772449.053642:0:17193:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeed3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1877760506295936:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1790772449.059186:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790772449.059255:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772449.059317:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1877760506296064:0@lo:400:kworker.0 00000100:00100000:3.0:1790772449.059353:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772449.059416:0:17185:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506295296 00000100:00100000:3.0:1790772449.059424:0:17185:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506295296 00000100:00100000:3.0:1790772449.060410:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1790772449.060424:0:17185:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdefc19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e96364ee-79c0-4114-891b-7127f484e910+19:3644:x1877760506295296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772449.060500:0:17185:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdefc19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e96364ee-79c0-4114-891b-7127f484e910+19:3644:x1877760506295296:12345-0@lo:400:kworker.0 Request processed in 80us (12510us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772449.060507:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1790772449.060567:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772449.060598:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1877760506296192:0@lo:400:kworker.0 00000100:00100000:3.0:1790772449.060622:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772449.060645:0:19816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506296064 00000100:00100000:3.0:1790772449.060649:0:19816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506296064 00000100:00100000:3.0:1790772449.060667:0:19816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506295680 00000100:00100000:3.0:1790772449.060669:0:19816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506295680 00000100:00100000:3.0:1790772449.060676:0:19816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506296192 00000100:00100000:3.0:1790772449.060678:0:19816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506296192 00000100:00100000:3.0:1790772449.060701:0:19816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790772449.060706:0:19816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc12ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1877760506296192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772449.061091:0:19816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc12ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1877760506296192:12345-0@lo:400:kworker.0 Request processed in 32us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772449.061099:0:19816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790772449.061119:0:19816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790772449.061123:0:19816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc35a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1877760506296064:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1790772449.061143:0:19816:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1790772449.061198:0:19816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc35a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1877760506296064:12345-0@lo:400:kworker.0 Request processed in 72us (1843us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790772449.061204:0:19816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790772449.061217:0:19816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790772449.061221:0:19816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc12ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3646:x1877760506295680:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1790772449.061226:0:19816:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1790772449.061251:0:19816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc12ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3646:x1877760506295680:12345-0@lo:400:kworker.0 Request processed in 28us (683us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790772449.061256:0:19816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1790772449.061274:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790772449.061314:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1790772449.061319:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9eccc2275800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1790772449.061322:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1790772449.061327:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9eccc2275800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790772449.061331:0:3645:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 507 00000100:00080000:3.0:1790772449.061340:0:3645:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9eccc2275800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:3.0:1790772449.061364:0:3645:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdc12ac380 x1877760506296320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790772449.061379:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1877760506296064:0@lo:400:kworker.0 00010000:00080000:3.0:1790772449.061413:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ecdf8091880 x1877760506296192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772449.061425:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1877760506296192:0@lo:400:kworker.0 00000100:00080000:3.0:1790772449.061444:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1790772449.061453:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9ecdc87eb800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1790772449.062846:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1790772449.062853:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9ecdc87eb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790772449.062858:0:3646:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 476 00000100:00080000:3.0:1790772449.062870:0:3646:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9ecdc87eb800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:3.0:1790772449.062902:0:3646:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdc12af100 x1877760506296448/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790772449.062919:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdfaa87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1877760506295680:0@lo:400:kworker.0 00000100:00100000:3.0:1790772449.063013:0:18699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506295552 00000100:00100000:3.0:1790772449.063019:0:18699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506295552 00000100:00100000:3.0:1790772449.063070:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790772449.063078:0:18699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506295552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772449.063149:0:18699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506295552:12345-0@lo:400:kworker.0 Request processed in 72us (3896us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772449.063155:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1790772449.063197:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790772449.063228:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdfaa85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506295552:0@lo:400:kworker.0 00000100:00100000:3.0:1790772449.063261:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc440ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1877760506295424:0@lo:38:kworker.0 00000100:00100000:3.0:1790772449.063977:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772449.064007:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1877760506296320:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1790772449.064034:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772449.064052:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877760506296448:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1790772449.064074:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772449.064109:0:17192:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506296320 00000100:00100000:3.0:1790772449.064125:0:17192:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506296320 00000100:00100000:3.0:1790772449.064145:0:17192:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506296448 00000100:00100000:3.0:1790772449.064148:0:17192:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506296448 00000100:00100000:3.0:1790772449.064161:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790772449.064193:0:17192:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc12adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1877760506296320:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1790772449.064209:0:17192:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1790772449.064246:0:17192:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc12adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1877760506296320:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 79us (211us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790772449.064253:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790772449.064268:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790772449.064272:0:17192:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc12ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1877760506296448:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1790772449.064278:0:17192:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1790772449.064316:0:17192:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc12ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1877760506296448:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 43us (241us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790772449.064323:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1790772449.064355:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9eccc2275800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790772449.064361:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790772449.064364:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1877760506296320:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1790772449.064373:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ecdc87eb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790772449.064377:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790772449.064379:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877760506296448:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1790772449.064417:0:17198:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506295424 00000100:00100000:3.0:1790772449.064421:0:17198:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506295424 00000100:00100000:3.0:1790772449.064442:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790772449.064446:0:17198:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc12aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1877760506295424:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1790772449.064454:0:17198:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1790772449.068870:0:17198:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc12aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1877760506295424:12345-0@lo:38:kworker.0 Request processed in 4413us (4884us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790772449.068897:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1790772449.068962:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ecdfb8bd000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790772449.068967:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790772449.068971:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc440ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1877760506295424:0@lo:38:kworker.0 00000100:00100000:0.0:1790772449.071082:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772449.071137:0:17192:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506295808 00000100:00100000:0.0:1790772449.071156:0:17192:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506295808 00000100:00100000:0.0:1790772449.071216:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790772449.071224:0:17192:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeec51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1877760506295808:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1790772449.071234:0:17192:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1790772449.071272:0:17192:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeec51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1877760506295808:12345-0@lo:400:kworker.0 Request processed in 48us (196us total) trans 0 rc -107/-107 00000100:00100000:0.0:1790772449.071278:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1790772449.071332:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1790772449.071337:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9eccc2242000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1790772449.071340:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1790772449.071346:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9eccc2242000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790772449.071350:0:3643:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 490 00000100:00080000:0.0:1790772449.071359:0:3643:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9eccc2242000 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:0.0:1790772449.071388:0:3643:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdeec50380 x1877760506296576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790772449.071411:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdfaa85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1877760506295808:0@lo:400:kworker.0 00000100:00100000:0.0:1790772449.071438:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1877760506296576:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1790772449.072866:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772449.072934:0:17194:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506296576 00000100:00100000:0.0:1790772449.072941:0:17194:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506296576 00000100:00100000:0.0:1790772449.072974:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790772449.072980:0:17194:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeec51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1877760506296576:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1790772449.072998:0:17194:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1790772449.073048:0:17194:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeec51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1877760506296576:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 66us (186us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790772449.073068:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1790772449.073104:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9eccc2242000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790772449.073109:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790772449.073112:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1877760506296576:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1790772449.075588:0:17193:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeed3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1877760506295936:12345-0@lo:400:kworker.0 Request processed in 21947us (27520us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772449.075613:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:2.0:1790772449.083680:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ecdf8091f80 x1877760506295936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772449.083697:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1877760506295936:0@lo:400:kworker.0 00000100:00100000:2.0:1790772449.083709:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc440ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e96364ee-79c0-4114-891b-7127f484e910:3644:1877760506295296:0@lo:400:kworker.0 00000001:00100000:0.0:1790772449.560935:0:17924:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1790772449.560952:0:17924:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:0.0:1790772449.560957:0:17924:0:(genops.c:885:class_export_put()) final put ffff9ecdc882d000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1790772449.560972:0:17924:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e5087553-5805-43ba-a063-2c518ab209a7 00000001:00080000:0.0:1790772449.560977:0:17924:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:0.0:1790772449.560980:0:17924:0:(genops.c:885:class_export_put()) final put ffff9ecdf4bca800/e5087553-5805-43ba-a063-2c518ab209a7 00000001:00100000:0.0:1790772449.560986:0:17924:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f6fc10b0-a0f6-4852-8b53-26173a9eb237 00000001:00080000:0.0:1790772449.560991:0:17924:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:0.0:1790772449.560993:0:17924:0:(genops.c:885:class_export_put()) final put ffff9eccc24ea000/f6fc10b0-a0f6-4852-8b53-26173a9eb237 00000020:00000080:1.0:1790772449.561747:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecdc882d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1790772449.561806:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecdf4bca800/e5087553-5805-43ba-a063-2c518ab209a7 for lustre-MDT0001 00000020:00000080:1.0:1790772449.561828:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc24ea000/f6fc10b0-a0f6-4852-8b53-26173a9eb237 for lustre-MDT0001 00000020:00000080:1.0:1790772449.561848:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eccc35fe800 for lustre-MDT0001 00000020:00000080:1.0:1790772449.561852:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ecdf4bc8800 for lustre-MDT0001 00000020:00000080:1.0:1790772449.561854:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eccc24e8000 for lustre-MDT0001 00000001:00100000:1.0:1790772449.562357:0:17172:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1790772449.562363:0:17172:0:(genops.c:885:class_export_put()) final put ffff9ecde13c0800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1790772449.562387:0:17172:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e5087553-5805-43ba-a063-2c518ab209a7 00000001:00080000:1.0:1790772449.562394:0:17172:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:1.0:1790772449.562397:0:17172:0:(genops.c:885:class_export_put()) final put ffff9ecdf4bcf800/e5087553-5805-43ba-a063-2c518ab209a7 00000001:00100000:1.0:1790772449.562401:0:17172:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f6fc10b0-a0f6-4852-8b53-26173a9eb237 00000001:00080000:1.0:1790772449.562404:0:17172:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:1.0:1790772449.562408:0:17172:0:(genops.c:885:class_export_put()) final put ffff9eccc24e9000/f6fc10b0-a0f6-4852-8b53-26173a9eb237 00000020:00000080:2.0:1790772449.562945:0:19463:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecde13c0800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1790772449.573988:0:19463:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecdf4bcf800/e5087553-5805-43ba-a063-2c518ab209a7 for lustre-MDT0000 00000020:00000080:2.0:1790772449.574081:0:19463:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc24e9000/f6fc10b0-a0f6-4852-8b53-26173a9eb237 for lustre-MDT0000 00000020:00000080:2.0:1790772449.574106:0:19463:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ecdefcd2800 for lustre-MDT0000 00000020:00000080:2.0:1790772449.574111:0:19463:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ecdf4bcb000 for lustre-MDT0000 00000020:00000080:2.0:1790772449.574115:0:19463:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eccc24ee000 for lustre-MDT0000 00010000:00010000:1.0:1790772450.068339:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772451.092378:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772452.116366:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772452.116700:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeed3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506296704:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790772452.116775:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772452.116918:0:19986:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506296704 00000100:00100000:2.0:1790772452.116926:0:19986:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506296704 00000100:00100000:2.0:1790772452.117008:0:19986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790772452.117018:0:19986:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeec50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506296704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790772452.117048:0:19986:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1790772452.117092:0:19986:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeec50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506296704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772452.117098:0:19986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1790772452.117719:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790772452.117769:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeed3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506296704:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1790772453.140533:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1790772453.460308:0:20764:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9ecdfc4aa900 - data ffff9ecdf0e21288/ffff9ecdf4bfbc00 00000020:01000000:0.0:1790772453.460436:0:20764:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9ecdedf98d20 - data ffff9ecdf0e85798/ffff9ecdf73cec00 00000001:00000004:0.0:1790772453.467497:0:20764:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:3.0:1790772453.531028:0:20764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790772453.531036:0:20764:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790772453.531050:0:20764:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9ecdeec50700 x1877760506294528/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1790772457 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772453.531074:0:20764:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1790772453.536064:0:20764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790772453.536072:0:20764:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:3.0:1790772453.536104:0:20764:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790772453.536106:0:20764:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1790772453.536658:0:17216:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1790772453.536664:0:17216:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:2.0:1790772453.536675:0:17216:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1790772453.542881:0:20764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790772453.542887:0:20764:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:3.0:1790772453.542909:0:20764:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790772453.542911:0:20764:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1790772453.543242:0:17218:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1790772453.543248:0:17218:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:1.0:1790772453.543258:0:17218:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1790772453.544422:0:20764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8be2 00000020:00000080:3.0:1790772453.544433:0:20764:0:(genops.c:885:class_export_put()) final put ffff9ecdc3e48000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1790772453.544836:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecdc3e48000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790772453.545815:0:20764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8bf7 00000020:00000080:3.0:1790772453.545825:0:20764:0:(genops.c:885:class_export_put()) final put ffff9eccc1b5d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1790772453.546122:0:20764:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1790772453.546128:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790772453.546135:0:20764:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790772453.546140:0:20764:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9ecdf5e799c0) has no exports 00000004:01000000:3.0:1790772453.546326:0:20764:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1790772453.546335:0:20764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8c59 00000020:00000080:3.0:1790772453.546348:0:20764:0:(genops.c:885:class_export_put()) final put ffff9ecde10be000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790772453.547088:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc1b5d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1790772453.547158:0:20764:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1790772453.547191:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790772453.547198:0:20764:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1790772453.547201:0:20764:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9eccc30a99c0) has no exports 00000020:00000080:3.0:1790772453.547207:0:20764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8c52 00000020:00000080:3.0:1790772453.547213:0:20764:0:(genops.c:885:class_export_put()) final put ffff9eccc3dac000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1790772453.549892:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecde10be000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1790772453.550234:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc3dac000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1790772453.550445:0:20764:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1790772453.550449:0:20764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790772453.550454:0:20764:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:3.0:1790772453.550460:0:20764:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790772453.550462:0:20764:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790772453.550537:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790772453.550546:0:20764:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790772453.550553:0:20764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8c44 00000020:00000080:3.0:1790772453.550561:0:20764:0:(genops.c:885:class_export_put()) final put ffff9eccc3daa000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790772453.551526:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eccc32c8800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1790772453.551536:0:37:0:(genops.c:885:class_export_put()) final put ffff9eccc3da8000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790772453.551539:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc3da8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1790772453.551545:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1790772453.551699:0:20764:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1790772453.551773:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc3daa000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1790772453.551798:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790772453.551806:0:20764:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790772453.551810:0:20764:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9ecdfa980000) has no exports 00000020:00000080:2.0:1790772453.551817:0:20764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8c3d 00000020:00000080:2.0:1790772453.551822:0:20764:0:(genops.c:885:class_export_put()) final put ffff9eccc3caf000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1790772453.552229:0:20764:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1790772453.552234:0:20764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790772453.552237:0:20764:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:2.0:1790772453.552242:0:20764:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790772453.552244:0:20764:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790772453.554317:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc3caf000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1790772453.554431:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790772453.554442:0:20764:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1790772453.554457:0:20764:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1790772453.554465:0:20764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8c2f 00000020:00000080:2.0:1790772453.554473:0:20764:0:(genops.c:885:class_export_put()) final put ffff9eccc32ce800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1790772453.554478:0:20764:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1790772453.554484:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790772453.554489:0:20764:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790772453.554493:0:20764:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff9eccc30a8000) has no exports 00000020:00000080:2.0:1790772453.554499:0:20764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8c28 00000020:00000080:2.0:1790772453.554502:0:20764:0:(genops.c:885:class_export_put()) final put ffff9ecdfc52a000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790772453.554785:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eccc3ca8800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1790772453.554792:0:37:0:(genops.c:885:class_export_put()) final put ffff9eccc32cf000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790772453.554794:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc32cf000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1790772453.554799:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790772453.554877:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc32ce800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1790772453.554882:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecdfc52a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1790772453.557124:0:20764:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1790772453.557132:0:20764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790772453.557136:0:20764:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1790772453.557143:0:20764:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790772453.557209:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790772453.557219:0:20764:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790772453.557246:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790772453.557249:0:20764:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790772453.557254:0:20764:0:(genops.c:885:class_export_put()) final put ffff9ecdc3e4e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790772453.557258:0:20764:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecdc3e4e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1790772453.557284:0:20764:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790772453.557374:0:20764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8bfe 00000020:00000080:3.0:1790772453.557381:0:20764:0:(genops.c:885:class_export_put()) final put ffff9eccc1b5f000/lustre-MDD0000_UUID 00000020:01000000:3.0:1790772453.557385:0:20764:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1790772453.557399:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790772453.557404:0:20764:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790772453.557408:0:20764:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9ecdf5e78000) has no exports 00000020:00000080:3.0:1790772453.557426:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790772453.557429:0:20764:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1790772453.557433:0:20764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8c05 00000020:00000080:3.0:1790772453.557437:0:20764:0:(genops.c:885:class_export_put()) final put ffff9eccc1b5d000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1790772453.557445:0:20764:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9eccc3507000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1790772453.557448:0:20764:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eccc3507000 3 00000020:01000004:3.0:1790772453.557452:0:20764:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9eccc3507000 from lustre-MDT0000 00000020:00000080:3.0:1790772453.557468:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790772453.557471:0:20764:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1790772453.557474:0:20764:0:(genops.c:885:class_export_put()) final put ffff9ecdc3e4f000/lustre-MDT0000_UUID 00000020:00000080:3.0:1790772453.557476:0:20764:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecdc3e4f000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1790772453.557482:0:20764:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1790772453.557509:0:20764:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1790772453.557513:0:20764:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1790772453.557516:0:20764:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1790772453.557519:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790772453.557522:0:20764:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1790772453.557527:0:20764:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9eccc3504800 e96364ee-79c0-4114-891b-7127f484e910 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790772453.557532:0:20764:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9ecdfb8e19c0) has exports, disconnecting them 00000020:00080000:3.0:1790772453.557535:0:20764:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9eccc3504800), last request at 1790772361 00000020:00000080:3.0:1790772453.557549:0:20764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8baa 00000020:00010000:3.0:1790772453.557553:0:20764:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9eccc3504800: total 2 00000100:00080000:3.0:1790772453.557556:0:20764:0:(import.c:65:import_set_state_nolock()) ffff9eccc3503800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1790772453.557567:0:20764:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9eccc3504800): rc 0 00000020:00080000:3.0:1790772453.557571:0:20764:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9ecdfb8e19c0) has no exports 00000100:00100000:3.0:1790772453.557622:0:17185:0:(service.c:3206:ptlrpc_main()) ll_mgs_0000: service thread [ffff9ecdf882f000:17185] 0 exiting: rc = 1 00000100:00100000:3.0:1790772453.557729:0:17187:0:(service.c:3206:ptlrpc_main()) ll_mgs_0002: service thread [ffff9eccc2654400:17187] 2 exiting: rc = 0 00000100:00100000:3.0:1790772453.557800:0:17186:0:(service.c:3206:ptlrpc_main()) ll_mgs_0001: service thread [ffff9eccc1bad800:17186] 1 exiting: rc = 0 00000100:00100000:3.0:1790772453.557853:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.557867:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.557873:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.557880:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.557886:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.557892:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.557899:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.557905:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.557912:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.557918:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.557924:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.557929:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.557935:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.557941:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.557946:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.557952:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.557957:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.557962:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.557968:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.557973:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.557978:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.557984:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.557989:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.557994:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558000:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558005:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558010:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558016:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558021:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558027:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558033:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558041:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558046:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558051:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558056:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558061:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558073:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558079:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558084:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558090:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558095:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558100:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558106:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558112:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558117:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558122:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558127:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558133:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558138:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558144:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558148:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558154:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558159:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558187:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558193:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558199:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558205:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558210:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558216:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558223:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558228:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558234:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558239:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772453.558244:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:1.0:1790772453.558867:0:17180:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9eccc3504800: total 2 00010000:00010000:1.0:1790772453.558873:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772453.558913:0:17180:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9eccc3504800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1790772453.558942:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eccc3561c00/0x418ffb1c3bcc8e0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x418ffb1c3bcc8e04 expref: 14 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772453.558960:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ecdd1ad0200/0x418ffb1c3bcc8bb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x418ffb1c3bcc8bb1 expref: 13 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772453.558970:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ecdf5013800/0x418ffb1c3bcc8ea5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x418ffb1c3bcc8e9e expref: 12 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772453.558980:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eccc3561800/0x418ffb1c3bcc9153 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x418ffb1c3bcc914c expref: 11 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772453.558989:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ecdc29cd800/0x418ffb1c3bcc90a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x418ffb1c3bcc909d expref: 10 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772453.559015:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eccc3560e00/0x418ffb1c3bcc8cc9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x418ffb1c3bcc8cc2 expref: 9 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772453.559027:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ecdf5012a00/0x418ffb1c3bcc8e35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x418ffb1c3bcc8e2e expref: 8 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772453.559037:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eccc3560800/0x418ffb1c3bcc9161 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x418ffb1c3bcc915a expref: 7 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772453.559046:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eccc3561600/0x418ffb1c3bcc8d86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x418ffb1c3bcc8d7f expref: 6 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772453.559055:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eccc3561a00/0x418ffb1c3bcc8cd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x418ffb1c3bcc8cd0 expref: 5 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772453.559066:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eccc3560a00/0x418ffb1c3bcc8ce5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x418ffb1c3bcc8cde expref: 4 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772453.559076:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eccc1bd0600/0x418ffb1c3bcc916f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x418ffb1c3bcc9168 expref: 3 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772453.559086:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ecdc0031400/0x418ffb1c3bcc8ecf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x418ffb1c3bcc8ec8 expref: 2 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772453.559095:0:17180:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9eccc3504800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1790772453.559110:0:17180:0:(genops.c:885:class_export_put()) final put ffff9eccc3504800/e96364ee-79c0-4114-891b-7127f484e910 00010000:00010000:1.0:1790772453.559117:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772453.559119:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772453.559121:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790772453.559136:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ecdfc528000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1790772453.559143:0:37:0:(genops.c:885:class_export_put()) final put ffff9ecdc3e4c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790772453.559147:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecdc3e4c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1790772453.559153:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790772453.559212:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc1b5f000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1790772453.559216:0:37:0:(genops.c:885:class_export_put()) final put ffff9ecdd072d800/lustre-MDD0000_UUID 00000020:00000080:1.0:1790772453.559218:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecdd072d800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1790772453.559221:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1790772453.559243:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc1b5d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790772453.559248:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc3504800/e96364ee-79c0-4114-891b-7127f484e910 for MGS 00000020:00000080:1.0:1790772453.559284:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eccc3503800 for MGS 00000020:01000000:3.0:1790772453.564348:0:20764:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9eccc21118a0 - data ffff9ecdf0d151b0/ffff9ecdfb40c400 00000020:01000000:3.0:1790772453.564466:0:20764:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9ecdc3efae40 - data ffff9ecdf0ddf510/ffff9ecde0416400 00000020:00000080:3.0:1790772453.564885:0:20764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8b8e 00000020:00000080:3.0:1790772453.564894:0:20764:0:(genops.c:885:class_export_put()) final put ffff9eccc3503000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1790772453.564905:0:20764:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9eccc3507000 from MGS, refs=2 00000020:01000004:3.0:1790772453.564909:0:20764:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eccc3507000 2 00000020:01000004:3.0:1790772453.564923:0:20764:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9eccc3507000 from MGS 00000020:00000080:3.0:1790772453.564950:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790772453.564956:0:20764:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1790772453.564959:0:20764:0:(genops.c:885:class_export_put()) final put ffff9eccc3505800/MGS 00000020:00000080:3.0:1790772453.564962:0:20764:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc3505800/MGS for MGS 00000020:01000000:3.0:1790772453.564968:0:20764:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1790772453.565030:0:20764:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1790772453.565034:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790772453.565040:0:20764:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1790772453.565046:0:20764:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9ecdff753000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790772453.565052:0:20764:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff9ecdfa9f8000) has exports, disconnecting them 00000020:00080000:3.0:1790772453.565057:0:20764:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9ecdff753000), last request at 1790772361 00000020:00000080:3.0:1790772453.565061:0:20764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8c91 00000020:00080000:3.0:1790772453.565071:0:20764:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ecdff753000): rc 0 00000020:00000080:3.0:1790772453.565075:0:20764:0:(genops.c:885:class_export_put()) final put ffff9ecdff753000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1790772453.565877:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc3503000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790772453.565889:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecdff753000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1790772453.646238:0:20764:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1790772453.646247:0:20764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790772453.646251:0:20764:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790772453.646258:0:20764:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790772453.646297:0:19463:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ecdd0ee3800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1790772453.646470:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790772453.646479:0:20764:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1790772453.646484:0:20764:0:(genops.c:885:class_export_put()) final put ffff9ecdd0ee0000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1790772453.646488:0:20764:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecdd0ee0000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1790772453.646498:0:20764:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1790772453.646589:0:20764:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eccc3507000 1 00000020:00000080:1.0:1790772453.646595:0:20764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8b80 00000020:00000080:1.0:1790772453.646602:0:20764:0:(genops.c:885:class_export_put()) final put ffff9eccc3504000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1790772453.646609:0:20764:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1790772453.646617:0:19463:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc3504000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790772453.646691:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790772453.646704:0:20764:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790772453.646708:0:20764:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9ecdfb8e3380) has no exports 00000020:00000080:1.0:1790772453.829409:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790772453.829421:0:20764:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1790772453.829426:0:20764:0:(genops.c:885:class_export_put()) final put ffff9eccc3501000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790772453.829431:0:20764:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc3501000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1790772453.829442:0:20764:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1790772453.829555:0:20764:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9eccc3506800 00000020:02000400:1.0:1790772453.829610:0:20764:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:1.0:1790772454.165328:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790772454.165344:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506296832:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790772454.165402:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772454.165510:0:19985:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506296832 00000100:00100000:3.0:1790772454.165518:0:19985:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506296832 00000100:00100000:3.0:1790772454.165576:0:19985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790772454.165584:0:19985:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf8091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506296832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790772454.165611:0:19985:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1790772454.165658:0:19985:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf8091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506296832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772454.165665:0:19985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1790772454.165668:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790772454.165673:0:19463:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790772454.165686:0:19463:0:(import.c:65:import_set_state_nolock()) ffff9ecdfb8bd000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00010000:00010000:3.0:1790772454.165689:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790772454.165692:0:19463:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 549 00000100:00080000:2.0:1790772454.165697:0:19463:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790772454.165704:0:19463:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9ecdfb8bd000 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:3.0:1790772454.165719:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeed3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e96364ee-79c0-4114-891b-7127f484e910:3645:1877760506296960:0@lo:400:kworker.0 00000100:00100000:2.0:1790772454.165726:0:19463:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdeed3d180 x1877760506297088/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:3.0:1790772454.165745:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877760506296960 offset 0 length 224: 4 00000100:00080000:2.0:1790772454.165755:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790772454.165759:0:19463:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790772454.165761:0:19463:0:(import.c:65:import_set_state_nolock()) ffff9ecdc87eb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790772454.165766:0:19463:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 549 00000100:00080000:2.0:1790772454.165769:0:19463:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:3.0:1790772454.165772:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:2.0:1790772454.165774:0:19463:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9ecdc87eb800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:3.0:1790772454.165781:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeed3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506297216:0@lo:400:kworker.0 00000100:00100000:2.0:1790772454.165787:0:19463:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdeed3ea00 x1877760506297344/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790772454.165799:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790772454.165810:0:19463:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790772454.165812:0:19463:0:(import.c:65:import_set_state_nolock()) ffff9eccc2242000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790772454.165815:0:19463:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 549 00000100:00080000:2.0:1790772454.165817:0:19463:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790772454.165822:0:19463:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9eccc2242000 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:2.0:1790772454.165834:0:19463:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdeed3fb80 x1877760506297472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790772454.165845:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790772454.165861:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790772454.165865:0:19463:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790772454.165867:0:19463:0:(import.c:65:import_set_state_nolock()) ffff9eccc2275800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790772454.165871:0:19463:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 549 00000100:00080000:2.0:1790772454.165873:0:19463:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790772454.165877:0:19463:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9eccc2275800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:3.0:1790772454.165881:0:19556:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506297216 00000100:00100000:3.0:1790772454.165886:0:19556:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506297216 00000100:00100000:2.0:1790772454.165888:0:19463:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdeed3f480 x1877760506297728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790772454.165919:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeed3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1877760506297088:0@lo:38:kworker.0 00000100:00100000:3.0:1790772454.165923:0:19556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790772454.165932:0:19556:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc12af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506297216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772454.165954:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772454.165977:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeed3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877760506297344:0@lo:38:kworker.0 00000100:00100000:3.0:1790772454.165983:0:19556:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc12af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506297216:12345-0@lo:400:kworker.0 Request processed in 50us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772454.165991:0:19556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790772454.166005:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772454.166017:0:17197:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506297088 00000100:00100000:3.0:1790772454.166022:0:17197:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506297088 00000100:00100000:2.0:1790772454.166026:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeed3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1877760506297472:0@lo:38:kworker.0 00000100:00100000:3.0:1790772454.166045:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790772454.166053:0:17197:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeed3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1877760506297088:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1790772454.166056:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:3.0:1790772454.166073:0:17197:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790772454.166079:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeed3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1877760506297728:0@lo:38:kworker.0 00000100:00100000:2.0:1790772454.166117:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772454.166149:0:17192:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506297344 00000100:00100000:2.0:1790772454.166160:0:17192:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506297344 00000100:00100000:2.0:1790772454.166200:0:17192:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506297472 00000100:00100000:2.0:1790772454.166204:0:17192:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506297472 00000100:00100000:2.0:1790772454.166216:0:17192:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506297728 00000100:00100000:2.0:1790772454.166218:0:17192:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506297728 00000100:00100000:2.0:1790772454.166227:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790772454.166231:0:17192:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeed3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1877760506297344:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1790772454.166241:0:17192:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790772454.166287:0:17192:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeed3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1877760506297344:12345-0@lo:38:kworker.0 Request processed in 54us (282us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790772454.166293:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790772454.166310:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790772454.166314:0:17192:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc369d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1877760506297472:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1790772454.166322:0:17192:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790772454.166346:0:17192:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc369d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1877760506297472:12345-0@lo:38:kworker.0 Request processed in 31us (295us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790772454.166351:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790772454.166361:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790772454.166365:0:17192:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf62e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1877760506297728:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1790772454.166372:0:17192:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790772454.166392:0:17192:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf62e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1877760506297728:12345-0@lo:38:kworker.0 Request processed in 26us (275us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790772454.166397:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1790772454.166446:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ecdc87eb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790772454.166450:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790772454.166454:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeed3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877760506297344:0@lo:38:kworker.0 00000100:00080000:2.0:1790772454.166472:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9eccc2242000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790772454.166476:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790772454.166479:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeed3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1877760506297472:0@lo:38:kworker.0 00000100:00080000:2.0:1790772454.166485:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9eccc2275800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790772454.166488:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790772454.166491:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeed3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1877760506297728:0@lo:38:kworker.0 00000100:00100000:2.0:1790772454.166528:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeed3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1877760506297856:0@lo:400:kworker.0 00000100:00100000:2.0:1790772454.166551:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772454.166583:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790772454.166589:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeed3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1877760506297600:0@lo:400:kworker.0 00000100:00100000:2.0:1790772454.166609:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772454.166628:0:18466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506297856 00000100:00100000:2.0:1790772454.166632:0:18466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506297856 00000100:00100000:2.0:1790772454.166655:0:18466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506297600 00000100:00100000:2.0:1790772454.166657:0:18466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506297600 00000100:00100000:2.0:1790772454.166673:0:18466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790772454.166678:0:18466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf62e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1877760506297856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772454.166712:0:18466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf62e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1877760506297856:12345-0@lo:400:kworker.0 Request processed in 34us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772454.166719:0:18466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790772454.166731:0:18466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790772454.166737:0:18466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf62e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1877760506297600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772454.166762:0:18466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf62e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1877760506297600:12345-0@lo:400:kworker.0 Request processed in 25us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772454.166767:0:18466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:2.0:1790772454.166805:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9ecdeed3e680 x1877760506297600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772454.166816:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeed3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1877760506297600:0@lo:400:kworker.0 00010000:00080000:2.0:1790772454.166825:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9ecdeed3d500 x1877760506297856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772454.166832:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeed3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1877760506297856:0@lo:400:kworker.0 00000100:00100000:2.0:1790772454.166865:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506296832:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790772454.166897:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeed3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506297216:0@lo:400:kworker.0 00000100:00080000:1.0:1790772454.168862:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790772454.168872:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790772454.168874:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790772454.203142:0:17197:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeed3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1877760506297088:12345-0@lo:38:kworker.0 Request processed in 37083us (37182us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790772454.203155:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1790772454.203382:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ecdfb8bd000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790772454.203389:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790772454.203393:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeed3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1877760506297088:0@lo:38:kworker.0 00010000:00010000:2.0:1790772455.191952:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772456.212451:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772457.237160:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790772457.237199:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1877760506297984:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790772457.237277:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790772457.244237:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772457.246209:0:19986:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506297984 00000100:00100000:2.0:1790772457.246221:0:19986:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506297984 00000100:00100000:2.0:1790772457.246298:0:19986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790772457.246307:0:19986:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc12af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1877760506297984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790772457.246340:0:19986:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1790772457.246428:0:19986:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc12af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1877760506297984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (9150us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772457.246436:0:19986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790772457.246489:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1877760506297984:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1790772457.247675:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000004:1.0:1790772458.141522:0:20966:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1790772458.158867:0:20966:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1790772458.158922:0:20966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9eccc3560400/0x418ffb1c3bcc8d7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc8d86 expref: -99 pid: 17923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772458.158954:0:20966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9eccc3560400/0x418ffb1c3bcc8d7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc8d86 expref: -99 pid: 17923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772458.158961:0:20966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9eccc3560400/0x418ffb1c3bcc8d7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x418ffb1c3bcc8d86 expref: -99 pid: 17923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772458.158968:0:20966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.114@tcp lock: ffff9eccc3560400/0x418ffb1c3bcc8d7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x418ffb1c3bcc8d86 expref: -99 pid: 17923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772458.159001:0:20966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790772458.159007:0:20966:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1790772458.159033:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772458.159039:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9eccc3560400/0x418ffb1c3bcc8d7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x418ffb1c3bcc8d86 expref: -99 pid: 17923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772458.159047:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc3560400 already unused, calling callback (ffffffffc11ffc20) 10000000:00010000:2.0:1790772458.159050:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9eccc3560400/0x418ffb1c3bcc8d7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x418ffb1c3bcc8d86 expref: -99 pid: 17923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772458.159059:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9eccc3560400/0x418ffb1c3bcc8d7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x418ffb1c3bcc8d86 expref: -99 pid: 17923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772458.159066:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9eccc3560400/0x418ffb1c3bcc8d7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x418ffb1c3bcc8d86 expref: -99 pid: 17923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772458.159072:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790772458.159075:0:17181:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1790772458.159077:0:17181:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1790772458.159109:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9eccc3560400/0x418ffb1c3bcc8d7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x418ffb1c3bcc8d86 expref: -99 pid: 17923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772458.159122:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790772458.159145:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9eccc3560400/0x418ffb1c3bcc8d7f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x418ffb1c3bcc8d86 expref: -99 pid: 17923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772458.159152:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9eccc3560400/0x418ffb1c3bcc8d7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x418ffb1c3bcc8d86 expref: -99 pid: 17923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772458.159181:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772458.159184:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772458.159186:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772458.159204:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e96364ee-79c0-4114-891b-7127f484e910:3646:1877760506298112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790772458.159281:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790772458.159526:0:20966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790772458.159530:0:20966:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1790772458.159536:0:20966:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790772458.159542:0:20966:0:(import.c:65:import_set_state_nolock()) ffff9ecdc87eb800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1790772458.159546:0:20966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790772458.159548:0:20966:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790772458.159550:0:20966:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1790772458.159861:0:17179:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506298112 00000100:00100000:3.0:1790772458.159868:0:17179:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506298112 00000100:00100000:3.0:1790772458.159907:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790772458.159913:0:17179:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf62e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3646:x1877760506298112:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1790772458.159919:0:17179:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790772458 with bad export cookie 4724270632815856554 00010000:00010000:0.0:1790772458.165527:0:20966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0400/0x418ffb1c3bcc8cde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc8ce5 expref: -99 pid: 17923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772458.165546:0:20966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0400/0x418ffb1c3bcc8cde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc8ce5 expref: -99 pid: 17923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772458.165570:0:20966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0400/0x418ffb1c3bcc8cde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x418ffb1c3bcc8ce5 expref: -99 pid: 17923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772458.165577:0:20966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0400/0x418ffb1c3bcc8cde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x418ffb1c3bcc8ce5 expref: -99 pid: 17923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772458.165601:0:20966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772458.165608:0:20966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9eccc3560200/0x418ffb1c3bcc909d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc90a4 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772458.165614:0:20966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9eccc3560200/0x418ffb1c3bcc909d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc90a4 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772458.165620:0:20966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9eccc3560200/0x418ffb1c3bcc909d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x418ffb1c3bcc90a4 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772458.165627:0:20966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.114@tcp lock: ffff9eccc3560200/0x418ffb1c3bcc909d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x418ffb1c3bcc90a4 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772458.165645:0:20966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790772458.165653:0:20966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdd1ad1600/0x418ffb1c3bcc9168 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc916f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772458.165659:0:20966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdd1ad1600/0x418ffb1c3bcc9168 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc916f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772458.165664:0:20966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdd1ad1600/0x418ffb1c3bcc9168 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x418ffb1c3bcc916f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772458.165680:0:20966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.114@tcp lock: ffff9ecdd1ad1600/0x418ffb1c3bcc9168 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x418ffb1c3bcc916f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772458.165688:0:20966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1790772458.165693:0:20966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1200/0x418ffb1c3bcc8cd0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc8cd7 expref: -99 pid: 17923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772458.165700:0:20966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1200/0x418ffb1c3bcc8cd0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc8cd7 expref: -99 pid: 17923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772458.165706:0:20966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1200/0x418ffb1c3bcc8cd0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x418ffb1c3bcc8cd7 expref: -99 pid: 17923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772458.165712:0:20966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1200/0x418ffb1c3bcc8cd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x418ffb1c3bcc8cd7 expref: -99 pid: 17923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772458.165720:0:20966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1790772458.165723:0:20966:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:2.0:1790772458.165839:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1790772458.165847:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0400/0x418ffb1c3bcc8cde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x418ffb1c3bcc8ce5 expref: -99 pid: 17923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772458.165855:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdfbab0400 already unused, calling callback (ffffffffc11ffc20) 10000000:00010000:2.0:1790772458.165858:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0400/0x418ffb1c3bcc8cde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x418ffb1c3bcc8ce5 expref: -99 pid: 17923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772458.165868:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0400/0x418ffb1c3bcc8cde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x418ffb1c3bcc8ce5 expref: -99 pid: 17923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772458.165882:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0400/0x418ffb1c3bcc8cde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x418ffb1c3bcc8ce5 expref: -99 pid: 17923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772458.165887:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790772458.165890:0:17181:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:2.0:1790772458.165892:0:17181:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:2.0:1790772458.165927:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0400/0x418ffb1c3bcc8cde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x418ffb1c3bcc8ce5 expref: -99 pid: 17923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772458.165934:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790772458.165954:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0400/0x418ffb1c3bcc8cde lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x418ffb1c3bcc8ce5 expref: -99 pid: 17923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772458.165961:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0400/0x418ffb1c3bcc8cde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x418ffb1c3bcc8ce5 expref: -99 pid: 17923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772458.165974:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790772458.165977:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9eccc3560200/0x418ffb1c3bcc909d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x418ffb1c3bcc90a4 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772458.165982:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc3560200 already unused, calling callback (ffffffffc11ffc20) 10000000:00010000:2.0:1790772458.166205:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9eccc3560200/0x418ffb1c3bcc909d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x418ffb1c3bcc90a4 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772458.166214:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9eccc3560200/0x418ffb1c3bcc909d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x418ffb1c3bcc90a4 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772458.166220:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9eccc3560200/0x418ffb1c3bcc909d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x418ffb1c3bcc90a4 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772458.166235:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1790772458.166237:0:17181:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1790772458.166250:0:17181:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1790772458.166266:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9eccc3560200/0x418ffb1c3bcc909d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x418ffb1c3bcc90a4 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772458.166272:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790772458.166279:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9eccc3560200/0x418ffb1c3bcc909d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x418ffb1c3bcc90a4 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772458.166285:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9eccc3560200/0x418ffb1c3bcc909d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x418ffb1c3bcc90a4 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772458.166301:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790772458.166305:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9ecdd1ad1600/0x418ffb1c3bcc9168 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x418ffb1c3bcc916f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772458.166310:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdd1ad1600 already unused, calling callback (ffffffffc11ffc20) 10000000:00010000:2.0:1790772458.166313:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9ecdd1ad1600/0x418ffb1c3bcc9168 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x418ffb1c3bcc916f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772458.166320:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9ecdd1ad1600/0x418ffb1c3bcc9168 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x418ffb1c3bcc916f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772458.166327:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9ecdd1ad1600/0x418ffb1c3bcc9168 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x418ffb1c3bcc916f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772458.166331:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790772458.166334:0:17181:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1790772458.166340:0:17181:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1790772458.166354:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9ecdd1ad1600/0x418ffb1c3bcc9168 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x418ffb1c3bcc916f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772458.166360:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790772458.166375:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9ecdd1ad1600/0x418ffb1c3bcc9168 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x418ffb1c3bcc916f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772458.166382:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9ecdd1ad1600/0x418ffb1c3bcc9168 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x418ffb1c3bcc916f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772458.166392:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772458.166395:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1200/0x418ffb1c3bcc8cd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x418ffb1c3bcc8cd7 expref: -99 pid: 17923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772458.166400:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdfbab1200 already unused, calling callback (ffffffffc11ffc20) 10000000:00010000:2.0:1790772458.166402:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1200/0x418ffb1c3bcc8cd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x418ffb1c3bcc8cd7 expref: -99 pid: 17923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772458.166408:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1200/0x418ffb1c3bcc8cd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x418ffb1c3bcc8cd7 expref: -99 pid: 17923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772458.166414:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1200/0x418ffb1c3bcc8cd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x418ffb1c3bcc8cd7 expref: -99 pid: 17923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772458.166420:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1790772458.166422:0:17181:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1790772458.166424:0:17181:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1790772458.166435:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1200/0x418ffb1c3bcc8cd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x418ffb1c3bcc8cd7 expref: -99 pid: 17923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772458.166441:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790772458.166455:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1200/0x418ffb1c3bcc8cd0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x418ffb1c3bcc8cd7 expref: -99 pid: 17923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772458.166461:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1200/0x418ffb1c3bcc8cd0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x418ffb1c3bcc8cd7 expref: -99 pid: 17923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772458.166472:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772458.166474:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772458.166475:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772458.166493:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e96364ee-79c0-4114-891b-7127f484e910:3643:1877760506298240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790772458.166553:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772458.166598:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790772458.166604:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e96364ee-79c0-4114-891b-7127f484e910:3643:1877760506298368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790772458.166624:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772458.166646:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e96364ee-79c0-4114-891b-7127f484e910:3646:1877760506298624:0@lo:103:ldlm_bl.0 00000020:01000004:0.0:1790772458.167849:0:20966:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1790772458.167853:0:20966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1790772458.167857:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790772458.167864:0:20966:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1790772458.167870:0:20966:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9eccc2273800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790772458.167876:0:20966:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9eccc3795000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790772458.167882:0:20966:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff9eccc37419c0) has exports, disconnecting them 00000020:00080000:0.0:1790772458.167886:0:20966:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9eccc2273800), last request at 1790772454 00000020:00000080:0.0:1790772458.167893:0:20966:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8ef9 00000100:00080000:0.0:1790772458.167911:0:20966:0:(import.c:65:import_set_state_nolock()) ffff9eccc2271000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1790772458.167967:0:20966:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9eccc2273800): rc 0 00000020:00000080:0.0:1790772458.167970:0:20966:0:(genops.c:885:class_export_put()) final put ffff9eccc2273800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1790772458.167981:0:20966:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9eccc3795000), last request at 1790772454 00000100:00100000:2.0:1790772458.168130:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772458.168189:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790772458.168198:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e96364ee-79c0-4114-891b-7127f484e910:3646:1877760506298496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790772458.168250:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772458.168279:0:17178:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1790772458.168287:0:17178:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1790772458.168303:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790772458.168312:0:19463:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc2273800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1790772458.168362:0:19463:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eccc2271000 for lustre-MDT0001 00010000:00010000:2.0:1790772458.168971:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772458.168981:0:17177:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000020:00000080:0.0:1790772458.169512:0:20966:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8e5f 00000100:00080000:0.0:1790772458.169524:0:20966:0:(import.c:65:import_set_state_nolock()) ffff9eccc3796000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1790772458.169546:0:20966:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9eccc3795000): rc 0 00000020:00000080:0.0:1790772458.169549:0:20966:0:(genops.c:885:class_export_put()) final put ffff9eccc3795000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1790772458.169561:0:20966:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb37a01cb7ae0 00000100:00080000:0.0:1790772458.169578:0:20966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790772458.169586:0:20966:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9ecdeec52300 x1877760506294912/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1790772463 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772458.169599:0:20966:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000020:00000080:1.0:1790772458.170255:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc3795000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1790772458.170300:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eccc3796000 for lustre-MDT0001 00010000:00010000:1.0:1790772458.170312:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772458.171878:0:17177:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506298240 00000100:00100000:2.0:1790772458.171891:0:17177:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506298240 00000100:00100000:2.0:1790772458.171931:0:17177:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1790772458.171952:0:17177:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506298368 00000100:00100000:2.0:1790772458.171955:0:17177:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506298368 00000100:00100000:2.0:1790772458.171967:0:17177:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1790772458.171971:0:17177:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506298624 00000100:00100000:2.0:1790772458.171974:0:17177:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506298624 00000100:00080000:0.0:1790772458.172445:0:20966:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790772458.172453:0:20966:0:(import.c:65:import_set_state_nolock()) ffff9ecdfb8bd000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:2.0:1790772458.173823:0:17177:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1790772458.173847:0:17177:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506298496 00000100:00100000:2.0:1790772458.173854:0:17177:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506298496 00000100:00100000:2.0:1790772458.173909:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1877760506294912:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790772458.176452:0:20967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790772458.176470:0:20967:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf62e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3643:x1877760506298240:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790772458.176479:0:20967:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790772458 with bad export cookie 4724270632815856554 00000100:00100000:2.0:1790772458.176580:0:20967:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf62e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3643:x1877760506298240:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (10026us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790772458.176588:0:20967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790772458.176610:0:20967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790772458.176614:0:20967:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf62e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3643:x1877760506298368:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790772458.176619:0:20967:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790772458 with bad export cookie 4724270632815856554 00000100:00100000:2.0:1790772458.176647:0:20967:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf62e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3643:x1877760506298368:12345-0@lo:103:ldlm_bl.0 Request processed in 31us (10021us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790772458.176653:0:20967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790772458.176678:0:20967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790772458.176682:0:20967:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf62e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3646:x1877760506298624:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790772458.176687:0:20967:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790772458 with bad export cookie 4724270632815856554 00000100:00100000:2.0:1790772458.176717:0:20967:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf62e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3646:x1877760506298624:12345-0@lo:103:ldlm_bl.0 Request processed in 34us (10050us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790772458.176724:0:20967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1790772458.176757:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.114@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1790772458.176774:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9eccc3f6d800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1790772458.176778:0:3646:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.114@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1790772458.176833:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.114@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:3.0:1790772458.184161:0:17179:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf62e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3646:x1877760506298112:12345-0@lo:103:ldlm_bl.0 Request processed in 24242us (24875us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790772458.184277:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790772458.184309:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790772458.184316:0:17179:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf62e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3646:x1877760506298496:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1790772458.184322:0:17179:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790772458 with bad export cookie 4724270632815856554 00000100:00100000:3.0:1790772458.184352:0:17179:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf62e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3646:x1877760506298496:12345-0@lo:103:ldlm_bl.0 Request processed in 36us (16113us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790772458.184358:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1790772458.193546:0:20966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790772458.193553:0:20966:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1790772458.193576:0:20966:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1790772458.193641:0:20966:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1790772458.193680:0:20966:0:(import.c:65:import_set_state_nolock()) ffff9ecdefcd0000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1790772458.193699:0:20966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790772458.193702:0:20966:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1790772458.193709:0:20966:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790772458.193790:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1877760506298752:0@lo:9:umount.0 00000100:00100000:3.0:1790772458.193854:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772458.193905:0:19248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506298752 00000100:00100000:3.0:1790772458.193912:0:19248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506298752 00000100:00100000:3.0:1790772458.193955:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790772458.193963:0:19248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc12ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1877760506298752:12345-0@lo:9:umount.0 00000020:00000080:3.0:1790772458.194257:0:19248:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8e89 00000100:00080000:3.0:1790772458.194268:0:19248:0:(import.c:65:import_set_state_nolock()) ffff9eccc2256800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790772458.194312:0:19248:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1790772458.194635:0:19248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc12ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3642:x1877760506298752:12345-0@lo:9:umount.0 Request processed in 672us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772458.194643:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1790772458.195229:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ecdefcd0000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1790772458.195236:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1790772458.195238:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790772458.195253:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1877760506298752:0@lo:9:umount.0 00000100:00080000:3.0:1790772458.195277:0:20966:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1790772458.195293:0:20966:0:(import.c:65:import_set_state_nolock()) ffff9eccc35f8000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1790772458.195316:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1877760506298880:0@lo:9:umount.0 00000100:00100000:3.0:1790772458.195348:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772458.195381:0:18698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506298880 00000100:00100000:3.0:1790772458.195386:0:18698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506298880 00000100:00100000:3.0:1790772458.195422:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790772458.195430:0:18698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc12af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1877760506298880:12345-0@lo:9:umount.0 00000020:00000080:3.0:1790772458.195447:0:18698:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8f15 00000100:00080000:3.0:1790772458.195455:0:18698:0:(import.c:65:import_set_state_nolock()) ffff9eccc24ed000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790772458.195481:0:18698:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1790772458.195583:0:18698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc12af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3642:x1877760506298880:12345-0@lo:9:umount.0 Request processed in 154us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772458.195590:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1790772458.195617:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9eccc35f8000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1790772458.195621:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1790772458.195623:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790772458.195625:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1877760506298880:0@lo:9:umount.0 00000100:00080000:1.0:1790772458.197047:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1790772458.197059:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1790772458.197301:0:20966:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9eccc37419c0) has no exports 00010000:00010000:3.0:1790772458.210415:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790772458.223387:0:3646:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.114@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1790772458.223393:0:3646:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1790772458.223402:0:3646:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ecdeed3f800 x1877760506296960/t0(0) o400->MGC192.168.206.114@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790772470 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772458.223426:0:3646:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ecdf62e7100 x1877760506298112/t0(0) o103->MGC192.168.206.114@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790772474 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772458.223435:0:3646:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ecdf62e4380 x1877760506298240/t0(0) o103->MGC192.168.206.114@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790772474 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772458.223445:0:3646:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ecdf62e5c00 x1877760506298368/t0(0) o103->MGC192.168.206.114@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790772474 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772458.223453:0:3646:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ecdf62e7480 x1877760506298624/t0(0) o103->MGC192.168.206.114@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790772474 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772458.223461:0:3646:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ecdf62e6680 x1877760506298496/t0(0) o103->MGC192.168.206.114@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790772474 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1790772458.223639:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1790772458.223642:0:3646:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1790772458.223644:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1790772458.223951:0:3643:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9eccc3f6d800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1790772458.224041:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e96364ee-79c0-4114-891b-7127f484e910:3643:1877760506298240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790772458.224067:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e96364ee-79c0-4114-891b-7127f484e910:3643:1877760506298368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790772458.224105:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeed3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e96364ee-79c0-4114-891b-7127f484e910:3645:1877760506296960:0@lo:400:kworker.0 00000100:00080000:2.0:1790772458.224505:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9eccc3f6d800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790772458.224511:0:3646:0:(import.c:545:import_select_connection()) MGC192.168.206.114@tcp: connect to NID 0@lo last attempt 461 00000100:00080000:2.0:1790772458.224522:0:3646:0:(import.c:666:import_select_connection()) MGC192.168.206.114@tcp: import ffff9eccc3f6d800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:2.0:1790772458.224662:0:3646:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdf62e4e00 x1877760506299008/t0(0) o250->MGC192.168.206.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790772458.224700:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e96364ee-79c0-4114-891b-7127f484e910:3646:1877760506298112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790772458.224719:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e96364ee-79c0-4114-891b-7127f484e910:3646:1877760506298496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790772458.224749:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e96364ee-79c0-4114-891b-7127f484e910:3646:1877760506298624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790772458.224778:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e96364ee-79c0-4114-891b-7127f484e910:3642:1877760506299008:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:2.0:1790772458.224819:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877760506299008 offset 0 length 520: 4 00000020:00080000:2.0:1790772458.232743:0:20966:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9eccc37419c0) has no exports 00010000:00010000:1.0:1790772458.260379:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1790772458.310022:0:20966:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9ecdfc4aa5a0 - data ffff9ecdf0e211b0/ffff9ecdfc959000 00000020:01000000:3.0:1790772458.310162:0:20966:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9ecdfc4aa8a0 - data ffff9ecdf0dba870/ffff9ecdfcef1c00 00000001:00000004:3.0:1790772458.325444:0:20966:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:1.0:1790772458.371574:0:20966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790772458.371582:0:20966:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790772458.371589:0:20966:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1790772458.379623:0:20966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1790772458.379631:0:20966:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:1.0:1790772458.379646:0:20966:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790772458.379648:0:20966:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1790772458.381610:0:17932:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1790772458.381628:0:17932:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:3.0:1790772458.381637:0:17932:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1790772458.382409:0:20966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1790772458.382414:0:20966:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:1.0:1790772458.382427:0:20966:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790772458.382429:0:20966:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1790772458.383832:0:17934:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1790772458.383839:0:17934:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:2.0:1790772458.383852:0:17934:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1790772458.391941:0:20966:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8cf3 00000020:00000080:1.0:1790772458.391954:0:20966:0:(genops.c:885:class_export_put()) final put ffff9ecdfb8b8000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1790772458.392126:0:19463:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecdfb8b8000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1790772458.393328:0:20966:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8d08 00000020:00000080:1.0:1790772458.393339:0:20966:0:(genops.c:885:class_export_put()) final put ffff9ecde13c4000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1790772458.393471:0:20966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1790772458.393477:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790772458.393485:0:20966:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790772458.393490:0:20966:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9eccc3744d40) has no exports 00000004:01000000:1.0:1790772458.393647:0:20966:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1790772458.393655:0:20966:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8d5c 00000020:00000080:1.0:1790772458.393660:0:20966:0:(genops.c:885:class_export_put()) final put ffff9ecdfb8eb000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790772458.393969:0:19463:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecde13c4000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1790772458.395295:0:20966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1790772458.395306:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790772458.395317:0:20966:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1790772458.395322:0:20966:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff9ecdfb8e4d40) has no exports 00000020:00000080:1.0:1790772458.395331:0:20966:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8d55 00000020:00000080:1.0:1790772458.395351:0:20966:0:(genops.c:885:class_export_put()) final put ffff9eccc35ff000/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1790772458.396140:0:20966:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1790772458.396145:0:20966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1790772458.396149:0:20966:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1790772458.396156:0:20966:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790772458.396158:0:20966:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790772458.396226:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790772458.396234:0:20966:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1790772458.396250:0:20966:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8d47 00000020:00000080:1.0:1790772458.396257:0:20966:0:(genops.c:885:class_export_put()) final put ffff9ecdefcd1800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1790772458.396261:0:20966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1790772458.396265:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790772458.396279:0:20966:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1790772458.396282:0:20966:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9ecdfa984d40) has no exports 00000020:00000080:1.0:1790772458.396287:0:20966:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8d40 00000020:00000080:1.0:1790772458.396291:0:20966:0:(genops.c:885:class_export_put()) final put ffff9ecdefcd4000/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1790772458.396622:0:20966:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1790772458.396626:0:20966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1790772458.396628:0:20966:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1790772458.396632:0:20966:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790772458.396634:0:20966:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790772458.396652:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790772458.396657:0:20966:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1790772458.396667:0:20966:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1790772458.397048:0:19463:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecdfb8eb000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1790772458.397059:0:19463:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc35ff000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1790772458.397064:0:19463:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eccc35f8000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1790772458.397070:0:19463:0:(genops.c:885:class_export_put()) final put ffff9ecdefcd2000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790772458.397072:0:19463:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecdefcd2000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1790772458.397076:0:19463:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790772458.397157:0:19463:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecdefcd1800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1790772458.397162:0:19463:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecdefcd4000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1790772458.397377:0:19463:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ecdefcd0000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1790772458.397382:0:19463:0:(genops.c:885:class_export_put()) final put ffff9ecdefcd4800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790772458.397385:0:19463:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecdefcd4800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1790772458.397388:0:19463:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1790772458.397803:0:20966:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8d2b 00000020:00000080:1.0:1790772458.397811:0:20966:0:(genops.c:885:class_export_put()) final put ffff9ecdc8829000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1790772458.397831:0:20966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1790772458.397836:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790772458.397842:0:20966:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1790772458.397846:0:20966:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff9ecdfb8e0000) has no exports 00000020:00000080:1.0:1790772458.397852:0:20966:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8d24 00000020:00000080:1.0:1790772458.397856:0:20966:0:(genops.c:885:class_export_put()) final put ffff9ecdfb8bf000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1790772458.398438:0:19463:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecdc8829000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1790772458.398447:0:19463:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecdfb8bf000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1790772458.419282:0:20966:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1790772458.419290:0:20966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790772458.419295:0:20966:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790772458.419301:0:20966:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790772458.419362:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790772458.419373:0:20966:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790772458.419413:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790772458.419417:0:20966:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790772458.419422:0:20966:0:(genops.c:885:class_export_put()) final put ffff9ecdfb8ba000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1790772458.419426:0:20966:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecdfb8ba000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1790772458.419438:0:20966:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790772458.419569:0:20966:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8d0f 00000020:00000080:2.0:1790772458.419575:0:20966:0:(genops.c:885:class_export_put()) final put ffff9ecde13c7800/lustre-MDD0001_UUID 00000020:01000000:2.0:1790772458.419580:0:20966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1790772458.419584:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790772458.419588:0:20966:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790772458.419592:0:20966:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9eccc3740000) has no exports 00000020:00000080:2.0:1790772458.419612:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790772458.419615:0:20966:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1790772458.419618:0:20966:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8d16 00000020:00000080:2.0:1790772458.419622:0:20966:0:(genops.c:885:class_export_put()) final put ffff9ecde13c0000/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1790772458.419629:0:20966:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9eccc326e800 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1790772458.419640:0:20966:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eccc326e800 2 00000020:01000004:2.0:1790772458.419643:0:20966:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9eccc326e800 from lustre-MDT0001 00000020:00000080:2.0:1790772458.419660:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790772458.419663:0:20966:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1790772458.419665:0:20966:0:(genops.c:885:class_export_put()) final put ffff9ecdfb8bc800/lustre-MDT0001_UUID 00000020:00000080:2.0:1790772458.419679:0:20966:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecdfb8bc800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1790772458.419685:0:20966:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1790772458.419712:0:20966:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1790772458.419715:0:20966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1790772458.419718:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790772458.419721:0:20966:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790772458.419735:0:20966:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9ecdc87e8000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790772458.419740:0:20966:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff9ecddfe2b380) has exports, disconnecting them 00000020:00080000:2.0:1790772458.419744:0:20966:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9ecdc87e8000), last request at 1790772375 00000020:00000080:2.0:1790772458.419748:0:20966:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8d94 00000020:00080000:2.0:1790772458.419758:0:20966:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ecdc87e8000): rc 0 00000020:00000080:2.0:1790772458.419760:0:20966:0:(genops.c:885:class_export_put()) final put ffff9ecdc87e8000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1790772458.420437:0:19463:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ecdfb8bd000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1790772458.420447:0:19463:0:(genops.c:885:class_export_put()) final put ffff9ecde10ba000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790772458.420450:0:19463:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecde10ba000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1790772458.420458:0:19463:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790772458.420553:0:19463:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecde13c7800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1790772458.420558:0:19463:0:(genops.c:885:class_export_put()) final put ffff9ecdfb8b9800/lustre-MDD0001_UUID 00000020:00000080:3.0:1790772458.420560:0:19463:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecdfb8b9800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1790772458.420563:0:19463:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1790772458.420645:0:19463:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecde13c0000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1790772458.420658:0:19463:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecdc87e8000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1790772458.420685:0:20966:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1790772458.420688:0:20966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790772458.420691:0:20966:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1790772458.420696:0:20966:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790772458.420715:0:19463:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ecdc87eb800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1790772458.420851:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790772458.420857:0:20966:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1790772458.420860:0:20966:0:(genops.c:885:class_export_put()) final put ffff9eccc35fb800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1790772458.420863:0:20966:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc35fb800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1790772458.420866:0:20966:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1790772458.420893:0:20966:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eccc326e800 1 00000020:00000080:3.0:1790772458.420897:0:20966:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8cbb 00000020:00000080:3.0:1790772458.420901:0:20966:0:(genops.c:885:class_export_put()) final put ffff9ecdd1141000/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1790772458.420909:0:20966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1790772458.420916:0:19463:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecdd1141000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1790772458.420924:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790772458.420928:0:20966:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790772458.420931:0:20966:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff9ecdfa9819c0) has no exports 00000020:00000080:3.0:1790772458.617675:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790772458.617687:0:20966:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1790772458.617693:0:20966:0:(genops.c:885:class_export_put()) final put ffff9eccc3268000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1790772458.617698:0:20966:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc3268000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1790772458.617708:0:20966:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1790772458.618557:0:20966:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9eccc3268800 00000020:01000000:3.0:1790772458.618580:0:20966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1790772458.618585:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790772458.618589:0:20966:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790772458.618593:0:20966:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9eccc30acd40) has no exports 00000100:00100000:2.0:1790772458.619357:0:17193:0:(service.c:3206:ptlrpc_main()) mdt00_001: service thread [ffff9ecdc8816600:17193] 1 exiting: rc = 0 00000100:00100000:2.0:1790772458.619462:0:17192:0:(service.c:3206:ptlrpc_main()) mdt00_000: service thread [ffff9eccc2655a00:17192] 0 exiting: rc = 1 00000100:00100000:1.0:1790772458.619774:0:19816:0:(service.c:3206:ptlrpc_main()) mdt00_004: service thread [ffff9eccc3382e00:19816] 4 exiting: rc = 0 00000100:00100000:2.0:1790772458.620567:0:18466:0:(service.c:3206:ptlrpc_main()) mdt00_003: service thread [ffff9ecdff8a5c00:18466] 3 exiting: rc = 0 00000100:00100000:3.0:1790772458.621373:0:17194:0:(service.c:3206:ptlrpc_main()) mdt00_002: service thread [ffff9ecdfaa55e00:17194] 2 exiting: rc = 0 00000100:00100000:2.0:1790772458.621597:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621605:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621611:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621616:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621622:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621628:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621634:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621640:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621646:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621653:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621658:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621683:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621690:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621695:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621701:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621707:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621713:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621719:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621734:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621740:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621748:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621754:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621760:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621766:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621771:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621777:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621783:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621798:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621804:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621810:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621816:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621821:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621827:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621832:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621838:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621844:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621850:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621856:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621861:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.621867:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.622371:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.622391:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.622396:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.622403:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.622409:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.622415:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.622428:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.622435:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.622440:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.622447:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.622453:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.622459:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.622465:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.622471:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.622477:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.622483:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.622489:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.622494:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.622500:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.622506:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.622512:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.622517:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.622523:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772458.622528:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772458.639339:0:17196:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9eccc10fe000:17196] 1 exiting: rc = 0 00000100:00100000:0.0:1790772458.644504:0:17195:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9eccc10fee00:17195] 0 exiting: rc = 1 00000100:00100000:1.0:1790772458.654850:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.654862:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.654880:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.654887:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.654892:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.654898:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.654904:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.654909:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.654915:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.654923:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655469:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655480:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655502:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655507:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655512:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655516:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655520:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655525:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655530:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655534:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655540:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655545:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655549:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655554:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655559:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655564:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655568:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655573:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655578:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655589:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655594:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655599:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655603:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655608:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655613:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655618:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655623:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655628:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655634:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655639:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655645:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655650:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655657:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655662:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655680:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655686:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655693:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655705:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655710:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.655715:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.656411:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.656423:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.656429:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.656435:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.656440:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.656445:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.656451:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.656457:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.656462:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.656468:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.656473:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.656478:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.656483:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.656489:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772458.666918:0:17197:0:(service.c:3206:ptlrpc_main()) mdt_out00_000: service thread [ffff9ecdf5004a00:17197] 0 exiting: rc = 1 00000100:00100000:1.0:1790772458.668697:0:17198:0:(service.c:3206:ptlrpc_main()) mdt_out00_001: service thread [ffff9ecdf5005c00:17198] 1 exiting: rc = 0 00000100:00100000:0.0:1790772458.669333:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669342:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669349:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669355:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669361:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669368:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669384:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669409:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669415:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669421:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669442:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669449:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669455:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669462:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669469:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669475:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669482:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669488:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669495:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669502:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669509:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669516:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669537:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669545:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669552:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669559:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669565:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669571:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669577:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669584:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669590:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669596:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669602:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669609:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669630:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669637:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669644:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669651:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669658:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669677:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669686:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669693:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669707:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669713:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669720:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669727:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669748:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669755:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669761:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669768:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669774:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669780:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669796:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669804:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669810:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669816:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669822:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669829:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669850:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669857:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669864:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669879:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669887:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.669893:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772458.728066:0:17200:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9ecdf882d400:17200] 1 exiting: rc = 0 00000100:00100000:2.0:1790772458.728230:0:17199:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9ecdf5005600:17199] 0 exiting: rc = 1 00000100:00100000:1.0:1790772458.728604:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728612:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728617:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728622:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728627:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728633:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728638:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728643:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728648:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728654:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728659:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728664:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728668:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728673:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728677:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728682:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728687:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728705:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728710:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728715:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728719:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728724:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728729:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728735:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728740:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728744:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728748:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728753:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728757:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728761:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728766:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728771:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728775:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728781:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728787:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728792:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728797:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728803:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728808:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728813:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728818:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728822:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728827:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728832:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728837:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728841:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728845:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728850:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728855:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728860:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728866:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728947:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728960:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728965:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728969:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728974:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.728979:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.729203:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.729210:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.729214:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.729219:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.729223:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.729228:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.729233:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772458.729643:0:17202:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9ecdf882dc00:17202] 1 exiting: rc = 0 00000100:00100000:2.0:1790772458.730336:0:17201:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9ecdf882c400:17201] 0 exiting: rc = 1 00000100:00100000:1.0:1790772458.733545:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733555:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733560:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733566:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733572:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733577:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733583:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733588:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733594:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733599:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733604:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733610:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733615:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733620:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733625:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733630:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733635:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733640:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733645:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733650:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733655:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733661:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733678:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733700:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733706:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733711:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733716:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733721:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733726:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733732:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733736:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733741:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733745:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733750:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733756:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733760:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733765:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733770:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733775:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733781:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733786:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733791:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733796:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733800:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733807:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733811:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733816:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733820:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733824:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733828:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733832:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733836:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733841:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733845:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733850:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733855:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733859:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733864:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733877:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733882:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733886:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733891:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733895:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.733900:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772458.739597:0:17204:0:(service.c:3206:ptlrpc_main()) mdt_fld_0001: service thread [ffff9ecdf882c600:17204] 1 exiting: rc = 0 00000100:00100000:2.0:1790772458.745515:0:17203:0:(service.c:3206:ptlrpc_main()) mdt_fld_0000: service thread [ffff9ecdf882d800:17203] 0 exiting: rc = 1 00000100:00100000:1.0:1790772458.749544:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749554:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749559:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749565:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749570:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749576:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749581:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749587:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749593:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749599:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749604:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749610:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749615:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749620:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749626:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749631:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749636:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749641:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749647:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749652:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749657:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749675:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749682:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749688:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749693:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749699:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749705:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749709:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749714:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749736:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749741:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749746:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749750:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749755:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749760:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749764:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749769:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749774:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749779:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749795:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749801:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749806:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749810:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749815:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749820:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749824:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749829:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749835:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749840:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749844:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749849:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749853:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749857:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749862:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749867:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749872:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749876:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749880:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749884:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749888:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749893:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749897:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749902:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.749906:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.759527:0:17206:0:(service.c:3206:ptlrpc_main()) mdt_io00_001: service thread [ffff9ecdf882ca00:17206] 1 exiting: rc = 0 00000100:00100000:2.0:1790772458.760364:0:17207:0:(service.c:3206:ptlrpc_main()) mdt_io00_002: service thread [ffff9ecdc9ea4400:17207] 2 exiting: rc = 0 00000100:00100000:0.0:1790772458.760889:0:17205:0:(service.c:3206:ptlrpc_main()) mdt_io00_000: service thread [ffff9ecdf882d200:17205] 0 exiting: rc = 1 00000100:00100000:1.0:1790772458.761140:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761148:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761153:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761159:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761198:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761207:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761212:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761218:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761224:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761229:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761234:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761252:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761258:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761271:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761278:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761285:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761290:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761296:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761301:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761306:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761313:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761318:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761328:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761336:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761342:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761350:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761356:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761362:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761367:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761373:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761378:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761390:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761395:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761405:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761425:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761430:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761435:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761459:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761464:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761469:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761475:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761481:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761487:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761492:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761497:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761503:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761509:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761515:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761520:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761527:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761532:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761538:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761544:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761551:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761557:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761562:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761568:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761574:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761580:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761586:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761592:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761598:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761603:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772458.761609:0:20966:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1790772458.768424:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790772458.768436:0:20966:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1790772458.768441:0:20966:0:(genops.c:885:class_export_put()) final put ffff9eccc3f68000/MDS_uuid 00000020:00000080:1.0:1790772458.768446:0:20966:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc3f68000/MDS_uuid for MDS 00000020:01000000:1.0:1790772458.768451:0:20966:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1790772458.768599:0:20966:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1790772459.293897:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790772459.295264:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) e96364ee-79c0-4114-891b-7127f484e910->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790772459.295272:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) e96364ee-79c0-4114-891b-7127f484e910->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790772459.295275:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790772459.295278:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790772459.295282:0:8:0:(import.c:65:import_set_state_nolock()) ffff9eccc2242000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790772459.295288:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 554 00000100:00080000:2.0:1790772459.295294:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790772459.295305:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9eccc2242000 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:2.0:1790772459.295355:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdf62e7b80 x1877760506299136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790772459.295418:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790772459.295422:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790772459.295423:0:8:0:(import.c:65:import_set_state_nolock()) ffff9eccc2275800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790772459.295427:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 554 00000100:00080000:2.0:1790772459.295430:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790772459.295435:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9eccc2275800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:2.0:1790772459.295443:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790772459.295456:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1877760506299264:0@lo:400:kworker.0 00000400:00000100:2.0:1790772459.295499:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877760506299264 offset 0 length 224: 4 00000100:00100000:2.0:1790772459.295546:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdf62e5500 x1877760506299392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790772459.295573:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1877760506299520:0@lo:400:kworker.0 00000400:00000100:2.0:1790772459.295590:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877760506299520 offset 0 length 224: 4 00000100:00100000:3.0:1790772459.295741:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1877760506299136:0@lo:38:kworker.0 00000400:00000100:3.0:1790772459.295765:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877760506299136 offset 0 length 520: 4 00000100:00100000:3.0:1790772459.295777:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1877760506299392:0@lo:38:kworker.0 00000400:00000100:3.0:1790772459.295803:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877760506299392 offset 0 length 520: 4 00010000:00010000:2.0:1790772460.308857:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772461.334513:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772462.358546:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790772463.328378:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) e96364ee-79c0-4114-891b-7127f484e910->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790772463.328389:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) e96364ee-79c0-4114-891b-7127f484e910->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790772463.328392:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790772463.328396:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790772463.328489:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1877760506299648:0@lo:400:kworker.0 00000400:00000100:2.0:1790772463.328555:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877760506299648 offset 0 length 224: 4 00000100:00080000:3.0:1790772463.328634:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790772463.328638:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790772463.329808:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1877760506299776:0@lo:400:kworker.0 00000400:00000100:1.0:1790772463.329856:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877760506299776 offset 0 length 224: 4 00010000:00010000:2.0:1790772463.381451:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790772463.444040:0:21169:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1790772463.451559:0:21169:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1790772463.451643:0:21169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0000/0x418ffb1c3bcc8e2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc8e35 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772463.451658:0:21169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0000/0x418ffb1c3bcc8e2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc8e35 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772463.451676:0:21169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0000/0x418ffb1c3bcc8e2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x418ffb1c3bcc8e35 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772463.451683:0:21169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0000/0x418ffb1c3bcc8e2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x418ffb1c3bcc8e35 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772463.452807:0:21169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790772463.452818:0:21169:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1790772463.452866:0:21169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790772463.452880:0:21169:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ecdf62e7b80 x1877760506299136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790772479 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1790772463.452890:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1790772463.452898:0:21169:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00010000:00010000:3.0:1790772463.452901:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0000/0x418ffb1c3bcc8e2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x418ffb1c3bcc8e35 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790772463.452905:0:21169:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790772463.452913:0:21169:0:(import.c:65:import_set_state_nolock()) ffff9eccc2242000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:3.0:1790772463.452914:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdfbab0000 already unused, calling callback (ffffffffc11ffc20) 10000000:00010000:3.0:1790772463.452919:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0000/0x418ffb1c3bcc8e2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x418ffb1c3bcc8e35 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772463.452929:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0000/0x418ffb1c3bcc8e2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x418ffb1c3bcc8e35 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790772463.452932:0:21169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790772463.452938:0:21169:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ecdf62e7b80 x1877760506299136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790772479 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772463.452946:0:21169:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790772463.452951:0:21169:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 10000000:00010000:3.0:1790772463.452960:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0000/0x418ffb1c3bcc8e2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x418ffb1c3bcc8e35 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772463.452966:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790772463.452969:0:17181:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1790772463.452972:0:17181:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1790772463.452988:0:17181:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9eccc3f6d800 00010000:00010000:3.0:1790772463.452992:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0000/0x418ffb1c3bcc8e2e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x418ffb1c3bcc8e35 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772463.452998:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0000/0x418ffb1c3bcc8e2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x418ffb1c3bcc8e35 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772463.453011:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772463.453014:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772463.453018:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772463.453044:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1877760506299136:0@lo:38:kworker.0 00000100:00080000:2.0:1790772463.454649:0:21169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1790772463.454661:0:21169:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ecdf62e6d80 x1877760506299264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772475 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772463.454686:0:21169:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ecdc12ac700 x1877760506299648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772479 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772463.454701:0:21169:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1790772463.454716:0:21169:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1790772463.454737:0:21169:0:(import.c:65:import_set_state_nolock()) ffff9eccc2242800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1790772463.454766:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1877760506299904:0@lo:39:umount.0 00000400:00000100:2.0:1790772463.454815:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877760506299904 offset 0 length 224: 4 00000100:00100000:0.0:1790772463.454888:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1877760506299648:0@lo:400:kworker.0 00000100:00100000:3.0:1790772463.455470:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1877760506299264:0@lo:400:kworker.0 00000001:00100000:1.0:1790772463.897554:0:18693:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1790772463.897564:0:18693:0:(genops.c:885:class_export_put()) final put ffff9eccc2254000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790772463.897778:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc2254000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1790772463.897832:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eccc2256800 for lustre-OST0000 00000001:00100000:0.0:1790772463.898661:0:19512:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790772463.898666:0:19512:0:(genops.c:885:class_export_put()) final put ffff9eccc24ed800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1790772463.898753:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc24ed800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1790772463.898855:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eccc24ed000 for lustre-OST0001 00000100:00080000:1.0:1790772464.404538:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) e96364ee-79c0-4114-891b-7127f484e910->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790772464.404548:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) e96364ee-79c0-4114-891b-7127f484e910->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790772464.404551:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790772464.404554:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790772464.405722:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1877760506300032:0@lo:400:kworker.0 00000400:00000100:2.0:1790772464.405778:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877760506300032 offset 0 length 224: 4 00010000:00010000:2.0:1790772464.405848:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772465.428462:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772466.452325:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772467.476549:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772468.501017:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772468.565335:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790772458/real 1790772458] req@ffff9ecdf62e4e00 x1877760506299008/t0(0) o250->MGC192.168.206.114@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790772468 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772468.565366:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ecdf62e4e00 x1877760506299008/t0(0) o250->MGC192.168.206.114@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790772468 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790772468.565406:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9eccc3f6d800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790772468.565437:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1790772468.565441:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e96364ee-79c0-4114-891b-7127f484e910:3642:1877760506299008:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:3.0:1790772468.565875:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) e96364ee-79c0-4114-891b-7127f484e910->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790772468.565880:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1790772468.565884:0:8:0:(import.c:65:import_set_state_nolock()) ffff9eccc3f6d800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790772468.565889:0:8:0:(import.c:545:import_select_connection()) MGC192.168.206.114@tcp: connect to NID 0@lo last attempt 558 00000100:00080000:3.0:1790772468.565894:0:8:0:(import.c:630:import_select_connection()) MGC192.168.206.114@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790772468.565905:0:8:0:(import.c:666:import_select_connection()) MGC192.168.206.114@tcp: import ffff9eccc3f6d800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:3.0:1790772468.565940:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdc12aea00 x1877760506300160/t0(0) o250->MGC192.168.206.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790772468.565970:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790772468.565974:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790772468.566089:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790772468.566103:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1877760506300288:0@lo:400:kworker.0 00000400:00000100:1.0:1790772468.566148:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877760506300288 offset 0 length 224: 4 00000100:00100000:0.0:1790772468.567727:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e96364ee-79c0-4114-891b-7127f484e910:3642:1877760506300160:0@lo:250:kworker.0 00000400:00000100:0.0:1790772468.567926:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877760506300160 offset 0 length 520: 4 00010000:00010000:3.0:1790772469.524946:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772470.549259:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772471.573109:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772472.601261:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772473.620392:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790772473.620745:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) e96364ee-79c0-4114-891b-7127f484e910->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790772473.620751:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) e96364ee-79c0-4114-891b-7127f484e910->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790772473.620754:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790772473.620757:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790772473.620903:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790772473.620935:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1877760506300416:0@lo:400:kworker.0 00000400:00000100:1.0:1790772473.620981:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877760506300416 offset 0 length 224: 4 00000100:00100000:0.0:1790772473.684302:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790772463/real 1790772463] req@ffff9ecdf62e7b80 x1877760506299904/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790772473 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772473.684336:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ecdf62e7b80 x1877760506299904/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790772473 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790772473.684356:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9eccc2242800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1790772473.684378:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1877760506299904:0@lo:39:umount.0 00000100:00080000:2.0:1790772473.684995:0:21169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1790772473.685000:0:21169:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790772473.685006:0:21169:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1790772473.685872:0:21169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdd1ad0400/0x418ffb1c3bcc8e04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc8e0b expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772473.685886:0:21169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdd1ad0400/0x418ffb1c3bcc8e04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc8e0b expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772473.685893:0:21169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdd1ad0400/0x418ffb1c3bcc8e04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x418ffb1c3bcc8e0b expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772473.686818:0:21169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.114@tcp lock: ffff9ecdd1ad0400/0x418ffb1c3bcc8e04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x418ffb1c3bcc8e0b expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772473.686941:0:21169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790772473.686951:0:21169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdd1ad1200/0x418ffb1c3bcc915a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9161 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772473.686959:0:21169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdd1ad1200/0x418ffb1c3bcc915a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc9161 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772473.686966:0:21169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdd1ad1200/0x418ffb1c3bcc915a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x418ffb1c3bcc9161 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772473.686971:0:21169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.114@tcp lock: ffff9ecdd1ad1200/0x418ffb1c3bcc915a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x418ffb1c3bcc9161 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772473.686990:0:21169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1790772473.686994:0:21169:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1790772473.687023:0:21169:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1790772473.687027:0:21169:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1790772473.687032:0:21169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790772473.687038:0:21169:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790772473.687042:0:21169:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff9ecdfc7f19c0) has no exports 00000020:00080000:3.0:1790772473.687074:0:21169:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff9ecdfc7f19c0) has no exports 00000020:01000000:3.0:1790772473.688677:0:21169:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9ecdc3081f60 - data ffff9ecde08a4870/ffff9ecdedddf000 00000020:01000000:3.0:1790772473.688806:0:21169:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9eccc33fd3c0 - data ffff9eccc1c25510/ffff9ecdfc830800 00010000:00010000:0.0:1790772473.689269:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790772473.689278:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9ecdd1ad0400/0x418ffb1c3bcc8e04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x418ffb1c3bcc8e0b expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772473.689290:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdd1ad0400 already unused, calling callback (ffffffffc11ffc20) 10000000:00010000:0.0:1790772473.689294:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9ecdd1ad0400/0x418ffb1c3bcc8e04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x418ffb1c3bcc8e0b expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772473.689304:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9ecdd1ad0400/0x418ffb1c3bcc8e04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x418ffb1c3bcc8e0b expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790772473.689311:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9ecdd1ad0400/0x418ffb1c3bcc8e04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x418ffb1c3bcc8e0b expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772473.689328:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790772473.689331:0:17181:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1790772473.689334:0:17181:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1790772473.689348:0:17181:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9eccc3f6d800 00010000:00010000:0.0:1790772473.689351:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9ecdd1ad0400/0x418ffb1c3bcc8e04 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x418ffb1c3bcc8e0b expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772473.689358:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9ecdd1ad0400/0x418ffb1c3bcc8e04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x418ffb1c3bcc8e0b expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772473.689369:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772473.689373:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9ecdd1ad1200/0x418ffb1c3bcc915a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x418ffb1c3bcc9161 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772473.689379:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdd1ad1200 already unused, calling callback (ffffffffc11ffc20) 10000000:00010000:0.0:1790772473.689381:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9ecdd1ad1200/0x418ffb1c3bcc915a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x418ffb1c3bcc9161 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772473.689388:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9ecdd1ad1200/0x418ffb1c3bcc915a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x418ffb1c3bcc9161 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790772473.689394:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9ecdd1ad1200/0x418ffb1c3bcc915a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x418ffb1c3bcc9161 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772473.689399:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1790772473.689402:0:17181:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1790772473.689404:0:17181:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1790772473.689408:0:17181:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9eccc3f6d800 00010000:00010000:0.0:1790772473.689410:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9ecdd1ad1200/0x418ffb1c3bcc915a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x418ffb1c3bcc9161 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772473.689422:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9ecdd1ad1200/0x418ffb1c3bcc915a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x418ffb1c3bcc9161 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772473.689430:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772473.689432:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772473.689434:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772473.690020:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1790772473.698379:0:21169:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1790772473.731320:0:21169:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8e19 00000020:00000080:2.0:1790772473.731332:0:21169:0:(genops.c:885:class_export_put()) final put ffff9eccc3794000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1790772473.731346:0:21169:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9eccc2230000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1790772473.731350:0:21169:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eccc2230000 2 00000020:01000004:2.0:1790772473.731352:0:21169:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9eccc2230000 from lustre-OST0000 00000020:00000080:2.0:1790772473.731373:0:21169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790772473.731382:0:21169:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1790772473.731385:0:21169:0:(genops.c:885:class_export_put()) final put ffff9ecdefcd3800/lustre-OST0000_UUID 00000020:00000080:2.0:1790772473.731388:0:21169:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecdefcd3800/lustre-OST0000_UUID for lustre-OST0000 00000020:00000080:1.0:1790772473.731734:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc3794000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1790772473.731902:0:21169:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1790772473.731982:0:21169:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1790772473.731987:0:21169:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1790772473.731991:0:21169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790772473.732080:0:21169:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790772473.732092:0:21169:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9eccc2240000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790772473.732099:0:21169:0:(genops.c:1552:class_disconnect_exports()) OBD device 23 (ffff9eccc3743380) has exports, disconnecting them 00000020:00080000:2.0:1790772473.732104:0:21169:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9eccc2240000), last request at 1790772390 00000020:00000080:2.0:1790772473.732108:0:21169:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8e43 00000020:00080000:2.0:1790772473.732119:0:21169:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9eccc2240000): rc 0 00000020:00000080:2.0:1790772473.732124:0:21169:0:(genops.c:885:class_export_put()) final put ffff9eccc2240000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1790772473.732832:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc2240000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1790772473.741615:0:21169:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1790772473.741624:0:21169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790772473.741627:0:21169:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790772473.741634:0:21169:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790772473.741672:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eccc2242000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1790772473.745821:0:21169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790772473.745838:0:21169:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1790772473.745844:0:21169:0:(genops.c:885:class_export_put()) final put ffff9eccc32c9800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1790772473.745848:0:21169:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc32c9800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1790772473.745855:0:21169:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1790772473.745928:0:21169:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1790772473.747314:0:21169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790772473.747323:0:21169:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790772473.747330:0:21169:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9eccc2240800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790772473.747336:0:21169:0:(genops.c:1552:class_disconnect_exports()) OBD device 24 (ffff9eccc25bcd40) has exports, disconnecting them 00000020:00080000:1.0:1790772473.747341:0:21169:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9eccc2240800), last request at 1790772390 00000020:00000080:1.0:1790772473.747345:0:21169:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8e58 00000020:00080000:1.0:1790772473.747361:0:21169:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9eccc2240800): rc 0 00000020:00000080:1.0:1790772473.747366:0:21169:0:(genops.c:885:class_export_put()) final put ffff9eccc2240800/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1790772473.747419:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc2240800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1790772473.749230:0:21169:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1790772473.749237:0:21169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1790772473.749240:0:21169:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790772473.749252:0:21169:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790772473.749286:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eccc2242800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1790772473.749458:0:21169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790772473.749466:0:21169:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1790772473.749470:0:21169:0:(genops.c:885:class_export_put()) final put ffff9eccc2244800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1790772473.749474:0:21169:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc2244800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1790772473.749484:0:21169:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1790772473.749544:0:21169:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eccc2230000 1 00000020:00000080:0.0:1790772473.749549:0:21169:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8df6 00000020:00000080:0.0:1790772473.749567:0:21169:0:(genops.c:885:class_export_put()) final put ffff9ecde1725000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1790772473.749576:0:21169:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1790772473.749600:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecde1725000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1790772473.749610:0:21169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790772473.749615:0:21169:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790772473.749617:0:21169:0:(genops.c:1557:class_disconnect_exports()) OBD device 20 (ffff9ecddfe28000) has no exports 00000020:00000080:1.0:1790772473.831052:0:21169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790772473.831064:0:21169:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1790772473.831070:0:21169:0:(genops.c:885:class_export_put()) final put ffff9eccc2233000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1790772473.831074:0:21169:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc2233000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1790772473.831085:0:21169:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1790772473.831223:0:21169:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9eccc2237000 00000020:02000400:1.0:1790772473.831276:0:21169:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1790772474.645376:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1790772475.485222:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790772459/real 1790772459] req@ffff9ecdf62e7480 x1877760506299520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790772475 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772475.548265:0:3644:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9ecdf62e7480 x1877760506299520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790772475 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790772475.548560:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9eccc33f0800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1790772475.548565:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1790772475.601271:0:3644:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:2.0:1790772475.602505:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) e96364ee-79c0-4114-891b-7127f484e910->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790772475.602512:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) e96364ee-79c0-4114-891b-7127f484e910->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790772475.602515:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790772475.602523:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790772475.602526:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790772475.602529:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1790772475.602532:0:37:0:(import.c:65:import_set_state_nolock()) ffff9eccc33f0800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790772475.602540:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 507 00000100:00080000:2.0:1790772475.602566:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9eccc33f0800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:2.0:1790772475.602610:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdf62e7100 x1877760506300544/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790772475.602664:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1877760506299520:0@lo:400:kworker.0 00000100:00100000:0.0:1790772475.602774:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1877760506300544:0@lo:38:kworker.0 00000400:00000100:0.0:1790772475.602819:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877760506300544 offset 0 length 520: 4 00010000:00010000:0.0:1790772475.670391:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772476.693737:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772477.730872:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772478.740373:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772479.700605:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790772459/real 1790772459] req@ffff9ecdf62e5500 x1877760506299392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1790772479 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772479.700634:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ecdf62e5500 x1877760506299392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1790772479 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790772479.700654:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9eccc2275800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790772479.700673:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790772479.700678:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1877760506299392:0@lo:38:kworker.0 00000100:00080000:2.0:1790772479.700707:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) e96364ee-79c0-4114-891b-7127f484e910->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790772479.700712:0:19463:0:(pinger.c:247:ptlrpc_pinger_process_import()) e96364ee-79c0-4114-891b-7127f484e910->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790772479.700714:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790772479.700717:0:19463:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790772479.700719:0:19463:0:(import.c:65:import_set_state_nolock()) ffff9eccc2275800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790772479.700724:0:19463:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 559 00000100:00080000:2.0:1790772479.700738:0:19463:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1790772479.700749:0:19463:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9eccc2275800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:2.0:1790772479.700776:0:19463:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdf62e5500 x1877760506300672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790772479.700794:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790772479.700798:0:19463:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790772479.700815:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1877760506300672:0@lo:38:kworker.0 00000400:00000100:2.0:1790772479.700869:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877760506300672 offset 0 length 520: 4 00000020:01000004:0.0:1790772479.706265:0:21371:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1790772479.737848:0:21371:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1790772479.737940:0:21371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdc0030000/0x418ffb1c3bcc8ec8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc8ecf expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772479.737955:0:21371:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdc0030000/0x418ffb1c3bcc8ec8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc8ecf expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772479.737963:0:21371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdc0030000/0x418ffb1c3bcc8ec8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x418ffb1c3bcc8ecf expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772479.737970:0:21371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.114@tcp lock: ffff9ecdc0030000/0x418ffb1c3bcc8ec8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x418ffb1c3bcc8ecf expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772479.737993:0:21371:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790772479.737998:0:21371:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1790772479.738020:0:21371:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790772479.738031:0:21371:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ecdf62e5500 x1877760506300672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790772504 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772479.738046:0:21371:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1790772479.738064:0:21371:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790772479.738070:0:21371:0:(import.c:65:import_set_state_nolock()) ffff9eccc2275800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1790772479.738074:0:21371:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790772479.738078:0:21371:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ecdf62e5500 x1877760506300672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790772504 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772479.738086:0:21371:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790772479.738089:0:21371:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 33s for inflight to error out 00010000:00010000:2.0:1790772479.738149:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772479.738156:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9ecdc0030000/0x418ffb1c3bcc8ec8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x418ffb1c3bcc8ecf expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772479.738189:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdc0030000 already unused, calling callback (ffffffffc11ffc20) 10000000:00010000:2.0:1790772479.738194:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9ecdc0030000/0x418ffb1c3bcc8ec8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x418ffb1c3bcc8ecf expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772479.738203:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9ecdc0030000/0x418ffb1c3bcc8ec8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x418ffb1c3bcc8ecf expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772479.738211:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9ecdc0030000/0x418ffb1c3bcc8ec8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x418ffb1c3bcc8ecf expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772479.738217:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790772479.738219:0:17180:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1790772479.738222:0:17180:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1790772479.738234:0:17180:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9eccc3f6d800 00010000:00010000:2.0:1790772479.738237:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9ecdc0030000/0x418ffb1c3bcc8ec8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x418ffb1c3bcc8ecf expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772479.738254:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9ecdc0030000/0x418ffb1c3bcc8ec8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x418ffb1c3bcc8ecf expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772479.738264:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772479.738266:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772479.738268:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772479.738465:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1877760506300672:0@lo:38:kworker.0 00000100:00080000:3.0:1790772479.740293:0:21371:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790772479.740306:0:21371:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ecdc12ae300 x1877760506299776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772479 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772479.740323:0:21371:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ecdf8091500 x1877760506300032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772480 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772479.740339:0:21371:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ecdc12adf80 x1877760506300288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772484 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772479.740348:0:21371:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ecdf62e6680 x1877760506300416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772489 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772479.740356:0:21371:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ecdf62e7100 x1877760506300544/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790772485 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772479.740367:0:21371:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1790772479.740372:0:21371:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1790772479.740376:0:21371:0:(import.c:65:import_set_state_nolock()) ffff9eccc33f0800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1790772479.740381:0:21371:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790772479.740384:0:21371:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ecdc12ae300 x1877760506299776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772479 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772479.740392:0:21371:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ecdf8091500 x1877760506300032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772480 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772479.740400:0:21371:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ecdc12adf80 x1877760506300288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772484 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772479.740939:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1877760506300288:0@lo:400:kworker.0 00000100:00100000:3.0:1790772479.740961:0:21371:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ecdf62e6680 x1877760506300416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772489 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772479.740972:0:21371:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ecdf62e7100 x1877760506300544/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790772485 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772479.740978:0:21371:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00000400:1.0:1790772479.741284:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790772463/real 1790772463] req@ffff9ecdc12ae300 x1877760506299776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790772479 ref 1 fl Rpc:EXNQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772479.755466:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1877760506300032:0@lo:400:kworker.0 00000100:00100000:3.0:1790772479.767780:0:21371:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 13s for inflight to error out 00000100:00100000:0.0:1790772479.774011:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1877760506300544:0@lo:38:kworker.0 00000100:00100000:1.0:1790772479.797911:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=FULL (now=CLOSED) req@ffff9ecdc12ae300 x1877760506299776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790772479 ref 1 fl Rpc:EXNQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1790772479.798001:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772479.798057:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1877760506300416:0@lo:400:kworker.0 00000100:00100000:2.0:1790772479.798079:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1877760506299776:0@lo:400:kworker.0 00010000:00010000:2.0:1790772479.801007:0:21371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9eccc3561e00/0x418ffb1c3bcc8e9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc8ea5 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772479.801025:0:21371:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9eccc3561e00/0x418ffb1c3bcc8e9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc8ea5 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772479.801031:0:21371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9eccc3561e00/0x418ffb1c3bcc8e9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x418ffb1c3bcc8ea5 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772479.801038:0:21371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.114@tcp lock: ffff9eccc3561e00/0x418ffb1c3bcc8e9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x418ffb1c3bcc8ea5 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772479.801067:0:21371:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790772479.801073:0:21371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdc29cc000/0x418ffb1c3bcc914c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9153 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772479.801108:0:21371:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdc29cc000/0x418ffb1c3bcc914c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc9153 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772479.801115:0:21371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdc29cc000/0x418ffb1c3bcc914c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x418ffb1c3bcc9153 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772479.801121:0:21371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.114@tcp lock: ffff9ecdc29cc000/0x418ffb1c3bcc914c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x418ffb1c3bcc9153 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772479.801148:0:21371:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1790772479.801153:0:21371:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1790772479.801200:0:21371:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1790772479.801204:0:21371:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1790772479.801209:0:21371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790772479.801215:0:21371:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790772479.801218:0:21371:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff9ecdfa9f99c0) has no exports 00000020:00080000:2.0:1790772479.801241:0:21371:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff9ecdfa9f99c0) has no exports 00010000:00010000:1.0:1790772479.801782:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790772479.801790:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9eccc3561e00/0x418ffb1c3bcc8e9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x418ffb1c3bcc8ea5 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772479.801798:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc3561e00 already unused, calling callback (ffffffffc11ffc20) 10000000:00010000:1.0:1790772479.801810:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9eccc3561e00/0x418ffb1c3bcc8e9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x418ffb1c3bcc8ea5 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772479.801819:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9eccc3561e00/0x418ffb1c3bcc8e9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x418ffb1c3bcc8ea5 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772479.801826:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9eccc3561e00/0x418ffb1c3bcc8e9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x418ffb1c3bcc8ea5 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772479.801831:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790772479.801834:0:17181:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1790772479.801836:0:17181:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1790772479.801849:0:17181:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9eccc3f6d800 00010000:00010000:1.0:1790772479.801863:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9eccc3561e00/0x418ffb1c3bcc8e9e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x418ffb1c3bcc8ea5 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772479.801871:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9eccc3561e00/0x418ffb1c3bcc8e9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x418ffb1c3bcc8ea5 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772479.801884:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772479.801887:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9ecdc29cc000/0x418ffb1c3bcc914c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x418ffb1c3bcc9153 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772479.801893:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdc29cc000 already unused, calling callback (ffffffffc11ffc20) 10000000:00010000:1.0:1790772479.801897:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9ecdc29cc000/0x418ffb1c3bcc914c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x418ffb1c3bcc9153 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772479.801904:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9ecdc29cc000/0x418ffb1c3bcc914c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x418ffb1c3bcc9153 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772479.801910:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9ecdc29cc000/0x418ffb1c3bcc914c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x418ffb1c3bcc9153 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772479.801922:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1790772479.801924:0:17181:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1790772479.801926:0:17181:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1790772479.801931:0:17181:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9eccc3f6d800 00010000:00010000:1.0:1790772479.801934:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9ecdc29cc000/0x418ffb1c3bcc914c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x418ffb1c3bcc9153 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772479.801941:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9ecdc29cc000/0x418ffb1c3bcc914c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x418ffb1c3bcc9153 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772479.801956:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772479.801957:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772479.801959:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772479.802021:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1790772479.807970:0:21371:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9ecdc3081480 - data ffff9ecde08a41b0/ffff9ecdfcbaf800 00000020:01000000:2.0:1790772479.808123:0:21371:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9ecdfc4aa3c0 - data ffff9eccc1d79288/ffff9ecdef15a000 00100000:10000000:2.0:1790772479.819315:0:21371:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1790772479.841539:0:21371:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8eb3 00000020:00000080:3.0:1790772479.841550:0:21371:0:(genops.c:885:class_export_put()) final put ffff9eccc33f2000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1790772479.841571:0:21371:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ecdfb8bc000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1790772479.841575:0:21371:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ecdfb8bc000 2 00000020:01000004:3.0:1790772479.841578:0:21371:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ecdfb8bc000 from lustre-OST0001 00000020:00000080:3.0:1790772479.841621:0:21371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790772479.841631:0:21371:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1790772479.841635:0:21371:0:(genops.c:885:class_export_put()) final put ffff9eccc33f7000/lustre-OST0001_UUID 00000020:00000080:3.0:1790772479.841638:0:21371:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc33f7000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1790772479.841644:0:21371:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1790772479.841746:0:21371:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import e96364ee-79c0-4114-891b-7127f484e910->MGS 00010000:00010000:3.0:1790772479.841761:0:21371:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0600/0x418ffb1c3bcc8cc2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x418ffb1c3bcc8cc9 expref: -99 pid: 17923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790772479.841773:0:21371:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0600/0x418ffb1c3bcc8cc2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x418ffb1c3bcc8cc9 expref: -99 pid: 17923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772479.841780:0:21371:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1790772479.841783:0:21371:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1790772479.841785:0:21371:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1790772479.841798:0:21371:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9eccc3f6d800 00010000:00010000:3.0:1790772479.841802:0:21371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0600/0x418ffb1c3bcc8cc2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x418ffb1c3bcc8cc9 expref: -99 pid: 17923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772479.841832:0:21371:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1000/0x418ffb1c3bcc8bb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x418ffb1c3bcc8bb8 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790772479.841840:0:21371:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1000/0x418ffb1c3bcc8bb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x418ffb1c3bcc8bb8 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772479.841845:0:21371:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790772479.841847:0:21371:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1790772479.841849:0:21371:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1790772479.841859:0:21371:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9eccc3f6d800 00010000:00010000:3.0:1790772479.841862:0:21371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1000/0x418ffb1c3bcc8bb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x418ffb1c3bcc8bb8 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1790772479.841878:0:21371:0:(import.c:65:import_set_state_nolock()) ffff9eccc3f6d800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1790772479.841882:0:21371:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1790772479.841884:0:21371:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1790772479.841886:0:21371:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1790772479.841889:0:21371:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1790772479.841899:0:21371:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ecdc12aea00 x1877760506300160/t0(0) o250->MGC192.168.206.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1790772483 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1790772479.841911:0:21371:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1790772479.841913:0:21371:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000020:00000080:0.0:1790772479.842010:0:19463:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc33f2000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:0.0:1790772479.842044:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e96364ee-79c0-4114-891b-7127f484e910:3642:1877760506300160:0@lo:250:kworker.0 10000000:01000000:3.0:1790772479.847558:0:21371:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1790772479.847576:0:21371:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8b9c 00000020:00000080:3.0:1790772479.847585:0:21371:0:(genops.c:885:class_export_put()) final put ffff9eccc3f6c800/e96364ee-79c0-4114-891b-7127f484e910 00000020:01000000:3.0:1790772479.847608:0:21371:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.114@tcp (flags='') 00000020:00000080:3.0:1790772479.847628:0:21371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790772479.847636:0:21371:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.114@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1790772479.847639:0:21371:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9eccc30ab380) has no exports 00000020:00000080:0.0:1790772479.847740:0:19463:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc3f6c800/e96364ee-79c0-4114-891b-7127f484e910 for MGC192.168.206.114@tcp 10000000:01000000:2.0:1790772479.847950:0:17189:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1790772479.848116:0:21371:0:(obd_class.h:668:obd_cleanup_client_import()) MGC192.168.206.114@tcp: client import never connected 00000100:00080000:3.0:1790772479.848139:0:21371:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1790772479.848142:0:21371:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1790772479.848144:0:21371:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1790772479.848146:0:21371:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1790772479.848211:0:21371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790772479.848217:0:21371:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.114@tcp (uuid e96364ee-79c0-4114-891b-7127f484e910) 00000020:01000000:3.0:1790772479.848225:0:21371:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1790772479.848228:0:21371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790772479.848232:0:21371:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1790772479.848238:0:21371:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9eccc2275000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790772479.848242:0:21371:0:(genops.c:1552:class_disconnect_exports()) OBD device 27 (ffff9eccc25b99c0) has exports, disconnecting them 00000020:00080000:3.0:1790772479.848246:0:21371:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9eccc2275000), last request at 1790772406 00000020:00000080:3.0:1790772479.848250:0:21371:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8edd 00000020:00080000:3.0:1790772479.848260:0:21371:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9eccc2275000): rc 0 00000020:00000080:3.0:1790772479.848264:0:21371:0:(genops.c:885:class_export_put()) final put ffff9eccc2275000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1790772479.848978:0:19463:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eccc3f6d800 for MGC192.168.206.114@tcp 00000020:00000080:0.0:1790772479.848985:0:19463:0:(genops.c:885:class_export_put()) final put ffff9eccc3f6b800/e96364ee-79c0-4114-891b-7127f484e910 00000020:00000080:0.0:1790772479.848988:0:19463:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc3f6b800/e96364ee-79c0-4114-891b-7127f484e910 for MGC192.168.206.114@tcp 00000020:01000000:0.0:1790772479.848993:0:19463:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.114@tcp (e96364ee-79c0-4114-891b-7127f484e910) 00000020:00000080:0.0:1790772479.849254:0:19463:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc2275000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1790772479.863246:0:21371:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1790772479.863254:0:21371:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790772479.863258:0:21371:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1790772479.863265:0:21371:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790772479.863484:0:21371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790772479.863493:0:21371:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1790772479.863499:0:21371:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1790772479.863505:0:21371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790772479.863509:0:21371:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1790772479.863517:0:21371:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9eccc33f6800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790772479.863524:0:21371:0:(genops.c:1552:class_disconnect_exports()) OBD device 28 (ffff9ecdfa9fb380) has exports, disconnecting them 00000020:00080000:3.0:1790772479.863527:0:21371:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9eccc33f6800), last request at 1790772406 00000020:00000080:3.0:1790772479.863531:0:21371:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8ef2 00000020:00080000:3.0:1790772479.863540:0:21371:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9eccc33f6800): rc 0 00000020:00000080:3.0:1790772479.863554:0:21371:0:(genops.c:885:class_export_put()) final put ffff9eccc33f6800/lustre-MDT0001-lwp-OST0001 00000020:00000080:0.0:1790772479.863740:0:19463:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eccc2275800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1790772479.863747:0:19463:0:(genops.c:885:class_export_put()) final put ffff9eccc2274000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1790772479.863750:0:19463:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc2274000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1790772479.863760:0:19463:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1790772479.863812:0:19463:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc33f6800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1790772479.864729:0:21371:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1790772479.864734:0:21371:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790772479.864737:0:21371:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1790772479.864742:0:21371:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790772479.866368:0:19463:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eccc33f0800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1790772479.868394:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1790772479.868713:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:1.0:1790772479.868984:0:17175:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9ecde177b600:17175] 0 exiting: rc = 1 00000100:00100000:3.0:1790772479.869105:0:17176:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9ecde177a600:17176] 1 exiting: rc = 0 00000100:00100000:0.0:1790772479.869292:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.869559:0:17178:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9eccc3c11600:17178] 1 exiting: rc = 0 00000100:00100000:0.0:1790772479.869630:0:17177:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9eccc3c11a00:17177] 0 exiting: rc = 1 00000100:00100000:3.0:1790772479.875936:0:17179:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9ecdeec5c000:17179] 2 exiting: rc = 0 00000100:00100000:3.0:1790772479.876033:0:20967:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9ecdd10b6a00:20967] 3 exiting: rc = 0 00000100:00100000:0.0:1790772479.876349:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876358:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876364:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876371:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876378:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876385:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876390:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876396:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876401:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876407:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876413:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876417:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876422:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876428:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876434:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876453:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876458:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876464:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876469:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876475:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876480:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876485:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876492:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876497:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876503:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876508:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876514:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876520:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876527:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876532:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876538:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876543:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876549:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876565:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876571:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876576:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876582:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876588:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876593:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876598:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876603:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876608:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876624:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876630:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876636:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876641:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876648:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876653:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876658:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876663:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876668:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876673:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876679:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876685:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876691:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876696:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876702:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876707:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876712:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876717:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876723:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876728:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876733:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772479.876738:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1790772479.880543:0:21371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790772479.880557:0:21371:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1790772479.880563:0:21371:0:(genops.c:885:class_export_put()) final put ffff9eccc33f4000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1790772479.880568:0:21371:0:(genops.c:844:class_export_destroy()) destroying export ffff9eccc33f4000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1790772479.880586:0:21371:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1790772479.880660:0:21371:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ecdfb8bc000 1 00000020:00000080:0.0:1790772479.880667:0:21371:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x418ffb1c3bcc8e97 00000020:00000080:0.0:1790772479.880672:0:21371:0:(genops.c:885:class_export_put()) final put ffff9ecdc3e4f800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1790772479.880695:0:21371:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1790772479.880700:0:21371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790772479.880705:0:21371:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790772479.880709:0:21371:0:(genops.c:1557:class_disconnect_exports()) OBD device 25 (ffff9ecdfa9fcd40) has no exports 00000020:00000080:1.0:1790772479.883372:0:19463:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecdc3e4f800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1790772480.319570:0:21371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790772480.319589:0:21371:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1790772480.319597:0:21371:0:(genops.c:885:class_export_put()) final put ffff9ecdefcd7000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1790772480.319604:0:21371:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecdefcd7000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1790772480.319619:0:21371:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1790772480.320028:0:21371:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ecdefcd3000 00000020:01000000:0.0:1790772480.320059:0:21371:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1790772480.320066:0:21371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790772480.320074:0:21371:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790772480.320080:0:21371:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff9ecdfa983380) has no exports 00000020:00000080:0.0:1790772480.320139:0:21371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790772480.320148:0:21371:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1790772480.320151:0:21371:0:(genops.c:885:class_export_put()) final put ffff9ecde1726800/OSS_uuid 00000020:00000080:0.0:1790772480.320157:0:21371:0:(genops.c:844:class_export_destroy()) destroying export ffff9ecde1726800/OSS_uuid for OSS 00000020:01000000:0.0:1790772480.320160:0:21371:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1790772480.320311:0:18698:0:(service.c:3206:ptlrpc_main()) ll_ost00_001: service thread [ffff9ecdfbacf800:18698] 1 exiting: rc = 0 00000100:00080000:2.0:1790772480.320435:0:17188:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1790772480.320568:0:18699:0:(service.c:3206:ptlrpc_main()) ll_ost00_002: service thread [ffff9ecdf5121800:18699] 2 exiting: rc = 0 00000100:00100000:3.0:1790772480.320858:0:19556:0:(service.c:3206:ptlrpc_main()) ll_ost00_004: service thread [ffff9eccc2414600:19556] 4 exiting: rc = 0 00000100:00100000:2.0:1790772480.323011:0:18697:0:(service.c:3206:ptlrpc_main()) ll_ost00_000: service thread [ffff9eccc2238c00:18697] 0 exiting: rc = 1 00000100:00100000:0.0:1790772480.324057:0:19248:0:(service.c:3206:ptlrpc_main()) ll_ost00_003: service thread [ffff9eccc3380400:19248] 3 exiting: rc = 0 00000100:00100000:0.0:1790772480.324153:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324194:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324200:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324205:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324210:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324216:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324235:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324240:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324246:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324251:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324256:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324262:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324268:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324273:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324278:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324284:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324289:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324294:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324299:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324304:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324309:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324314:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324319:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324324:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324329:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324334:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324339:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324344:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324349:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324354:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324360:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324365:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324371:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324376:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324381:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324386:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324391:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324417:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324430:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324437:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324442:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324455:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324460:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324465:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324470:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324475:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324480:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324485:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324490:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324495:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324500:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324505:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324511:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324516:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324520:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324525:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324804:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324812:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324817:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324821:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324826:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324830:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324835:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.324840:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772480.329928:0:18701:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9ecdf5120000:18701] 1 exiting: rc = 0 00000100:00100000:2.0:1790772480.330016:0:18700:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9ecdf5121400:18700] 0 exiting: rc = 1 00000100:00100000:0.0:1790772480.332881:0:19985:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9ecdf4b54800:19985] 2 exiting: rc = 0 00000100:00100000:2.0:1790772480.349369:0:19986:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_003: service thread [ffff9ecdf4b75e00:19986] 3 exiting: rc = 0 00000100:00100000:0.0:1790772480.349615:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349622:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349628:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349633:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349638:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349643:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349648:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349653:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349658:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349670:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349677:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349696:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349701:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349706:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349713:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349718:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349723:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349729:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349736:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349742:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349752:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349758:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349763:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349768:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349773:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349777:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349782:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349787:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349793:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349798:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349803:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349808:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349813:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349818:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349824:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349834:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349843:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349849:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349854:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349859:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349865:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349869:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349874:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349879:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349883:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349888:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349900:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349905:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349910:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349915:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349919:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349924:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349930:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349934:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349939:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349944:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349949:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349954:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349959:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349963:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349969:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349974:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349979:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.349984:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.350901:0:18702:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9ecdf5120200:18702] 0 exiting: rc = 1 00000100:00100000:2.0:1790772480.351249:0:18704:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9ecdfcba4400:18704] 2 exiting: rc = 0 00000100:00100000:2.0:1790772480.351402:0:20334:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_003: service thread [ffff9eccc2444000:20334] 3 exiting: rc = 0 00000100:00100000:2.0:1790772480.351546:0:18703:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9ecdf5121a00:18703] 1 exiting: rc = 0 00000100:00100000:0.0:1790772480.351738:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.351745:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.351751:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.351757:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.351762:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.351767:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.351773:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.351818:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.351824:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.351830:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.351835:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.351841:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.351847:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.351851:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.351857:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.351862:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.351876:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.351881:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.351886:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.351891:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.351897:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.351902:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.351907:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.351927:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.351933:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.351939:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.351944:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.351949:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.351954:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.351959:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.351965:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.351971:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.351976:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.351981:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.351986:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.351991:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.351997:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.352002:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.352007:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.352013:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.352018:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.352023:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.352028:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.352033:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.352039:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.352044:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.352050:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.352073:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.352080:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.352085:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.352090:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.352103:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.352108:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.352113:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.352119:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.352136:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.352143:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.352149:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.352193:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.352898:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.352906:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.352911:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.352917:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772480.352933:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.372091:0:18705:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9ecdfcba5200:18705] 0 exiting: rc = 1 00000100:00100000:1.0:1790772480.372250:0:18706:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9ecdfcba4e00:18706] 1 exiting: rc = 0 00000100:00100000:3.0:1790772480.379087:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379118:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379133:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379139:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379219:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379225:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379232:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379237:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379243:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379247:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379252:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379257:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379262:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379267:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379272:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379276:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379280:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379285:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379290:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379295:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379299:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379304:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379310:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379315:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379337:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379342:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379347:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379353:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379358:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379363:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379368:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379373:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379378:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379383:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379387:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379392:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379398:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379403:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379408:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379414:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379420:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379425:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379431:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379437:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379442:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379448:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379453:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379459:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379464:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379470:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379475:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379480:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379486:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379492:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379499:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379504:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379510:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379515:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379521:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379544:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379550:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379557:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379564:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.379570:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772480.381349:0:18708:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9eccc23d6000:18708] 1 exiting: rc = 0 00000100:00100000:1.0:1790772480.381586:0:18707:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9ecde0163e00:18707] 0 exiting: rc = 1 00000100:00100000:1.0:1790772480.381656:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381663:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381669:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381675:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381700:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381707:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381713:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381719:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381725:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381742:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381767:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381773:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381779:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381785:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381791:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381797:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381817:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381824:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381830:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381836:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381842:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381847:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381853:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381859:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381865:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381872:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381878:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381884:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381906:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381914:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381932:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381942:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381949:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381956:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381961:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381967:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381973:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381979:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381985:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.381991:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.382011:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.382017:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.382023:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.382029:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.382035:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.382047:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.382053:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.382058:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.382064:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.382069:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.382075:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.382080:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.382109:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.382121:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.382136:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.382142:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.382148:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.382154:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.382159:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.382188:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.382195:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.382644:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.382652:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772480.382659:0:21371:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1790772480.415668:0:21371:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1790772503.319537:0:22135:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg614-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1790772513.746005:0:22735:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790772513.746011:0:22735:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1790772513.746012:0:22735:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1790772513.746121:0:22735:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ecdfb45f000 00000020:01000004:3.0:1790772513.746136:0:22735:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1790772513.746143:0:22735:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1790772513.746157:0:22735:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9ecdfa9f99c0) 00000020:00000080:3.0:1790772513.746544:0:22735:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1790772513.823006:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1790772513.823502:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1790772513.834127:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1790772513.834580:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1790772513.834984:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1790772513.835283:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1790772513.835648:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1790772513.839244:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1790772513.839764:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1790772513.840059:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1790772513.840284:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1790772513.840650:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1790772513.847209:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1790772513.847846:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1790772513.849073:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1790772513.849405:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1790772513.856072:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1790772513.856683:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1790772513.857334:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1790772513.857843:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1790772513.858116:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1790772513.858406:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1790772513.858897:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1790772513.859156:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1790772513.859537:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1790772513.859800:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1790772513.860055:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1790772513.865686:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1790772513.866130:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1790772513.866370:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1790772513.866726:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1790772513.867001:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1790772513.867281:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1790772513.867625:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1790772513.867828:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1790772513.868037:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1790772513.868780:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1790772513.869197:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1790772513.869619:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1790772513.869880:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1790772513.870137:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1790772513.870416:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1790772513.870770:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1790772513.871108:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1790772513.871366:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1790772513.871914:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1790772513.874818:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1790772513.875517:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1790772513.876147:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1790772513.876414:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1790772513.877228:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1790772513.877603:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1790772513.877803:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:0.0:1790772513.878895:0:22735:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1790772513.879114:0:22735:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1790772513.879122:0:22735:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:0.0:1790772513.879134:0:22735:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x418ffb1c3bcc9408 00000020:01000004:0.0:1790772513.879141:0:22735:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1790772513.879146:0:22735:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1790772513.879152:0:22735:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ecdfb45f000 from MGS 00000020:01000004:0.0:1790772513.879155:0:22735:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1790772513.879216:0:22735:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9ecdfc7f4d40) 00000020:00000080:0.0:1790772513.879229:0:22735:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1790772513.879285:0:22735:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ecdfb45f000 from MGS, refs=2 00080000:01000000:0.0:1790772513.879290:0:22735:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790772513.879296:0:22735:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x418ffb1c3bcc9416 00000100:00100000:0.0:1790772513.879389:0:22735:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1790772513.879515:0:22735:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1790772513.879521:0:22735:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1790772513.880336:0:22735:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1790772513.880343:0:22735:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1790772513.881041:0:22735:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790772513.881233:0:22735:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1790772513.881238:0:22735:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1790772513.881842:0:22735:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1790772513.881849:0:22735:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1790772513.882331:0:22735:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1790772513.882338:0:22735:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1790772513.890508:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772513.890528:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772513.890531:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772513.898543:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772513.898550:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772513.898553:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772513.900149:0:22735:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1790772513.900907:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1790772513.912162:0:22735:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1790772513.913104:0:22747:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1790772513.913153:0:22735:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1790772513.913209:0:22735:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790772513.913915:0:22735:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1790772513.914286:0:22735:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790772513.914432:0:22735:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1790772513.914583:0:22735:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1790772513.915120:0:22735:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1790772513.915127:0:22735:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1790772513.917720:0:22735:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1790772513.917731:0:22735:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1790772513.919364:0:22735:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1790772513.919398:0:22735:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.114@tcp' 00000020:01000004:0.0:1790772513.919400:0:22735:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1790772513.919428:0:22735:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.114@tcp (typ=mgc) 00000020:00000080:0.0:1790772513.919448:0:22735:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.114@tcp (ffff9ecdfc7f0000) 00000020:00000080:0.0:1790772513.919465:0:22735:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1790772513.919538:0:22735:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ecde14b6800@MGC192.168.206.114@tcp: add connection 192.168.206.114@tcp at head 00010000:00010000:0.0:1790772513.919674:0:22735:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.114@tcp-0 is initialized 00000040:01000000:0.0:1790772513.919679:0:22735:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.114@tcp ctxt 1 is initialized 00000100:00080000:1.0:1790772513.921157:0:22752:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1790772513.925712:0:22754:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1790772513.925795:0:22735:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.114@tcp (uuid a371a4ff-c27a-4b58-b24c-92c8783ef87a) 00000020:00000080:1.0:1790772513.925818:0:22735:0:(genops.c:1384:class_connect()) connect: client a371a4ff-c27a-4b58-b24c-92c8783ef87a, cookie 0x418ffb1c3bcc9424 00000100:00080000:1.0:1790772513.925830:0:22735:0:(import.c:545:import_select_connection()) MGC192.168.206.114@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790772513.925841:0:22735:0:(import.c:666:import_select_connection()) MGC192.168.206.114@tcp: import ffff9ecde14b6800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:1.0:1790772513.925874:0:22735:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdf8090a80 x1877760506300800/t0(0) o250->MGC192.168.206.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790772513.925938:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3642:1877760506300800:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1790772513.926012:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790772513.926088:0:22735:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a371a4ff-c27a-4b58-b24c-92c8783ef87a->MGS 00000100:00100000:2.0:1790772513.926110:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506300800 00000100:00100000:2.0:1790772513.926117:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506300800 00000020:01000004:1.0:1790772513.926118:0:22735:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1790772513.926122:0:22735:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1790772513.926135:0:22735:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9ecddfe28000) 00000020:00000080:1.0:1790772513.926148:0:22735:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1790772513.926149:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790772513.926157:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf118bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3642:x1877760506300800:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1790772513.928517:0:22749:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from a371a4ff-c27a-4b58-b24c-92c8783ef87a@0@lo t0 exp 0000000000000000 cur 614 last 0 00000020:00000080:2.0:1790772513.928560:0:22749:0:(genops.c:1384:class_connect()) connect: client a371a4ff-c27a-4b58-b24c-92c8783ef87a, cookie 0x418ffb1c3bcc9432 00000100:00080000:2.0:1790772513.928696:0:22749:0:(import.c:65:import_set_state_nolock()) ffff9ecdfb447000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790772513.936338:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf118bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+5:3642:x1877760506300800:12345-0@lo:250:mount.lustre.0 Request processed in 10167us (10312us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772513.936354:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790772513.943365:0:22735:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790772513.943858:0:22735:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1790772513.943865:0:22735:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1790772513.943993:0:3642:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.114@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1790772513.944003:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.206.114@tcp: connect to target with instance 0 00000100:00080000:0.0:1790772513.944011:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.206.114@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1790772513.944017:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1790772513.944022:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ecde14b6800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1790772513.944025:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1790772513.944050:0:3642:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1790772513.944061:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3642:1877760506300800:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1790772513.949631:0:22735:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1790772513.949645:0:22735:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1790772513.950197:0:22735:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1790772513.950204:0:22735:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1790772513.951049:0:22735:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790772513.951266:0:22735:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1790772513.951273:0:22735:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1790772513.955685:0:22735:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1790772513.955698:0:22735:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1790772514.011734:0:22735:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790772514.011921:0:22735:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1790772514.011927:0:22735:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1790772514.016217:0:22735:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1790772514.016293:0:22735:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1790772514.018794:0:22735:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790772514.018981:0:22735:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790772514.018987:0:22735:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1790772514.020575:0:22735:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790772514.020585:0:22735:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1790772514.021320:0:22735:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790772514.021512:0:22735:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790772514.021517:0:22735:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1790772514.022084:0:22735:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790772514.022091:0:22735:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1790772514.030010:0:22735:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790772514.030362:0:22735:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790772514.030369:0:22735:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1790772514.030867:0:22735:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790772514.030874:0:22735:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1790772514.054870:0:22735:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790772514.062378:0:22735:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1790772514.062389:0:22735:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1790772514.068392:0:22735:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790772514.068455:0:22735:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1790772514.069452:0:22735:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790772514.069460:0:22735:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1790772514.071320:0:22735:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1790772514.071350:0:22735:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1790772514.071357:0:22735:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.114@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1790772514.071459:0:22735:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.114@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790772514.071494:0:22735:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.114@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1790772514.071498:0:22735:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790772514.071500:0:22735:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790772514.071501:0:22735:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790772514.071502:0:22735:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790772514.071503:0:22735:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790772514.071508:0:22735:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790772514.071510:0:22735:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790772514.071511:0:22735:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790772514.071513:0:22735:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790772514.071514:0:22735:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790772514.071516:0:22735:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1790772514.071519:0:22735:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790772514.071520:0:22735:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790772514.071521:0:22735:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790772514.071521:0:22735:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790772514.071522:0:22735:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790772514.071524:0:22735:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790772514.071524:0:22735:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790772514.071525:0:22735:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790772514.071526:0:22735:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790772514.071527:0:22735:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790772514.071563:0:22735:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790772514.071581:0:22735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22735:1877760506300928:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790772514.071653:0:22735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772514.071691:0:22735:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc9c1d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772514.071855:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506300928 00000100:00100000:0.0:1790772514.071863:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506300928 00000100:00100000:0.0:1790772514.071909:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790772514.071918:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1189450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+5:22735:x1877760506300928:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790772514.071973:0:22751:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790772514.071977:0:22751:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1790772514.071980:0:22751:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1790772514.072382:0:22772:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1790772514.072862:0:22751:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:3.0:1790772514.077477:0:22773:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1790772514.077486:0:22773:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1790772514.077489:0:22773:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1790772514.077492:0:22773:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1790772514.077740:0:22773:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1790772514.077875:0:22751:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790772514.077886:0:22751:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1790772514.079143:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1189450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+5:22735:x1877760506300928:12345-0@lo:253:mount.lustre.0 Request processed in 7221us (7483us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772514.079160:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790772514.079201:0:22735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22735:1877760506300928:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790772514.079215:0:22735:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790772514.079218:0:22735:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790772514.079220:0:22735:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790772514.079222:0:22735:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790772514.079223:0:22735:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790772514.079224:0:22735:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790772514.079225:0:22735:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790772514.079227:0:22735:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790772514.079228:0:22735:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790772514.079230:0:22735:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790772514.079232:0:22735:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790772514.079248:0:22735:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ecdfb45f000 from lustre-MDT0000 10000000:01000000:2.0:1790772514.079275:0:22735:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1790772514.079278:0:22735:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790772514.079282:0:22735:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9ecdfc7f0000 10000000:01000000:2.0:1790772514.079286:0:22735:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790772514.079302:0:22735:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ecdfc7f0000 from 1 10000000:01000000:2.0:1790772514.079305:0:22735:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790772514.079336:0:22735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8a00/0x418ffb1c3bcc9439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.079346:0:22735:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8a00/0x418ffb1c3bcc9439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.079356:0:22735:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8a00/0x418ffb1c3bcc9439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772514.079374:0:22735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22735:1877760506301056:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790772514.079410:0:22735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772514.079547:0:22735:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc9c1d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772514.079941:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506301056 00000100:00100000:1.0:1790772514.079962:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506301056 00000100:00100000:1.0:1790772514.080001:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790772514.080010:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1189c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+5:22735:x1877760506301056:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790772514.080023:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772514.080037:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ecdef3a7a00/0x418ffb1c3bcc9440 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x418ffb1c3bcc9439 expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772514.080059:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ecdef3a7a00/0x418ffb1c3bcc9440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9439 expref: 6 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772514.080082:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ecdef3a7a00/0x418ffb1c3bcc9440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9439 expref: 6 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772514.080091:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdef3a7a00, rc 0) 00000100:00100000:1.0:1790772514.080137:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1189c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+6:22735:x1877760506301056:12345-0@lo:101:mount.lustre.0 Request processed in 129us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772514.080144:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790772514.080230:0:22735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22735:1877760506301056:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790772514.080245:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8a00/0x418ffb1c3bcc9439 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9440 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.080254:0:22735:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8a00/0x418ffb1c3bcc9439 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc9440 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772514.080310:0:22735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22735:1877760506301184:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790772514.080338:0:22735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772514.080373:0:22735:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc1ba8240 going to sleep for 11 seconds 00000100:00100000:1.0:1790772514.080404:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506301184 00000100:00100000:1.0:1790772514.080409:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506301184 00000100:00100000:1.0:1790772514.080440:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790772514.080447:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1188c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+6:22735:x1877760506301184:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790772514.080519:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1188c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+6:22735:x1877760506301184:12345-0@lo:501:mount.lustre.0 Request processed in 72us (180us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790772514.080527:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790772514.080590:0:22735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22735:1877760506301184:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1790772514.080618:0:22735:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790772514.080638:0:22735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8a00/0x418ffb1c3bcc9439 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9440 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.080647:0:22735:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8a00/0x418ffb1c3bcc9439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9440 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772514.080655:0:22735:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ecdfb45f000 10000000:01000000:2.0:1790772514.080660:0:22735:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790772514.080664:0:22735:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ecdfb45f000 10000000:01000000:2.0:1790772514.080667:0:22735:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1790772514.080669:0:22735:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ecdfb45f000 from 1 10000000:01000000:2.0:1790772514.080672:0:22735:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1790772514.080686:0:22735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8c00/0x418ffb1c3bcc9447 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.080699:0:22735:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8c00/0x418ffb1c3bcc9447 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.080708:0:22735:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8c00/0x418ffb1c3bcc9447 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772514.080719:0:22735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22735:1877760506301312:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790772514.080744:0:22735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772514.080767:0:22735:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc9c1d780 going to sleep for 11 seconds 00000100:00100000:0.0:1790772514.080825:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506301312 00000100:00100000:0.0:1790772514.080836:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506301312 00000100:00100000:0.0:1790772514.080865:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790772514.080872:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf118ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+6:22735:x1877760506301312:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790772514.080878:0:22749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772514.080888:0:22749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eccc1bd1800/0x418ffb1c3bcc944e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x418ffb1c3bcc9447 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.080904:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eccc1bd1800/0x418ffb1c3bcc944e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9447 expref: 7 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.080912:0:22749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eccc1bd1800/0x418ffb1c3bcc944e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9447 expref: 7 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.080919:0:22749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eccc1bd1800, rc 0) 00000100:00100000:0.0:1790772514.080967:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf118ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+7:22735:x1877760506301312:12345-0@lo:101:mount.lustre.0 Request processed in 95us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772514.080973:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790772514.081072:0:22735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22735:1877760506301312:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790772514.081084:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8c00/0x418ffb1c3bcc9447 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc944e expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.081092:0:22735:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8c00/0x418ffb1c3bcc9447 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc944e expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772514.081104:0:22735:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1790772514.081120:0:22735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8c00/0x418ffb1c3bcc9447 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc944e expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.081126:0:22735:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8c00/0x418ffb1c3bcc9447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc944e expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772514.081132:0:22735:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790772514.081136:0:22735:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790772514.081140:0:22735:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ecdfb45f000 10000000:01000000:2.0:1790772514.081142:0:22735:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1790772514.081152:0:22735:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1790772514.081154:0:22735:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1790772514.081196:0:22735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8400/0x418ffb1c3bcc9455 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.081204:0:22735:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8400/0x418ffb1c3bcc9455 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.081211:0:22735:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8400/0x418ffb1c3bcc9455 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772514.081223:0:22735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22735:1877760506301440:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790772514.081249:0:22735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772514.081275:0:22735:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc9c1d780 going to sleep for 11 seconds 00000100:00100000:1.0:1790772514.081311:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506301440 00000100:00100000:1.0:1790772514.081315:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506301440 00000100:00100000:1.0:1790772514.081347:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790772514.081354:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf118b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+7:22735:x1877760506301440:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790772514.081360:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772514.081367:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ecdef3a7000/0x418ffb1c3bcc945c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x418ffb1c3bcc9455 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772514.081379:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ecdef3a7000/0x418ffb1c3bcc945c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9455 expref: 8 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772514.081387:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ecdef3a7000/0x418ffb1c3bcc945c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9455 expref: 8 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772514.081416:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdef3a7000, rc 0) 00000100:00100000:1.0:1790772514.081454:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf118b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+8:22735:x1877760506301440:12345-0@lo:101:mount.lustre.0 Request processed in 101us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772514.081460:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790772514.081538:0:22735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22735:1877760506301440:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790772514.081550:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8400/0x418ffb1c3bcc9455 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc945c expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.081557:0:22735:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8400/0x418ffb1c3bcc9455 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc945c expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772514.081598:0:22735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22735:1877760506301568:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790772514.081623:0:22735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772514.081645:0:22735:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc9c1d780 going to sleep for 11 seconds 00000100:00100000:3.0:1790772514.081696:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506301568 00000100:00100000:3.0:1790772514.081700:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506301568 00000100:00100000:3.0:1790772514.081727:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790772514.081734:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcba8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+8:22735:x1877760506301568:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790772514.081852:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcba8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+9:22735:x1877760506301568:12345-0@lo:501:mount.lustre.0 Request processed in 119us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772514.081859:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790772514.081926:0:22735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22735:1877760506301568:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790772514.081962:0:22735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22735:1877760506301696:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790772514.082000:0:22735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772514.082028:0:22735:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc9c1d780 going to sleep for 11 seconds 00000100:00100000:1.0:1790772514.082042:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506301696 00000100:00100000:1.0:1790772514.082046:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506301696 00000100:00100000:1.0:1790772514.082083:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790772514.082090:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcbaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+9:22735:x1877760506301696:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790772514.088657:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcbaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+9:22735:x1877760506301696:12345-0@lo:503:mount.lustre.0 Request processed in 6559us (6647us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772514.088672:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790772514.088715:0:22735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22735:1877760506301696:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790772514.089248:0:22774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22774:1877760506301824:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772514.089293:0:22774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772514.089321:0:22774:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc9c1d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772514.089660:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506301824 00000100:00100000:0.0:1790772514.089666:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506301824 00000100:00100000:0.0:1790772514.089705:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790772514.089713:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcbab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+9:22774:x1877760506301824:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790772514.090383:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcbab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+9:22774:x1877760506301824:12345-0@lo:502:llog_process_th.0 Request processed in 670us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772514.090390:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790772514.090527:0:22774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22774:1877760506301824:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790772514.090553:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790772514.090563:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772514.090565:0:22774:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1790772514.090570:0:22774:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1790772514.090573:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790772514.090585:0:22774:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9eccc25b8000) 00000020:00000080:2.0:1790772514.090598:0:22774:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1790772514.090602:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1790772514.090685:0:22774:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:2.0:1790772514.090691:0:22774:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x418ffb1c3bcc946a 00000020:00000080:2.0:1790772514.090865:0:22774:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1790772514.090869:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790772514.090872:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772514.090873:0:22774:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1790772514.090876:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790772514.090879:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772514.090880:0:22774:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1790772514.090883:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790772514.090890:0:22774:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9eccc25bb380) 00000020:00000080:2.0:1790772514.090898:0:22774:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1790772514.090901:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1790772514.090902:0:22774:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1790772514.090905:0:22774:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1790772514.090910:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790772514.090967:0:22774:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ecdfb45f000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1790772514.090979:0:22774:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9eccc25b99c0) 00000020:00000080:2.0:1790772514.090986:0:22774:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1790772514.091034:0:22774:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1790772514.091038:0:22774:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x418ffb1c3bcc947f 00000020:00000080:2.0:1790772514.091115:0:22774:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1790772514.091120:0:22774:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1790772514.091123:0:22774:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x418ffb1c3bcc9486 00080000:01000000:2.0:1790772514.091127:0:22774:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:2.0:1790772514.091129:0:22774:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x418ffb1c3bcc948d 00010000:00010000:1.0:1790772514.190189:0:22774:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1790772514.190716:0:22774:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:1.0:1790772514.191033:0:22774:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1790772514.191588:0:22774:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9ecddfe299c0) 00000020:00000080:1.0:1790772514.191606:0:22774:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1790772514.191681:0:22774:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:1.0:1790772514.191689:0:22774:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x418ffb1c3bcc949b 00000020:00000080:0.0:1790772514.202793:0:22774:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1790772514.205842:0:22774:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x418ffb1c3bcc94a2 00000020:00000080:1.0:1790772514.206192:0:22774:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1790772514.206203:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772514.206210:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772514.206212:0:22774:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1790772514.206216:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790772514.206218:0:22774:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1790772514.206220:0:22774:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790772514.206221:0:22774:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790772514.206223:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790772514.206225:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772514.206232:0:22774:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790772514.206235:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790772514.206241:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772514.206242:0:22774:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1790772514.206246:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1790772514.206286:0:22774:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1790772514.206302:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772514.206305:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772514.206307:0:22774:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1790772514.206309:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790772514.206312:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772514.206314:0:22774:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1790772514.206317:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790772514.206322:0:22774:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.114@tcp to nid 0x20000c0a8ce72 (192.168.206.114@tcp) 00000020:00000080:1.0:1790772514.206346:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790772514.206360:0:22774:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9ecddfe2cd40) 00000020:00000080:1.0:1790772514.206373:0:22774:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1790772514.206378:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790772514.206428:0:22774:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1790772514.206537:0:22774:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:1.0:1790772514.206545:0:22774:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x418ffb1c3bcc94b0 00010000:00080000:1.0:1790772514.206576:0:22774:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ecdd1145800@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.114@tcp at head 00010000:00010000:1.0:1790772514.208899:0:22774:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1790772514.209876:0:22774:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790772514.209892:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1790772514.209934:0:22774:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1790772514.210091:0:22774:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x418ffb1c3bcc94b7 00000100:00080000:0.0:1790772514.210112:0:22774:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790772514.210143:0:22774:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ecdd1145800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:0.0:1790772514.210252:0:22774:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdeec51180 x1877760506301952/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790772514.210279:0:22774:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1790772514.210360:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790772514.210365:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772514.210367:0:22774:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1790772514.210371:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790772514.210374:0:22774:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1790772514.210375:0:22774:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790772514.210377:0:22774:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790772514.210378:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790772514.210381:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772514.210382:0:22774:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790772514.210386:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790772514.210391:0:22774:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1790772514.210395:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772514.210396:0:22774:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1790772514.210399:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790772514.210403:0:22774:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.114@tcp to nid 0x20000c0a8ce72 (192.168.206.114@tcp) 00000020:01000000:0.0:1790772514.210426:0:22774:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1790772514.210428:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790772514.210452:0:22774:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ecdfc7f3380) 00000020:00000080:0.0:1790772514.210465:0:22774:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1790772514.210470:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790772514.210551:0:22774:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1790772514.210557:0:22774:0:(osd_handler.c:8931:osd_obd_connect()) connect #6 00000020:00000080:0.0:1790772514.210563:0:22774:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x418ffb1c3bcc94c5 00010000:00080000:0.0:1790772514.210603:0:22774:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ecdd1143800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.114@tcp at head 00010000:00010000:0.0:1790772514.210836:0:22774:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:1.0:1790772514.211570:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506301952:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790772514.211669:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772514.211779:0:22761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506301952 00000100:00100000:3.0:1790772514.211786:0:22761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506301952 00000100:00100000:3.0:1790772514.211830:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790772514.211837:0:22761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf8092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1877760506301952:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1790772514.211854:0:22761:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:0.0:1790772514.217357:0:22774:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1790772514.217582:0:22774:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1790772514.220385:0:22774:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790772514.220756:0:22774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1790772514.223900:0:22774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:0.0:1790772514.224520:0:22780:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1790772514.224526:0:22780:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1790772514.225161:0:22774:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790772514.225248:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790772514.225284:0:22774:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1790772514.225301:0:22774:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x418ffb1c3bcc94cc 00000100:00080000:0.0:1790772514.225310:0:22774:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790772514.225321:0:22774:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ecdd1143800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:0.0:1790772514.225353:0:22774:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdeec53800 x1877760506302080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790772514.225376:0:22774:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1790772514.225467:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790772514.225472:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772514.225474:0:22774:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1790772514.225477:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790772514.225480:0:22774:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1790772514.225481:0:22774:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790772514.225483:0:22774:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790772514.225485:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790772514.225487:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772514.225489:0:22774:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790772514.225491:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790772514.225495:0:22774:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1790772514.225498:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772514.225500:0:22774:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1790772514.225511:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790772514.225515:0:22774:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.114@tcp to nid 0x20000c0a8ce72 (192.168.206.114@tcp) 00000020:01000000:0.0:1790772514.225535:0:22774:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1790772514.225538:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790772514.225548:0:22774:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9ecdfc7f19c0) 00000020:00000080:0.0:1790772514.225559:0:22774:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1790772514.225576:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790772514.225629:0:22774:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1790772514.225634:0:22774:0:(osd_handler.c:8931:osd_obd_connect()) connect #7 00000020:00000080:0.0:1790772514.225639:0:22774:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x418ffb1c3bcc94da 00010000:00080000:0.0:1790772514.225662:0:22774:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ecdff753800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.114@tcp at head 00010000:00010000:0.0:1790772514.225838:0:22774:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1790772514.225889:0:22774:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1790772514.225901:0:22774:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1790772514.226132:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506302080:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1790772514.226199:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877760506302080 offset 0 length 520: 4 00000100:00100000:3.0:1790772514.232058:0:22761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf8092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1877760506301952:12345-0@lo:38:llog_process_th.0 Request processed in 20208us (20376us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790772514.232076:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1790772514.233381:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ecdd1145800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790772514.233394:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790772514.233399:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506301952:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1790772514.240087:0:22774:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790772514.240569:0:22774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1790772514.241115:0:22774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:3.0:1790772514.242149:0:22782:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1790772514.242158:0:22782:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1790772514.252052:0:22774:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790772514.252074:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790772514.252133:0:22774:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1790772514.252159:0:22774:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x418ffb1c3bcc94e1 00000100:00080000:2.0:1790772514.252210:0:22774:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790772514.252225:0:22774:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ecdff753800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:2.0:1790772514.252276:0:22774:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdf62e7480 x1877760506302208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790772514.252305:0:22774:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1790772514.252389:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790772514.252395:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772514.252397:0:22774:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1790772514.252401:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790772514.252407:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772514.252408:0:22774:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790772514.252412:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790772514.252415:0:22774:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790772514.252418:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790772514.252420:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772514.252422:0:22774:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790772514.252425:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790772514.252427:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772514.252455:0:22774:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790772514.252461:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1790772514.252502:0:22774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22774:1877760506302336:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772514.252601:0:22774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772514.252666:0:22774:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecde012bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790772514.252676:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506302336 00000100:00100000:0.0:1790772514.252692:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506302336 00000100:00100000:0.0:1790772514.252763:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790772514.252774:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcbaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+9:22774:x1877760506302336:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790772514.252969:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcbaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+9:22774:x1877760506302336:12345-0@lo:502:llog_process_th.0 Request processed in 196us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772514.252978:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790772514.253116:0:22774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22774:1877760506302336:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790772514.253150:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790772514.253156:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772514.253158:0:22774:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790772514.253162:0:22774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:1.0:1790772514.253337:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506302208:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1790772514.253408:0:22735:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1790772514.253813:0:22735:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1790772514.253841:0:22735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8400/0x418ffb1c3bcc9455 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc945c expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.253855:0:22735:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8400/0x418ffb1c3bcc9455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc945c expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772514.253865:0:22735:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ecdfb45f000 from 1 10000000:01000000:3.0:1790772514.253868:0:22735:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790772514.253918:0:22735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0600/0x418ffb1c3bcc94e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.253941:0:22735:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0600/0x418ffb1c3bcc94e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.253960:0:22735:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0600/0x418ffb1c3bcc94e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772514.253981:0:22735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22735:1877760506302464:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790772514.254035:0:22735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772514.254075:0:22735:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdd1b846c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772514.254543:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506302464 00000100:00100000:2.0:1790772514.254553:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506302464 00000100:00100000:2.0:1790772514.254594:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790772514.254601:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcbab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+9:22735:x1877760506302464:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790772514.254613:0:22749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772514.254632:0:22749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ecdf4bd9a00/0x418ffb1c3bcc94ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x418ffb1c3bcc94e8 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.254655:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ecdf4bd9a00/0x418ffb1c3bcc94ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x418ffb1c3bcc94e8 expref: 10 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.254666:0:22749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ecdf4bd9a00/0x418ffb1c3bcc94ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc94e8 expref: 10 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.254674:0:22749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdf4bd9a00, rc 0) 00000100:00100000:2.0:1790772514.254738:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcbab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+10:22735:x1877760506302464:12345-0@lo:101:mount.lustre.0 Request processed in 138us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772514.254744:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790772514.255245:0:22735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22735:1877760506302464:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790772514.255266:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0600/0x418ffb1c3bcc94e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc94ef expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.255278:0:22735:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0600/0x418ffb1c3bcc94e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc94ef expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772514.255854:0:22735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec50380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22735:1877760506302592:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1790772514.255964:0:22735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772514.256010:0:22735:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecde10c3180 going to sleep for 11 seconds 00000100:00100000:2.0:1790772514.256019:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506302592 00000100:00100000:2.0:1790772514.256031:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506302592 00000100:00100000:2.0:1790772514.256067:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790772514.256074:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcba8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+10:22735:x1877760506302592:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1790772514.256087:0:22751:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1790772514.256092:0:22751:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1790772514.256185:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcba8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+10:22735:x1877760506302592:12345-0@lo:256:mount.lustre.0 Request processed in 91us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772514.256192:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790772514.256285:0:22735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec50380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22735:1877760506302592:0@lo:256:mount.lustre.0 00000400:00000100:1.0:1790772514.256306:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877760506302208 offset 0 length 520: 4 10000000:01000000:3.0:1790772514.256795:0:22735:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790772514.256815:0:22735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0600/0x418ffb1c3bcc94e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc94ef expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.256825:0:22735:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0600/0x418ffb1c3bcc94e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc94ef expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772514.256833:0:22735:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ecdfb45f000 from 1 10000000:01000000:3.0:1790772514.256836:0:22735:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790772514.256858:0:22735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1000/0x418ffb1c3bcc94f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.256866:0:22735:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1000/0x418ffb1c3bcc94f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.256875:0:22735:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1000/0x418ffb1c3bcc94f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772514.256897:0:22735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22735:1877760506302720:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790772514.256924:0:22735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772514.256944:0:22735:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdd1b846c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772514.257109:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506302720 00000100:00100000:2.0:1790772514.257113:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506302720 00000100:00100000:2.0:1790772514.257143:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790772514.257149:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcba8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+10:22735:x1877760506302720:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790772514.257157:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772514.257194:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ecdf4bd9000/0x418ffb1c3bcc94fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x418ffb1c3bcc94f6 expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.257213:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ecdf4bd9000/0x418ffb1c3bcc94fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x418ffb1c3bcc94f6 expref: 11 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.257223:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ecdf4bd9000/0x418ffb1c3bcc94fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc94f6 expref: 11 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.257232:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdf4bd9000, rc 0) 00000100:00100000:2.0:1790772514.257273:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcba8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+11:22735:x1877760506302720:12345-0@lo:101:mount.lustre.0 Request processed in 124us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772514.257279:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790772514.257363:0:22735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22735:1877760506302720:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790772514.257375:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1000/0x418ffb1c3bcc94f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc94fd expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.257382:0:22735:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1000/0x418ffb1c3bcc94f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc94fd expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772514.257487:0:22735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22735:1877760506302848:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790772514.257509:0:22735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772514.257535:0:22735:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdd1b846c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772514.257837:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506302848 00000100:00100000:2.0:1790772514.257841:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506302848 00000100:00100000:2.0:1790772514.257870:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790772514.257884:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcba9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+11:22735:x1877760506302848:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790772514.258028:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcba9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+11:22735:x1877760506302848:12345-0@lo:501:mount.lustre.0 Request processed in 144us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772514.258034:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790772514.260315:0:22735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22735:1877760506302848:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790772514.260372:0:22735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22735:1877760506302976:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790772514.260581:0:22735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772514.260607:0:22735:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdd1b846c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772514.260764:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506302976 00000100:00100000:2.0:1790772514.260771:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506302976 00000100:00100000:2.0:1790772514.260819:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790772514.260829:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcba9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+11:22735:x1877760506302976:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790772514.260939:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcba9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+11:22735:x1877760506302976:12345-0@lo:503:mount.lustre.0 Request processed in 112us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772514.260947:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790772514.261098:0:22735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22735:1877760506302976:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790772514.261625:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22784:1877760506303104:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772514.261666:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772514.261698:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc37796c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772514.261723:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506303104 00000100:00100000:0.0:1790772514.261729:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506303104 00000100:00100000:0.0:1790772514.261768:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790772514.261776:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcbaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+11:22784:x1877760506303104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790772514.262379:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcbaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+11:22784:x1877760506303104:12345-0@lo:502:llog_process_th.0 Request processed in 597us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772514.262394:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790772514.263866:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22784:1877760506303104:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790772514.263916:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790772514.263928:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772514.263931:0:22784:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790772514.263941:0:22784:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ecdfb45f000 00000020:00000080:2.0:1790772514.263944:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790772514.263961:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790772514.263964:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772514.263965:0:22784:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1790772514.263968:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790772514.263971:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772514.263972:0:22784:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790772514.263975:0:22784:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ecdfb45f000 00000020:00000080:2.0:1790772514.263977:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790772514.264051:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790772514.264055:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772514.264056:0:22784:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1790772514.264059:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790772514.264061:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772514.264063:0:22784:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790772514.264067:0:22784:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ecdfb45f000 00000020:00000080:2.0:1790772514.264068:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790772514.264089:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790772514.264092:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772514.264093:0:22784:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790772514.264096:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790772514.264098:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772514.264100:0:22784:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1790772514.264103:0:22784:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ecdfb45f000 00000020:00000080:2.0:1790772514.264106:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790772514.264150:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22784:1877760506303232:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772514.264245:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772514.264288:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc9c1d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790772514.264671:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506303232 00000100:00100000:3.0:1790772514.264679:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506303232 00000100:00100000:3.0:1790772514.264727:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790772514.264739:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcbab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+11:22784:x1877760506303232:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790772514.264869:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcbab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+11:22784:x1877760506303232:12345-0@lo:502:llog_process_th.0 Request processed in 133us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772514.264887:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790772514.264960:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22784:1877760506303232:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790772514.265014:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790772514.265025:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772514.265028:0:22784:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1790772514.265034:0:22784:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1790772514.265457:0:22735:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1790772514.265502:0:22735:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790772514.265523:0:22735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1000/0x418ffb1c3bcc94f6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc94fd expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.265535:0:22735:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1000/0x418ffb1c3bcc94f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc94fd expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772514.265597:0:22735:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790772514.265600:0:22735:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ecdfb45f000 10000000:01000000:3.0:1790772514.265603:0:22735:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ecdfb45f000 10000000:01000000:3.0:1790772514.265608:0:22735:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790772514.265613:0:22735:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ecdfb45f000 from 1 10000000:01000000:3.0:1790772514.265616:0:22735:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790772514.265645:0:22735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0000/0x418ffb1c3bcc9504 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.265654:0:22735:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0000/0x418ffb1c3bcc9504 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.265664:0:22735:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0000/0x418ffb1c3bcc9504 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772514.265682:0:22735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22735:1877760506303360:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790772514.265723:0:22735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772514.265757:0:22735:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc885d180 going to sleep for 11 seconds 00000100:00100000:0.0:1790772514.265774:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506303360 00000100:00100000:0.0:1790772514.265784:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506303360 00000100:00100000:0.0:1790772514.265842:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790772514.265852:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcba8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+11:22735:x1877760506303360:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790772514.265869:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772514.265896:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eccc1bd1400/0x418ffb1c3bcc950b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x418ffb1c3bcc9504 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.265939:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eccc1bd1400/0x418ffb1c3bcc950b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9504 expref: 12 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.265962:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eccc1bd1400/0x418ffb1c3bcc950b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9504 expref: 12 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.265991:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eccc1bd1400, rc 0) 00000100:00100000:0.0:1790772514.266069:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcba8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+12:22735:x1877760506303360:12345-0@lo:101:mount.lustre.0 Request processed in 217us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772514.266078:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790772514.266145:0:22735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22735:1877760506303360:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790772514.266216:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0000/0x418ffb1c3bcc9504 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc950b expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.266228:0:22735:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0000/0x418ffb1c3bcc9504 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc950b expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772514.266309:0:22735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22735:1877760506303488:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790772514.266348:0:22735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772514.266368:0:22735:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecde10c3180 going to sleep for 11 seconds 00000100:00100000:3.0:1790772514.266621:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506303488 00000100:00100000:3.0:1790772514.266630:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506303488 00000100:00100000:3.0:1790772514.266803:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790772514.266816:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcbaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+12:22735:x1877760506303488:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790772514.266973:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcbaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+12:22735:x1877760506303488:12345-0@lo:501:mount.lustre.0 Request processed in 159us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772514.267637:0:22735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22735:1877760506303488:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790772514.267679:0:22735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22735:1877760506303616:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790772514.267724:0:22735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772514.267753:0:22735:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc3779d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790772514.271305:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506303616 00000100:00100000:0.0:1790772514.271324:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506303616 00000100:00100000:0.0:1790772514.271381:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790772514.271393:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcbabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+13:22735:x1877760506303616:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790772514.272155:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcbabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+13:22735:x1877760506303616:12345-0@lo:503:mount.lustre.0 Request processed in 760us (4425us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772514.272190:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790772514.273536:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790772514.273966:0:22735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22735:1877760506303616:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790772514.274514:0:22786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22786:1877760506303744:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772514.274585:0:22786:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772514.274624:0:22786:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc3779cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772514.274746:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506303744 00000100:00100000:0.0:1790772514.274760:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506303744 00000100:00100000:0.0:1790772514.274834:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790772514.274846:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcba9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+12:22786:x1877760506303744:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790772514.275141:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcba9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+12:22786:x1877760506303744:12345-0@lo:502:llog_process_th.0 Request processed in 297us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772514.275154:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790772514.278279:0:22786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22786:1877760506303744:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1790772514.278370:0:22786:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1790772514.278386:0:22786:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9eccc25bcd40) 00000020:00000080:2.0:1790772514.278407:0:22786:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1790772514.278551:0:22786:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ecdfb45f000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1790772514.278557:0:22786:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ecdfb45f000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1790772514.278560:0:22786:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ecdfb45f000 4 00010000:00080000:2.0:1790772514.278604:0:22786:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ecdfc731000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.114@tcp at head 00010000:00010000:2.0:1790772514.282269:0:22786:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1790772514.282484:0:22786:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1790772514.282526:0:22786:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790772514.282540:0:22786:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x418ffb1c3bcc9519 00000100:00080000:2.0:1790772514.282550:0:22786:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790772514.282561:0:22786:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ecdfc731000 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:2.0:1790772514.282595:0:22786:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdf62e4000 x1877760506303872/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790772514.282617:0:22786:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790772514.290141:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877760506303872:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790772514.290316:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772514.290910:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506303872 00000100:00100000:0.0:1790772514.290919:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506303872 00000100:00100000:0.0:1790772514.290961:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790772514.290967:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf8090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1877760506303872:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790772514.291034:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf8090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1877760506303872:12345-0@lo:38:llog_process_th.0 Request processed in 65us (718us total) trans 0 rc -11/-11 00000100:00100000:0.0:1790772514.291041:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790772514.291081:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790772514.291100:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ecdfc731000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790772514.291106:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1790772514.291111:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877760506303872:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790772514.294160:0:22786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22786:1877760506304000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772514.294262:0:22786:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772514.294300:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506304000 00000100:00100000:2.0:1790772514.294306:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506304000 00000100:00100000:2.0:1790772514.294342:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790772514.294351:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcba9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+12:22786:x1877760506304000:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772514.294459:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcba9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+12:22786:x1877760506304000:12345-0@lo:502:llog_process_th.0 Request processed in 109us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772514.294467:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790772514.294514:0:22786:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc3779c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790772514.294534:0:22786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22786:1877760506304000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772514.294577:0:22786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22786:1877760506304128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772514.294608:0:22786:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772514.294629:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506304128 00000100:00100000:2.0:1790772514.294634:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506304128 00000100:00100000:2.0:1790772514.294653:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790772514.294659:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+12:22786:x1877760506304128:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772514.294717:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+12:22786:x1877760506304128:12345-0@lo:502:llog_process_th.0 Request processed in 57us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772514.294723:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790772514.294750:0:22786:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc3779c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790772514.294762:0:22786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22786:1877760506304128:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1790772514.294780:0:22786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1790772514.294832:0:22735:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1790772514.294860:0:22735:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790772514.294876:0:22735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0000/0x418ffb1c3bcc9504 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc950b expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.294887:0:22735:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0000/0x418ffb1c3bcc9504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc950b expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790772514.294932:0:22735:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790772514.294934:0:22735:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790772514.294936:0:22735:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790772514.294937:0:22735:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790772514.294939:0:22735:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790772514.294940:0:22735:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790772514.294942:0:22735:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790772514.294943:0:22735:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790772514.294945:0:22735:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790772514.294964:0:22735:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790772514.294968:0:22735:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1790772514.294970:0:22735:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790772514.294971:0:22735:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790772514.294972:0:22735:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790772514.294973:0:22735:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790772514.294973:0:22735:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790772514.294974:0:22735:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790772514.294975:0:22735:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790772514.294976:0:22735:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790772514.294977:0:22735:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790772514.294978:0:22735:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790772514.294990:0:22735:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790772514.294999:0:22735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22735:1877760506304256:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790772514.295029:0:22735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772514.295045:0:22735:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc3779c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790772514.295065:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506304256 00000100:00100000:2.0:1790772514.295069:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506304256 00000100:00100000:2.0:1790772514.295090:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790772514.295096:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+12:22735:x1877760506304256:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790772514.295114:0:22751:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1790772514.295128:0:22751:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1790772514.302728:0:22751:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790772514.302743:0:22751:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1790772514.302875:0:22772:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790772514.302881:0:22772:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790772514.302901:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eccc1bd0200/0x418ffb1c3bcc9520 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.302919:0:22772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ecdf4bd9a00/0x418ffb1c3bcc94ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc94e8 expref: 12 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.302928:0:22772:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eccc1bd0200/0x418ffb1c3bcc9520 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.302974:0:22772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ecdf4bd9a00/0x418ffb1c3bcc94ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x418ffb1c3bcc94e8 expref: 12 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.302988:0:22772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ecdf4bd9a00/0x418ffb1c3bcc94ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x418ffb1c3bcc94e8 expref: 12 pid: 22749 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772514.303068:0:22772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec52a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22772:1877760506304384:0@lo:104: 00000100:00100000:0.0:1790772514.303214:0:22772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772514.303253:0:22772:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc9c1d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772514.303760:0:22739:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506304384 00000100:00100000:2.0:1790772514.303769:0:22739:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506304384 00000100:00100000:2.0:1790772514.303813:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790772514.303822:0:22739:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeec50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+3:22772:x1877760506304384:12345-0@lo:104: 00010000:00010000:2.0:1790772514.303835:0:22739:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0600/0x418ffb1c3bcc94e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x418ffb1c3bcc94ef expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.303892:0:22739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790772514.303898:0:22739:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeec50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+3:22772:x1877760506304384:12345-0@lo:104: Request processed in 77us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772514.303910:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790772514.303962:0:22772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec52a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22772:1877760506304384:0@lo:104: 00010000:00010000:2.0:1790772514.303984:0:22772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eccc1bd0200/0x418ffb1c3bcc9520 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772514.304043:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+12:22735:x1877760506304256:12345-0@lo:253:mount.lustre.0 Request processed in 8947us (9013us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772514.304052:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790772514.304090:0:22735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22735:1877760506304256:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790772514.304099:0:22735:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790772514.304102:0:22735:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790772514.304104:0:22735:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790772514.304105:0:22735:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790772514.304107:0:22735:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790772514.304108:0:22735:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790772514.304109:0:22735:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790772514.304111:0:22735:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790772514.304112:0:22735:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790772514.304114:0:22735:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790772514.304115:0:22735:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790772514.304124:0:22735:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1790772514.304327:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772514.304334:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0600/0x418ffb1c3bcc94e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x418ffb1c3bcc94ef expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.304343:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdfbab0600 already unused, calling callback (ffffffffc11ffc20) 10000000:00010000:0.0:1790772514.304347:0:22745:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0600/0x418ffb1c3bcc94e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x418ffb1c3bcc94ef expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.304356:0:22745:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0600/0x418ffb1c3bcc94e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x418ffb1c3bcc94ef expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790772514.304364:0:22745:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0600/0x418ffb1c3bcc94e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x418ffb1c3bcc94ef expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772514.304370:0:22745:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790772514.304400:0:22745:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0600/0x418ffb1c3bcc94e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc94ef expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.304407:0:22745:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790772514.304422:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0600/0x418ffb1c3bcc94e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc94ef expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.304430:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0600/0x418ffb1c3bcc94e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc94ef expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.304446:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772514.304453:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772514.304455:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772514.304481:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790772514.304490:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3645:1877760506304512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790772514.305303:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772514.312403:0:22741:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506304512 00000100:00100000:2.0:1790772514.312415:0:22741:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506304512 00010000:00010000:2.0:1790772514.312466:0:22741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ecdf4bd9a00/0x418ffb1c3bcc94ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x418ffb1c3bcc94e8 expref: 12 pid: 22749 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772514.312505:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790772514.312515:0:22741:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeec53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+12:3645:x1877760506304512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790772514.312528:0:22741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772514.312533:0:22741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ecdf4bd9a00/0x418ffb1c3bcc94ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x418ffb1c3bcc94e8 expref: 12 pid: 22749 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.312552:0:22741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ecdf4bd9a00/0x418ffb1c3bcc94ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x418ffb1c3bcc94e8 expref: 12 pid: 22749 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.312581:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ecdf4bd9a00/0x418ffb1c3bcc94ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x418ffb1c3bcc94e8 expref: 12 pid: 22749 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.312597:0:22741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eccc1bd0200/0x418ffb1c3bcc9520 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.312605:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eccc1bd0200/0x418ffb1c3bcc9520 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790772514.312621:0:22741:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009740906s 00010000:00010000:2.0:1790772514.312626:0:22741:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eccc1bd0200/0x418ffb1c3bcc9520 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.312632:0:22741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eccc1bd0200/0x418ffb1c3bcc9520 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.312638:0:22741:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eccc1bd0200/0x418ffb1c3bcc9520 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.312645:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eccc1bd0200/0x418ffb1c3bcc9520 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.312651:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc1bd0200 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:2.0:1790772514.312655:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eccc1bd0200/0x418ffb1c3bcc9520 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.312662:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eccc1bd0200/0x418ffb1c3bcc9520 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.312683:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eccc1bd0200/0x418ffb1c3bcc9520 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.312694:0:22741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772514.313472:0:22741:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeec53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+11:3645:x1877760506304512:12345-0@lo:103:ldlm_bl.0 Request processed in 957us (8168us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772514.313481:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790772514.313526:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3645:1877760506304512:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790772514.313554:0:22772:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eccc1bd0200/0x418ffb1c3bcc9520 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.313563:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eccc1bd0200/0x418ffb1c3bcc9520 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.313570:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eccc1bd0200/0x418ffb1c3bcc9520 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790772514.331815:0:22735:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:3.0:1790772514.336887:0:22735:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1790772514.338306:0:22796:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:1.0:1790772514.338314:0:22796:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:1.0:1790772514.338832:0:22797:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1790772514.338854:0:22735:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1790772514.339262:0:22797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1790772514.340199:0:22735:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1790772514.340231:0:22735:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790772514.341450:0:22797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1790772514.341516:0:22797:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00000080:3.0:1790772514.341934:0:22735:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000100:00080000:2.0:1790772514.342300:0:22798:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9ecdf62e5180 x1877760506304640/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772514.342314:0:22798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdea11d3c0 going to sleep for 0 seconds 00000040:01000000:3.0:1790772514.342640:0:22735:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1790772514.342717:0:22735:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790772514.344281:0:22735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1790772514.345148:0:22735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1790772514.345254:0:22735:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1790772514.346079:0:22735:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:3.0:1790772514.348197:0:22735:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:3.0:1790772514.353216:0:22735:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1790772514.357232:0:22735:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1790772514.357266:0:22735:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb37a01633988 00100000:10000000:0.0:1790772514.357272:0:22735:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1790772514.358334:0:22735:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790772514.358348:0:22735:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.114@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790772514.358364:0:22735:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1790772514.358381:0:22735:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1790772514.361395:0:22735:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790772514.362393:0:22735:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790772514.965157:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772515.348242:0:22798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdea11d3c0 going to sleep for 0 seconds 00000040:00080000:3.0:1790772515.352624:0:22792:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1790772515.352633:0:22792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790772515.355599:0:22792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1790772515.355615:0:22792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:2.0:1790772515.668810:0:22754:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790772515.668817:0:22754:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ecdfb45f000 from 11 10000000:01000000:2.0:1790772515.668822:0:22754:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790772515.668873:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8200/0x418ffb1c3bcc9527 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772515.668885:0:22754:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8200/0x418ffb1c3bcc9527 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772515.668906:0:22754:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8200/0x418ffb1c3bcc9527 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772515.668933:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506304768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790772515.669018:0:22754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772515.669070:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc266ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1790772515.669475:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506304768 00000100:00100000:1.0:1790772515.669484:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506304768 00000100:00100000:1.0:1790772515.669592:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790772515.669602:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+11:22754:x1877760506304768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772515.669615:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772515.669630:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ecdef3a7400/0x418ffb1c3bcc952e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x418ffb1c3bcc9527 expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772515.669651:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ecdef3a7400/0x418ffb1c3bcc952e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9527 expref: 12 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772515.669661:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ecdef3a7400/0x418ffb1c3bcc952e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9527 expref: 12 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772515.669669:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdef3a7400, rc 0) 00000100:00100000:1.0:1790772515.669718:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+12:22754:x1877760506304768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772515.669725:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790772515.672956:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506304768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790772515.672982:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8200/0x418ffb1c3bcc9527 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc952e expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772515.672994:0:22754:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8200/0x418ffb1c3bcc9527 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc952e expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772515.673063:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506304896:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790772515.673158:0:22754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772515.673210:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc266ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1790772515.673221:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506304896 00000100:00100000:0.0:1790772515.673227:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506304896 00000100:00100000:0.0:1790772515.673276:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790772515.673285:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+12:22754:x1877760506304896:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790772515.673305:0:22751:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790772515.673322:0:22751:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790772515.673325:0:22751:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1790772515.673416:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+12:22754:x1877760506304896:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 132us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772515.673421:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506304896:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790772515.673460:0:22754:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790772515.673467:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8200/0x418ffb1c3bcc9527 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc952e expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772515.673477:0:22754:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8200/0x418ffb1c3bcc9527 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc952e expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772515.676826:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1790772515.988334:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772516.373852:0:22798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdea11d3c0 going to sleep for 0 seconds 00000040:00080000:1.0:1790772516.382315:0:22792:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790772516.382323:0:22792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790772516.382440:0:22792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:1.0:1790772516.382478:0:22792:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790772516.386743:0:22792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:1.0:1790772517.012409:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772517.396413:0:22798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdea11d3c0 going to sleep for 0 seconds 00010000:00010000:1.0:1790772518.040777:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772518.421438:0:22798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdea11d3c0 going to sleep for 0 seconds 00000001:02000400:2.0:1790772518.915870:0:23039:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg614-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1790772519.081653:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772519.444241:0:22798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdea11d3c0 going to sleep for 0 seconds 00000100:00100000:2.0:1790772519.702050:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3643:1877760506305024:0@lo:400:kworker.0 00000100:00100000:2.0:1790772519.702141:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772519.702373:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506305024 00000100:00100000:3.0:1790772519.702394:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506305024 00000100:00100000:3.0:1790772519.702484:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790772519.702494:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+12:3643:x1877760506305024:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1790772519.702611:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1790772519.702616:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1790772519.702619:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ecdd1145800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790772519.702624:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 614 00000100:00080000:0.0:1790772519.702628:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790772519.702635:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ecdd1145800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:0.0:1790772519.702665:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdeec51880 x1877760506305152/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790772519.702681:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790772519.702685:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790772519.702688:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790772519.702691:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790772519.702694:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1790772519.702696:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790772519.702698:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ecdfc731000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790772519.702704:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ecdfc731000 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:0.0:1790772519.702717:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdeec51c00 x1877760506305280/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790772519.702740:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506305152:0@lo:38:kworker.0 00000100:00100000:0.0:1790772519.702783:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772519.702806:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877760506305280:0@lo:38:kworker.0 00000100:00100000:0.0:1790772519.702846:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772519.702888:0:22762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506305152 00000100:00100000:0.0:1790772519.702892:0:22762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506305152 00000100:00100000:0.0:1790772519.702911:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790772519.702916:0:22762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeec52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1877760506305152:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1790772519.702945:0:22762:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1790772519.702983:0:22762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeec52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1877760506305152:12345-0@lo:38:kworker.0 Request processed in 59us (193us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790772519.702990:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1790772519.703537:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ecdd1145800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790772519.703544:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790772519.703547:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506305152:0@lo:38:kworker.0 00000100:00100000:3.0:1790772519.707038:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+12:3643:x1877760506305024:12345-0@lo:400:kworker.0 Request processed in 4534us (4885us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772519.707054:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790772519.707346:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3643:1877760506305024:0@lo:400:kworker.0 00000100:00100000:2.0:1790772519.707567:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506305280 00000100:00100000:2.0:1790772519.707575:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506305280 00000100:00100000:2.0:1790772519.707764:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790772519.707780:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeec50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1877760506305280:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1790772519.707809:0:22758:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 620 last 0 00000020:00000080:2.0:1790772519.707851:0:22758:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x418ffb1c3bcc9535 00000004:00100000:2.0:1790772519.707868:0:22758:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790772519.708043:0:22758:0:(import.c:65:import_set_state_nolock()) ffff9ecdd16da800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790772519.708142:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeec50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1877760506305280:12345-0@lo:38:kworker.0 Request processed in 370us (5295us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772519.708149:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790772519.708292:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ecdeec51c00 x1877760506305280/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790772529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790772519.708307:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1790772519.708314:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1790772519.708319:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790772519.708321:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ecdfc731000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790772519.708326:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877760506305280:0@lo:38:kworker.0 00000020:00000004:0.0:1790772519.955259:0:23092:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790772519.955432:0:23092:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790772520.086344:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772520.470640:0:22798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdea11d3c0 going to sleep for 0 seconds 00000020:00000004:3.0:1790772520.822451:0:23143:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790772520.822783:0:23143:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790772521.113258:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772521.494538:0:22798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdea11d3c0 going to sleep for 0 seconds 00010000:00010000:0.0:1790772522.136354:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772522.516636:0:22798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdea11d3c0 going to sleep for 0 seconds 00000100:00080000:1.0:1790772522.721712:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790772522.721719:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1790772522.721723:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ecdd1145800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790772522.721731:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 620 00000100:00080000:1.0:1790772522.721736:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1790772522.721747:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ecdd1145800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:1.0:1790772522.721767:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdf8091500 x1877760506305536/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790772522.721784:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790772522.721788:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790772522.721790:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790772522.721793:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790772522.721830:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506305536:0@lo:38:kworker.0 00000100:00100000:1.0:1790772522.721957:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772522.722018:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1877760506305664:0@lo:400:kworker.0 00000100:00100000:1.0:1790772522.722045:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772522.722081:0:22762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506305536 00000100:00100000:1.0:1790772522.722087:0:22762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506305536 00000100:00100000:1.0:1790772522.722115:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790772522.722121:0:22762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf8093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1877760506305536:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1790772522.722152:0:22762:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790772522.722214:0:22762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf8093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1877760506305536:12345-0@lo:38:kworker.0 Request processed in 91us (256us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790772522.722221:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790772522.722253:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506305664 00000100:00100000:1.0:1790772522.722257:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506305664 00000100:00100000:1.0:1790772522.722284:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790772522.722290:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf8092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1877760506305664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772522.722331:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf8092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1877760506305664:12345-0@lo:400:kworker.0 Request processed in 41us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772522.722337:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790772522.722373:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ecdf8090e00 x1877760506305664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772522.722386:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1877760506305664:0@lo:400:kworker.0 00000100:00080000:1.0:1790772522.722410:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ecdd1145800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790772522.722414:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790772522.722418:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506305536:0@lo:38:kworker.0 00000100:00100000:3.0:1790772522.722502:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790772522.722512:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3643:1877760506305408:0@lo:400:kworker.0 00000100:00100000:3.0:1790772522.722551:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772522.725818:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506305408 00000100:00100000:1.0:1790772522.725831:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506305408 00000100:00100000:1.0:1790772522.725903:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790772522.725934:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+12:3643:x1877760506305408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772522.726022:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+12:3643:x1877760506305408:12345-0@lo:400:kworker.0 Request processed in 89us (3470us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772522.726029:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790772522.726080:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3643:1877760506305408:0@lo:400:kworker.0 00010000:00010000:0.0:1790772523.160289:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772523.541192:0:22798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdea11d3c0 going to sleep for 0 seconds 00010000:00010000:0.0:1790772524.180360:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772524.565233:0:22798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdea11d3c0 going to sleep for 0 seconds 00000100:00100000:3.0:1790772524.756288:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790772514/real 1790772514] req@ffff9ecdf62e7480 x1877760506302208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790772524 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772524.756322:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ecdf62e7480 x1877760506302208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790772524 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772524.756344:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790772514/real 1790772514] req@ffff9ecdeec53800 x1877760506302080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790772524 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772524.756358:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ecdeec53800 x1877760506302080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790772524 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790772524.756400:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ecdff753800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790772524.756426:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790772524.756431:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506302208:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1790772524.756437:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ecdd1143800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790772524.756442:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790772524.756444:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506302080:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1790772524.756660:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790772524.756665:0:19463:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1790772524.756668:0:19463:0:(import.c:65:import_set_state_nolock()) ffff9ecdd1145800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790772524.756672:0:19463:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 623 00000100:00080000:1.0:1790772524.756677:0:19463:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1790772524.756687:0:19463:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ecdd1145800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:1.0:1790772524.756707:0:19463:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdf8091500 x1877760506305920/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790772524.756725:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790772524.756728:0:19463:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1790772524.756730:0:19463:0:(import.c:65:import_set_state_nolock()) ffff9ecdd1143800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790772524.756733:0:19463:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 614 00000100:00080000:1.0:1790772524.756735:0:19463:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790772524.756740:0:19463:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ecdd1143800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:1.0:1790772524.756751:0:19463:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdf8090e00 x1877760506306048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790772524.756759:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790772524.756770:0:19463:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790772524.756772:0:19463:0:(import.c:65:import_set_state_nolock()) ffff9ecdff753800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790772524.756775:0:19463:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 614 00000100:00080000:1.0:1790772524.756777:0:19463:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790772524.756782:0:19463:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ecdff753800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:1.0:1790772524.756794:0:19463:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdf8092680 x1877760506306176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790772524.756839:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877760506306304:0@lo:400:kworker.0 00000100:00100000:1.0:1790772524.756907:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772524.756956:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506306304 00000100:00100000:1.0:1790772524.756963:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506306304 00000100:00100000:1.0:1790772524.757001:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790772524.757010:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf8090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877760506306304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772524.757058:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf8090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877760506306304:12345-0@lo:400:kworker.0 Request processed in 49us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772524.757065:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790772524.757098:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ecdf8092a00 x1877760506306304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772524.757110:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877760506306304:0@lo:400:kworker.0 00000100:00100000:2.0:1790772524.757199:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790772524.757209:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3645:1877760506305792:0@lo:400:kworker.0 00000100:00100000:2.0:1790772524.757282:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772524.757506:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506305792 00000100:00100000:1.0:1790772524.757511:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506305792 00000100:00100000:1.0:1790772524.757537:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790772524.757544:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+12:3645:x1877760506305792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772524.757584:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+12:3645:x1877760506305792:12345-0@lo:400:kworker.0 Request processed in 41us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772524.757601:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790772524.757652:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3645:1877760506305792:0@lo:400:kworker.0 00000100:00100000:0.0:1790772524.757821:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506305920:0@lo:38:kworker.0 00000100:00100000:0.0:1790772524.757856:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772524.757887:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506306048:0@lo:8:kworker.0 00000400:00000100:0.0:1790772524.757946:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877760506306048 offset 0 length 520: 4 00000100:00100000:0.0:1790772524.757960:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506306176:0@lo:8:kworker.0 00000400:00000100:0.0:1790772524.757994:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877760506306176 offset 0 length 520: 4 00000100:00100000:1.0:1790772524.758346:0:22762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506305920 00000100:00100000:1.0:1790772524.758352:0:22762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506305920 00000100:00100000:1.0:1790772524.758393:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790772524.758398:0:22762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeec51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1877760506305920:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1790772524.758415:0:22762:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790772524.758460:0:22762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeec51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1877760506305920:12345-0@lo:38:kworker.0 Request processed in 61us (603us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790772524.758467:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1790772524.758609:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ecdd1145800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790772524.758614:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790772524.758617:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506305920:0@lo:38:kworker.0 00010000:00010000:0.0:1790772525.204354:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772525.600304:0:22798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdea11d3c0 going to sleep for 0 seconds 00010000:00010000:0.0:1790772526.228319:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772526.612279:0:22798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdea11d3c0 going to sleep for 0 seconds 00000040:00080000:1.0:1790772526.612932:0:22792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790772527.253331:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772527.637694:0:22798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdea11d3c0 going to sleep for 0 seconds 00000020:01000004:1.0:1790772528.243748:0:23488:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1790772528.243752:0:23488:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1790772528.243754:0:23488:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1790772528.243855:0:23488:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ecde1727000 00000020:01000004:1.0:1790772528.243870:0:23488:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1790772528.243898:0:23488:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1790772528.243911:0:23488:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9ecddfe2b380) 00000020:00000080:1.0:1790772528.243928:0:23488:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00010000:00010000:1.0:1790772528.276797:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1790772528.293662:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1790772528.294512:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1790772528.295112:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1790772528.295500:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1790772528.295709:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1790772528.295927:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1790772528.296114:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1790772528.296527:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1790772528.296718:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1790772528.296915:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1790772528.297076:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1790772528.297791:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1790772528.298699:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1790772528.298895:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1790772528.299088:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1790772528.299290:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1790772528.299651:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1790772528.299848:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1790772528.300048:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1790772528.300499:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1790772528.300703:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1790772528.300903:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1790772528.301091:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1790772528.301301:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1790772528.301675:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1790772528.301858:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1790772528.302046:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1790772528.302416:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1790772528.302678:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1790772528.302871:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1790772528.303071:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1790772528.303289:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1790772528.303635:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1790772528.303833:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1790772528.306137:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1790772528.306432:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1790772528.306835:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1790772528.307035:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1790772528.307252:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1790772528.307577:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1790772528.307764:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1790772528.308039:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1790772528.308518:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1790772528.308723:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1790772528.308932:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1790772528.309219:0:23488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:01000000:2.0:1790772528.309953:0:23488:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1790772528.310139:0:23488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1790772528.310149:0:23488:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790772528.310158:0:23488:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x418ffb1c3bcc9543 00000020:01000004:2.0:1790772528.310334:0:23488:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1790772528.310574:0:23488:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.114@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790772528.310578:0:23488:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790772528.310586:0:23488:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1790772528.310615:0:23488:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1790772528.310619:0:23488:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.114@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1790772528.317544:0:23488:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.114@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790772528.317593:0:23488:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.114@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1790772528.317597:0:23488:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790772528.317599:0:23488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1790772528.317600:0:23488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790772528.317602:0:23488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790772528.317603:0:23488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790772528.317604:0:23488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790772528.317605:0:23488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790772528.317607:0:23488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790772528.317608:0:23488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790772528.317612:0:23488:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1790772528.317615:0:23488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790772528.317616:0:23488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1790772528.317617:0:23488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790772528.317618:0:23488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790772528.317619:0:23488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790772528.317620:0:23488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790772528.317621:0:23488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790772528.317622:0:23488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790772528.317629:0:23488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790772528.317666:0:23488:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1790772528.317686:0:23488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506306432:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790772528.317796:0:23488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772528.317853:0:23488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc8509480 going to sleep for 11 seconds 00000100:00100000:1.0:1790772528.318131:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506306432 00000100:00100000:1.0:1790772528.318139:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506306432 00000100:00100000:1.0:1790772528.318213:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790772528.318222:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+12:23488:x1877760506306432:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790772528.318249:0:22750:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1790772528.318252:0:22750:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1790772528.318260:0:22750:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1790772528.318714:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+12:23488:x1877760506306432:12345-0@lo:253:mount.lustre.0 Request processed in 492us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772528.318723:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790772528.318822:0:23488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506306432:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790772528.318833:0:23488:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1790772528.318836:0:23488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790772528.318838:0:23488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1790772528.318839:0:23488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790772528.318840:0:23488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790772528.318841:0:23488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790772528.318842:0:23488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790772528.318843:0:23488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790772528.318852:0:23488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790772528.318853:0:23488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790772528.318887:0:23488:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ecde1727000 from lustre-MDT0001 10000000:01000000:0.0:1790772528.318920:0:23488:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1790772528.318923:0:23488:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1790772528.318929:0:23488:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ecdfc7f0000 local copy 00010000:00010000:0.0:1790772528.318939:0:23488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8a00/0x418ffb1c3bcc9439 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9440 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772528.319039:0:23488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec52d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506306560:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790772528.319074:0:23488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772528.319110:0:23488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdfaa7ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1790772528.319545:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506306560 00000100:00100000:1.0:1790772528.319550:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506306560 00000100:00100000:1.0:1790772528.319588:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790772528.319597:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+12:23488:x1877760506306560:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790772528.319664:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+12:23488:x1877760506306560:12345-0@lo:501:mount.lustre.0 Request processed in 68us (589us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790772528.319671:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790772528.319751:0:23488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec52d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506306560:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1790772528.319766:0:23488:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1790772528.319784:0:23488:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1790772528.319791:0:23488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8a00/0x418ffb1c3bcc9439 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9440 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772528.319800:0:23488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8a00/0x418ffb1c3bcc9439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9440 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772528.319823:0:23488:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ecde1727000 10000000:01000000:0.0:1790772528.319828:0:23488:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790772528.319832:0:23488:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9ecdfc7f0000 10000000:01000000:0.0:1790772528.319835:0:23488:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1790772528.319839:0:23488:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9ecdfc7f0000 from 1 10000000:01000000:0.0:1790772528.319841:0:23488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1790772528.319865:0:23488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1000/0x418ffb1c3bcc954a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772528.319900:0:23488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1000/0x418ffb1c3bcc954a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772528.319910:0:23488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1000/0x418ffb1c3bcc954a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772528.319924:0:23488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec52d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506306688:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790772528.319953:0:23488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772528.319981:0:23488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdfaa7ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1790772528.320035:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506306688 00000100:00100000:1.0:1790772528.320040:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506306688 00000100:00100000:1.0:1790772528.320069:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790772528.320078:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+12:23488:x1877760506306688:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790772528.320086:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772528.320098:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ecdef3a6e00/0x418ffb1c3bcc9551 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x418ffb1c3bcc954a expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772528.320116:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ecdef3a6e00/0x418ffb1c3bcc9551 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x418ffb1c3bcc954a expref: 13 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772528.320125:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ecdef3a6e00/0x418ffb1c3bcc9551 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc954a expref: 13 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772528.320133:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdef3a6e00, rc 0) 00000100:00100000:1.0:1790772528.320162:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+13:23488:x1877760506306688:12345-0@lo:101:mount.lustre.0 Request processed in 86us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772528.320194:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790772528.320344:0:23488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec52d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506306688:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790772528.320356:0:23488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1000/0x418ffb1c3bcc954a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9551 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772528.320375:0:23488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1000/0x418ffb1c3bcc954a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc9551 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772528.320391:0:23488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1790772528.320681:0:23488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1000/0x418ffb1c3bcc954a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9551 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772528.320690:0:23488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1000/0x418ffb1c3bcc954a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9551 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772528.320697:0:23488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ecde1727000 10000000:01000000:0.0:1790772528.320701:0:23488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1790772528.320705:0:23488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ecde1727000 from 1 10000000:01000000:0.0:1790772528.320707:0:23488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1790772528.320730:0:23488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1600/0x418ffb1c3bcc9558 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772528.320737:0:23488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1600/0x418ffb1c3bcc9558 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772528.320745:0:23488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1600/0x418ffb1c3bcc9558 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772528.320758:0:23488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec52d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506306816:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790772528.320787:0:23488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772528.320805:0:23488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdfaa7ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1790772528.320868:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506306816 00000100:00100000:1.0:1790772528.320873:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506306816 00000100:00100000:1.0:1790772528.320919:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790772528.320926:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+13:23488:x1877760506306816:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790772528.320934:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772528.320943:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ecdef3a6200/0x418ffb1c3bcc955f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x418ffb1c3bcc9558 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772528.320959:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ecdef3a6200/0x418ffb1c3bcc955f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9558 expref: 14 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772528.320967:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ecdef3a6200/0x418ffb1c3bcc955f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9558 expref: 14 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772528.320974:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdef3a6200, rc 0) 00000100:00100000:1.0:1790772528.321013:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+14:23488:x1877760506306816:12345-0@lo:101:mount.lustre.0 Request processed in 87us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772528.321019:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790772528.321091:0:23488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec52d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506306816:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790772528.321102:0:23488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1600/0x418ffb1c3bcc9558 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc955f expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772528.321109:0:23488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1600/0x418ffb1c3bcc9558 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc955f expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772528.321121:0:23488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1790772528.321530:0:23488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1600/0x418ffb1c3bcc9558 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc955f expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772528.321538:0:23488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1600/0x418ffb1c3bcc9558 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc955f expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772528.321545:0:23488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1790772528.321607:0:23488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790772528.321614:0:23488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ecde1727000 10000000:01000000:1.0:1790772528.321617:0:23488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1790772528.321620:0:23488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1790772528.321622:0:23488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1790772528.321639:0:23488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdef3a6800/0x418ffb1c3bcc9566 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772528.321647:0:23488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9ecdef3a6800/0x418ffb1c3bcc9566 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772528.321654:0:23488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9ecdef3a6800/0x418ffb1c3bcc9566 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772528.321676:0:23488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8091880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506306944:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790772528.321707:0:23488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772528.321737:0:23488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecddfac0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790772528.321791:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506306944 00000100:00100000:0.0:1790772528.321797:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506306944 00000100:00100000:0.0:1790772528.321834:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790772528.321840:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+14:23488:x1877760506306944:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790772528.321847:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772528.321855:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eccc1bd0400/0x418ffb1c3bcc956d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x418ffb1c3bcc9566 expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772528.321869:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eccc1bd0400/0x418ffb1c3bcc956d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9566 expref: 15 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772528.321891:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eccc1bd0400/0x418ffb1c3bcc956d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9566 expref: 15 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772528.321898:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eccc1bd0400, rc 0) 00000100:00100000:0.0:1790772528.321935:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+15:23488:x1877760506306944:12345-0@lo:101:mount.lustre.0 Request processed in 95us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772528.321940:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790772528.322009:0:23488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8091880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506306944:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790772528.322021:0:23488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9ecdef3a6800/0x418ffb1c3bcc9566 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc956d expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.322038:0:23488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9ecdef3a6800/0x418ffb1c3bcc9566 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc956d expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790772528.323566:0:23488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:2.0:1790772528.324118:0:23488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790772528.328618:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1790772528.328670:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:2.0:1790772528.328689:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:2.0:1790772528.328704:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:2.0:1790772528.328722:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:2.0:1790772528.328736:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:2.0:1790772528.328751:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:2.0:1790772528.328764:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:2.0:1790772528.328778:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:2.0:1790772528.328792:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:2.0:1790772528.328806:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:2.0:1790772528.328821:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:2.0:1790772528.328836:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:2.0:1790772528.328850:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:2.0:1790772528.328864:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:2.0:1790772528.328890:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:2.0:1790772528.328907:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:2.0:1790772528.328922:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:2.0:1790772528.328937:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:2.0:1790772528.328954:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:2.0:1790772528.328968:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:2.0:1790772528.328983:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:2.0:1790772528.328997:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:2.0:1790772528.329012:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:2.0:1790772528.329026:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:2.0:1790772528.329041:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:2.0:1790772528.329067:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:2.0:1790772528.329081:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:2.0:1790772528.329096:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:2.0:1790772528.329111:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:2.0:1790772528.329125:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:2.0:1790772528.329138:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:2.0:1790772528.329152:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:2.0:1790772528.329580:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:2.0:1790772528.329606:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:2.0:1790772528.329621:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:2.0:1790772528.329635:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:2.0:1790772528.329648:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:2.0:1790772528.329661:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:2.0:1790772528.329674:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:2.0:1790772528.329687:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:2.0:1790772528.329698:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:2.0:1790772528.329710:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:2.0:1790772528.329723:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:2.0:1790772528.329750:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:2.0:1790772528.329757:0:23488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:2.0:1790772528.329853:0:23488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506307072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790772528.329933:0:23488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772528.330019:0:23488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc2625a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790772528.330064:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506307072 00000100:00100000:3.0:1790772528.330072:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506307072 00000100:00100000:3.0:1790772528.330162:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790772528.330197:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+15:23488:x1877760506307072:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790772528.330351:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+15:23488:x1877760506307072:12345-0@lo:501:mount.lustre.0 Request processed in 156us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772528.330360:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790772528.330481:0:23488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506307072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790772528.330513:0:23488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506307200:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790772528.330555:0:23488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772528.330866:0:23488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc2625a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790772528.330942:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506307200 00000100:00100000:0.0:1790772528.330948:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506307200 00000100:00100000:0.0:1790772528.330971:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790772528.330978:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+15:23488:x1877760506307200:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790772528.332253:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+15:23488:x1877760506307200:12345-0@lo:503:mount.lustre.0 Request processed in 1271us (1692us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772528.332263:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790772528.332634:0:23488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506307200:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790772528.333049:0:23488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790772528.333124:0:23488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506307328:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790772528.333199:0:23488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772528.333232:0:23488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc2625600 going to sleep for 11 seconds 00000100:00100000:0.0:1790772528.333540:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506307328 00000100:00100000:0.0:1790772528.333546:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506307328 00000100:00100000:0.0:1790772528.333585:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790772528.333594:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+15:23488:x1877760506307328:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790772528.334625:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+15:23488:x1877760506307328:12345-0@lo:502:mount.lustre.0 Request processed in 1029us (1423us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772528.334641:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790772528.334731:0:23488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506307328:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790772528.334929:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1790772528.334957:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:2.0:1790772528.334970:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:2.0:1790772528.334983:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:2.0:1790772528.334995:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:2.0:1790772528.335007:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:2.0:1790772528.335020:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:2.0:1790772528.335034:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:2.0:1790772528.335046:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:2.0:1790772528.335057:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:2.0:1790772528.335069:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:2.0:1790772528.335081:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:2.0:1790772528.335092:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:2.0:1790772528.335103:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:2.0:1790772528.335114:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:2.0:1790772528.335128:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:2.0:1790772528.335143:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:2.0:1790772528.335157:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:2.0:1790772528.335261:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:2.0:1790772528.335277:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:2.0:1790772528.335291:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:2.0:1790772528.335414:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:2.0:1790772528.335498:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:2.0:1790772528.335514:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:2.0:1790772528.335527:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:2.0:1790772528.335540:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:2.0:1790772528.335551:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:2.0:1790772528.335576:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:2.0:1790772528.335589:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:2.0:1790772528.335603:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:2.0:1790772528.335615:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:2.0:1790772528.335628:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:2.0:1790772528.335644:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:2.0:1790772528.335659:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:2.0:1790772528.335674:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:2.0:1790772528.335689:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:2.0:1790772528.335703:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:2.0:1790772528.335716:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:2.0:1790772528.335730:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:2.0:1790772528.335744:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:2.0:1790772528.335759:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:2.0:1790772528.335772:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:2.0:1790772528.335786:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:2.0:1790772528.335800:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:2.0:1790772528.335834:0:23488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506307456:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790772528.335904:0:23488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772528.335984:0:23488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc2625600 going to sleep for 11 seconds 00000100:00100000:1.0:1790772528.336089:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506307456 00000100:00100000:1.0:1790772528.336096:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506307456 00000100:00100000:3.0:1790772528.336187:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790772528.336197:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+15:23488:x1877760506307456:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790772528.336294:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+15:23488:x1877760506307456:12345-0@lo:502:mount.lustre.0 Request processed in 98us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772528.336301:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790772528.336567:0:23488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506307456:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790772528.336614:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:2.0:1790772528.336623:0:23488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1790772528.337534:0:23492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790772528.337546:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772528.337548:0:23492:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1790772528.337553:0:23492:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1790772528.337556:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790772528.337569:0:23492:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9eccc3743380) 00000020:00000080:2.0:1790772528.337586:0:23492:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1790772528.337592:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1790772528.337664:0:23492:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790772528.337671:0:23492:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x418ffb1c3bcc957b 00000020:00000080:2.0:1790772528.337859:0:23492:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1790772528.337863:0:23492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790772528.337866:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772528.337868:0:23492:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1790772528.337871:0:23492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790772528.337874:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772528.337889:0:23492:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1790772528.337894:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790772528.337901:0:23492:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9eccc3740000) 00000020:00000080:2.0:1790772528.337912:0:23492:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1790772528.337916:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1790772528.337918:0:23492:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1790772528.337920:0:23492:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1790772528.337960:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790772528.338014:0:23492:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ecde1727000 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1790772528.338026:0:23492:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9eccc37419c0) 00000020:00000080:2.0:1790772528.338034:0:23492:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1790772528.338089:0:23492:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1790772528.338095:0:23492:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x418ffb1c3bcc9590 00000020:00000080:2.0:1790772528.338592:0:23492:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1790772528.338599:0:23492:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1790772528.338604:0:23492:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x418ffb1c3bcc9597 00080000:01000000:2.0:1790772528.338610:0:23492:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:2.0:1790772528.338613:0:23492:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x418ffb1c3bcc959e 00010000:00010000:1.0:1790772528.407967:0:23492:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1790772528.408761:0:23492:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:1.0:1790772528.409129:0:23492:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1790772528.410250:0:23492:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1790772528.410263:0:23492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772528.410269:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772528.410271:0:23492:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1790772528.410275:0:23492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790772528.410281:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772528.410282:0:23492:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1790772528.410285:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790772528.410290:0:23492:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.114@tcp to nid 0x20000c0a8ce72 (192.168.206.114@tcp) 00000020:00000080:1.0:1790772528.410331:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790772528.410348:0:23492:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9ecdfa983380) 00000020:00000080:1.0:1790772528.410378:0:23492:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1790772528.410384:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790772528.410690:0:23492:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1790772528.410696:0:23492:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:1.0:1790772528.410703:0:23492:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x418ffb1c3bcc95ac 00010000:00080000:1.0:1790772528.410734:0:23492:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9eccc32cc800@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.114@tcp at head 00010000:00010000:1.0:1790772528.417787:0:23492:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1790772528.420976:0:23492:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1790772528.420990:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1790772528.421037:0:23492:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1790772528.421056:0:23492:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x418ffb1c3bcc95b3 00000100:00080000:1.0:1790772528.421066:0:23492:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790772528.421076:0:23492:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9eccc32cc800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:1.0:1790772528.421108:0:23492:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdf8092a00 x1877760506307584/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790772528.421196:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1877760506307584:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790772528.421261:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772528.421361:0:22762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506307584 00000100:00100000:3.0:1790772528.421377:0:22762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506307584 00000100:00100000:3.0:1790772528.421409:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790772528.421416:0:22762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeec52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1877760506307584:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1790772528.421448:0:22762:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 628 last 0 00000020:00000080:3.0:1790772528.421489:0:22762:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x418ffb1c3bcc95ba 00000004:00100000:3.0:1790772528.421503:0:22762:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1790772528.421508:0:22762:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:1.0:1790772528.421860:0:23492:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1790772528.421938:0:23492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772528.421942:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772528.421944:0:23492:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1790772528.421947:0:23492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790772528.421950:0:23492:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1790772528.421951:0:23492:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790772528.421953:0:23492:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790772528.421954:0:23492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790772528.421956:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772528.421958:0:23492:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790772528.421960:0:23492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790772528.421964:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772528.421965:0:23492:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1790772528.421969:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1790772528.422004:0:23492:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1790772528.422016:0:23492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772528.422020:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772528.422021:0:23492:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1790772528.422024:0:23492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790772528.422025:0:23492:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1790772528.422027:0:23492:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790772528.422028:0:23492:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790772528.422030:0:23492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790772528.422032:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772528.422033:0:23492:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790772528.422035:0:23492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790772528.422044:0:23492:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1790772528.422048:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772528.422049:0:23492:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1790772528.422052:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790772528.422056:0:23492:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.114@tcp to nid 0x20000c0a8ce72 (192.168.206.114@tcp) 00000020:01000000:1.0:1790772528.422074:0:23492:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1790772528.422076:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790772528.422089:0:23492:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9ecdfa9819c0) 00000020:00000080:1.0:1790772528.422101:0:23492:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1790772528.422105:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790772528.422156:0:23492:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1790772528.422162:0:23492:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:1.0:1790772528.422185:0:23492:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x418ffb1c3bcc95c8 00010000:00080000:1.0:1790772528.422211:0:23492:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9eccc3cac800@lustre-OST0000-osc-MDT0001: add connection 192.168.206.114@tcp at head 00010000:00010000:1.0:1790772528.422606:0:23492:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:3.0:1790772528.423107:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1790772528.423120:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1790772528.423123:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ecdd1145800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790772528.423129:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 625 00000100:00080000:3.0:1790772528.423132:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1790772528.423140:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ecdd1145800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:3.0:1790772528.423184:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdc12ac000 x1877760506307712/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000040:01000000:2.0:1790772528.424833:0:23492:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790772528.425131:0:23492:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1790772528.425572:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506307712:0@lo:38:kworker.0 00000100:00100000:0.0:1790772528.425640:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772528.426729:0:22761:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1790772528.426741:0:22761:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1790772528.427569:0:22761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506307712 00000100:00100000:2.0:1790772528.427580:0:22761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506307712 00000100:00100000:2.0:1790772528.427690:0:23497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790772528.427697:0:23497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeec50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3642:x1877760506307712:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1790772528.427801:0:23497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeec50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3642:x1877760506307712:12345-0@lo:38:kworker.0 Request processed in 103us (2159us total) trans 0 rc -11/-11 00000100:00100000:2.0:1790772528.427813:0:23497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790772528.428650:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790772528.428660:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ecdd1145800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790772528.428665:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1790772528.428669:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506307712:0@lo:38:kworker.0 00000040:00080000:1.0:1790772528.430007:0:23492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:3.0:1790772528.430279:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790772528.430285:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790772528.430287:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790772528.430290:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790772528.430627:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1877760506307840:0@lo:400:kworker.0 00000100:00100000:1.0:1790772528.430694:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772528.430764:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506307840 00000100:00100000:1.0:1790772528.430850:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506307840 00000100:00100000:1.0:1790772528.430909:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790772528.430919:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf8091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1877760506307840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772528.430974:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf8091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1877760506307840:12345-0@lo:400:kworker.0 Request processed in 57us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772528.430981:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1790772528.431021:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ecdc12ace00 x1877760506307840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772528.431049:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1877760506307840:0@lo:400:kworker.0 00000040:00080000:1.0:1790772528.431924:0:23492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1790772528.432096:0:23492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1790772528.435746:0:23498:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1790772528.435754:0:23498:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00080000:0.0:1790772528.436445:0:22762:0:(import.c:65:import_set_state_nolock()) ffff9ecde10bc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790772528.436549:0:22762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeec52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1877760506307584:12345-0@lo:38:llog_process_th.0 Request processed in 15131us (15285us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772528.436560:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790772528.436606:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790772528.436614:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1790772528.436623:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1790772528.436627:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790772528.436629:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9eccc32cc800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790772528.436639:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1877760506307584:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790772528.437119:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790772528.437132:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1877760506307968:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790772528.437206:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1790772528.437918:0:23492:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790772528.437932:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790772528.437978:0:23492:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1790772528.437998:0:23492:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x418ffb1c3bcc95cf 00000100:00080000:3.0:1790772528.438005:0:23492:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790772528.438014:0:23492:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9eccc3cac800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:3.0:1790772528.438036:0:23492:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdc12af480 x1877760506308096/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790772528.438062:0:23492:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1790772528.438088:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790772528.438092:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790772528.438104:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790772528.438107:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1790772528.438149:0:23492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790772528.438152:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772528.438154:0:23492:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1790772528.438157:0:23492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790772528.438160:0:23492:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1790772528.438161:0:23492:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790772528.438163:0:23492:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790772528.438188:0:23492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790772528.438192:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772528.438193:0:23492:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790772528.438196:0:23492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790772528.438200:0:23492:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1790772528.438204:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772528.438206:0:23492:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1790772528.438208:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790772528.438212:0:23492:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.114@tcp to nid 0x20000c0a8ce72 (192.168.206.114@tcp) 00000020:01000000:3.0:1790772528.438232:0:23492:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1790772528.438235:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790772528.438246:0:23492:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9ecdfa9fcd40) 00000020:00000080:3.0:1790772528.438258:0:23492:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1790772528.438263:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790772528.438317:0:23492:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1790772528.438324:0:23492:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:3.0:1790772528.438329:0:23492:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x418ffb1c3bcc95dd 00010000:00080000:3.0:1790772528.438353:0:23492:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ecdf8089800@lustre-OST0001-osc-MDT0001: add connection 192.168.206.114@tcp at head 00000100:00100000:1.0:1790772528.438803:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1877760506308096:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1790772528.438847:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877760506308096 offset 0 length 520: 4 00010000:00010000:3.0:1790772528.439141:0:23492:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1790772528.439250:0:23492:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1790772528.439266:0:23492:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1790772528.440336:0:22761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506307968 00000100:00100000:0.0:1790772528.440347:0:22761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506307968 00000100:00100000:0.0:1790772528.440903:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790772528.440915:0:22761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc12afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1877760506307968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790772528.440952:0:22761:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1790772528.441083:0:22761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc12afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1877760506307968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 171us (3877us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772528.441091:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790772528.442100:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1877760506307968:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1790772528.443607:0:23492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790772528.444639:0:23492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1790772528.444888:0:23492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:0.0:1790772528.446222:0:23500:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1790772528.446228:0:23500:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1790772528.447288:0:23492:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790772528.447301:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790772528.447574:0:23492:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1790772528.447597:0:23492:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x418ffb1c3bcc95e4 00000100:00080000:3.0:1790772528.447606:0:23492:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790772528.447617:0:23492:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ecdf8089800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:3.0:1790772528.447650:0:23492:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdc12aed80 x1877760506308224/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790772528.447718:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1877760506308224:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1790772528.447842:0:23492:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000400:00000100:1.0:1790772528.447915:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877760506308224 offset 0 length 520: 4 00000100:00080000:3.0:1790772528.448002:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790772528.448007:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790772528.448009:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790772528.448012:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1790772528.448053:0:23492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790772528.448058:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772528.448060:0:23492:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1790772528.448063:0:23492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790772528.448066:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772528.448068:0:23492:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790772528.448071:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790772528.448072:0:23492:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790772528.448074:0:23492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790772528.448077:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772528.448078:0:23492:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1790772528.448080:0:23492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790772528.448083:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772528.448084:0:23492:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790772528.448088:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1790772528.448127:0:23492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790772528.448130:0:23492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772528.448131:0:23492:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790772528.448134:0:23492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:2.0:1790772528.448334:0:23488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1790772528.448374:0:23488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1790772528.448394:0:23488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdef3a6800/0x418ffb1c3bcc9566 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc956d expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.448405:0:23488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9ecdef3a6800/0x418ffb1c3bcc9566 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc956d expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772528.448413:0:23488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ecde1727000 from 1 10000000:01000000:2.0:1790772528.448416:0:23488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790772528.448453:0:23488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9200/0x418ffb1c3bcc95eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.448461:0:23488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9200/0x418ffb1c3bcc95eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.448472:0:23488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9200/0x418ffb1c3bcc95eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772528.448488:0:23488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506308352:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790772528.448530:0:23488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772528.448551:0:23488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc73a09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790772528.448662:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506308352 00000100:00100000:3.0:1790772528.448669:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506308352 00000100:00100000:3.0:1790772528.448700:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790772528.448708:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+15:23488:x1877760506308352:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790772528.448720:0:22749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772528.448733:0:22749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ecdfbab0e00/0x418ffb1c3bcc95f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x418ffb1c3bcc95eb expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772528.448754:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ecdfbab0e00/0x418ffb1c3bcc95f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x418ffb1c3bcc95eb expref: 16 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772528.448765:0:22749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ecdfbab0e00/0x418ffb1c3bcc95f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc95eb expref: 16 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772528.448784:0:22749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdfbab0e00, rc 0) 00000100:00100000:3.0:1790772528.448828:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+16:23488:x1877760506308352:12345-0@lo:101:mount.lustre.0 Request processed in 121us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772528.448835:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790772528.449081:0:23488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506308352:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790772528.449096:0:23488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9200/0x418ffb1c3bcc95eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc95f2 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.449116:0:23488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9200/0x418ffb1c3bcc95eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc95f2 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772528.450027:0:23488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506308480:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1790772528.450123:0:23488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772528.450286:0:23488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc73a09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772528.451696:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506308480 00000100:00100000:1.0:1790772528.451706:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506308480 00000100:00100000:1.0:1790772528.451776:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790772528.451787:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+16:23488:x1877760506308480:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1790772528.451811:0:22750:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1790772528.451831:0:22750:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1790772528.451835:0:22750:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1790772528.452081:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+16:23488:x1877760506308480:12345-0@lo:256:mount.lustre.0 Request processed in 297us (1958us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772528.452089:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790772528.452217:0:23488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506308480:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1790772528.453096:0:23488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790772528.453118:0:23488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9200/0x418ffb1c3bcc95eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc95f2 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772528.453129:0:23488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9200/0x418ffb1c3bcc95eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc95f2 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772528.453137:0:23488:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ecde1727000 from 1 10000000:01000000:0.0:1790772528.453140:0:23488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790772528.453195:0:23488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1c00/0x418ffb1c3bcc95f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772528.453203:0:23488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1c00/0x418ffb1c3bcc95f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772528.453211:0:23488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1c00/0x418ffb1c3bcc95f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772528.453227:0:23488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec51500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506308608:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790772528.453266:0:23488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772528.453293:0:23488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc9c73300 going to sleep for 11 seconds 00000100:00100000:2.0:1790772528.453568:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506308608 00000100:00100000:2.0:1790772528.453575:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506308608 00000100:00100000:2.0:1790772528.453622:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790772528.453630:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+16:23488:x1877760506308608:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790772528.453641:0:22749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772528.453654:0:22749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ecdf4bd8e00/0x418ffb1c3bcc9600 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x418ffb1c3bcc95f9 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.453673:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ecdf4bd8e00/0x418ffb1c3bcc9600 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x418ffb1c3bcc95f9 expref: 17 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.453684:0:22749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ecdf4bd8e00/0x418ffb1c3bcc9600 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc95f9 expref: 17 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.453692:0:22749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdf4bd8e00, rc 0) 00000100:00100000:2.0:1790772528.453731:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+17:23488:x1877760506308608:12345-0@lo:101:mount.lustre.0 Request processed in 101us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772528.453737:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790772528.453967:0:23488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec51500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506308608:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790772528.453994:0:23488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1c00/0x418ffb1c3bcc95f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9600 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772528.454003:0:23488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1c00/0x418ffb1c3bcc95f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc9600 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790772528.455287:0:23488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:0.0:1790772528.455699:0:23488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790772528.456089:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1790772528.456111:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:0.0:1790772528.456124:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:0.0:1790772528.456135:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:0.0:1790772528.456160:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:0.0:1790772528.456511:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:0.0:1790772528.456528:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:0.0:1790772528.456541:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:0.0:1790772528.456554:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1790772528.456565:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:0.0:1790772528.456578:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:0.0:1790772528.456598:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:0.0:1790772528.456604:0:23488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:0.0:1790772528.456675:0:23488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec51500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506308736:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790772528.456732:0:23488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772528.456913:0:23488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc9c73780 going to sleep for 11 seconds 00000100:00100000:2.0:1790772528.456958:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506308736 00000100:00100000:2.0:1790772528.456966:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506308736 00000100:00100000:2.0:1790772528.457057:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790772528.457076:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+17:23488:x1877760506308736:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790772528.457219:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+17:23488:x1877760506308736:12345-0@lo:501:mount.lustre.0 Request processed in 145us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772528.457227:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790772528.457309:0:23488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec51500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506308736:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790772528.457353:0:23488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec51500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506308864:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790772528.457405:0:23488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772528.457935:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506308864 00000100:00100000:1.0:1790772528.457941:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506308864 00000100:00100000:1.0:1790772528.457969:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790772528.457975:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+17:23488:x1877760506308864:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790772528.458068:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+17:23488:x1877760506308864:12345-0@lo:503:mount.lustre.0 Request processed in 92us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772528.458082:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790772528.458355:0:23488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc9c73780 going to sleep for 11 seconds 00000100:00100000:1.0:1790772528.458383:0:23488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec51500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506308864:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790772528.459073:0:23488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790772528.459155:0:23488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8093100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506308992:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790772528.459248:0:23488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772528.459279:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506308992 00000100:00100000:1.0:1790772528.459284:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506308992 00000100:00100000:1.0:1790772528.459320:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790772528.459328:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+17:23488:x1877760506308992:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790772528.459565:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+17:23488:x1877760506308992:12345-0@lo:502:mount.lustre.0 Request processed in 238us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772528.459572:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790772528.459615:0:23488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc30f1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790772528.459630:0:23488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8093100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506308992:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790772528.459868:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1790772528.459906:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:1.0:1790772528.459921:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:1.0:1790772528.459935:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:1.0:1790772528.459947:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:1.0:1790772528.459959:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:1.0:1790772528.459971:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:1.0:1790772528.459983:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:1.0:1790772528.459995:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1790772528.460008:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:1.0:1790772528.460022:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:1.0:1790772528.460044:0:23488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8093100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506309120:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790772528.460081:0:23488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772528.460105:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506309120 00000100:00100000:1.0:1790772528.460109:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506309120 00000100:00100000:1.0:1790772528.460128:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790772528.460133:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+17:23488:x1877760506309120:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790772528.460225:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+17:23488:x1877760506309120:12345-0@lo:502:mount.lustre.0 Request processed in 91us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772528.460231:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790772528.460258:0:23488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc30f1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790772528.460270:0:23488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8093100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506309120:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790772528.460301:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:1.0:1790772528.460324:0:23488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1790772528.461572:0:23502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790772528.461583:0:23502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772528.461586:0:23502:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790772528.461594:0:23502:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ecde1727000 00000020:00000080:2.0:1790772528.461596:0:23502:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790772528.461605:0:23502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790772528.461607:0:23502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772528.461608:0:23502:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1790772528.461611:0:23502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790772528.461613:0:23502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772528.461614:0:23502:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790772528.461617:0:23502:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ecde1727000 00000020:00000080:2.0:1790772528.461619:0:23502:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790772528.461680:0:23502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790772528.461684:0:23502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772528.461686:0:23502:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1790772528.461688:0:23502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790772528.461691:0:23502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772528.461692:0:23502:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790772528.461696:0:23502:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ecde1727000 00000020:00000080:2.0:1790772528.461698:0:23502:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790772528.461734:0:23502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790772528.461737:0:23502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772528.461739:0:23502:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790772528.461742:0:23502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790772528.461744:0:23502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772528.461745:0:23502:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1790772528.461749:0:23502:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ecde1727000 00000020:00000080:2.0:1790772528.461756:0:23502:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790772528.461957:0:23502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790772528.461961:0:23502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772528.461962:0:23502:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1790772528.461965:0:23502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:1.0:1790772528.463579:0:23488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1790772528.463618:0:23488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790772528.463646:0:23488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1c00/0x418ffb1c3bcc95f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9600 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772528.463660:0:23488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1c00/0x418ffb1c3bcc95f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9600 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772528.463711:0:23488:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790772528.463714:0:23488:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ecde1727000 10000000:01000000:1.0:1790772528.463716:0:23488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ecde1727000 10000000:01000000:1.0:1790772528.463720:0:23488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790772528.463726:0:23488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ecde1727000 from 1 10000000:01000000:1.0:1790772528.463729:0:23488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790772528.463761:0:23488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdef3a7600/0x418ffb1c3bcc9607 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772528.463796:0:23488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9ecdef3a7600/0x418ffb1c3bcc9607 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772528.463809:0:23488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9ecdef3a7600/0x418ffb1c3bcc9607 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772528.463832:0:23488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8093100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506309248:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790772528.463903:0:23488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772528.463946:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506309248 00000100:00100000:1.0:1790772528.463953:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506309248 00000100:00100000:1.0:1790772528.463991:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790772528.463999:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+17:23488:x1877760506309248:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790772528.464010:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772528.464021:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ecdef3a6a00/0x418ffb1c3bcc960e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x418ffb1c3bcc9607 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772528.464040:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ecdef3a6a00/0x418ffb1c3bcc960e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9607 expref: 18 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772528.464049:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ecdef3a6a00/0x418ffb1c3bcc960e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9607 expref: 18 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772528.464055:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdef3a6a00, rc 0) 00000100:00100000:1.0:1790772528.464086:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+18:23488:x1877760506309248:12345-0@lo:101:mount.lustre.0 Request processed in 87us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772528.464092:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790772528.464141:0:23488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc30f1900 going to sleep for 11 seconds 00000100:00100000:1.0:1790772528.464190:0:23488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8093100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506309248:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790772528.464206:0:23488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9ecdef3a7600/0x418ffb1c3bcc9607 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc960e expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772528.464215:0:23488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9ecdef3a7600/0x418ffb1c3bcc9607 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc960e expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790772528.469811:0:23488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:1.0:1790772528.470108:0:23488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790772528.470340:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:1.0:1790772528.470374:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:1.0:1790772528.470391:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:1.0:1790772528.470404:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:1.0:1790772528.470418:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:1.0:1790772528.470903:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:1.0:1790772528.470923:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:1.0:1790772528.470936:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:1.0:1790772528.470958:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:1.0:1790772528.470990:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:1.0:1790772528.471007:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:1.0:1790772528.471022:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:1.0:1790772528.471034:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:1.0:1790772528.471047:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:1.0:1790772528.471060:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:1.0:1790772528.471071:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:1.0:1790772528.471082:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:1.0:1790772528.471094:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:1.0:1790772528.471106:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:1.0:1790772528.471119:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:1.0:1790772528.471130:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:1.0:1790772528.471143:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:1.0:1790772528.471195:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:1.0:1790772528.471213:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:1.0:1790772528.471228:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:1.0:1790772528.471255:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:1.0:1790772528.471272:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:1.0:1790772528.471286:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:1.0:1790772528.471489:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:1.0:1790772528.471517:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:1.0:1790772528.471534:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:1.0:1790772528.471548:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:1.0:1790772528.471564:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:1.0:1790772528.471578:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:1.0:1790772528.471591:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:1.0:1790772528.471606:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:1.0:1790772528.471620:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:1.0:1790772528.471634:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:1.0:1790772528.471649:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:1.0:1790772528.471661:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:1.0:1790772528.471673:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:1.0:1790772528.471699:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:1.0:1790772528.471712:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:1.0:1790772528.471724:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:1.0:1790772528.471735:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:1.0:1790772528.471747:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:1.0:1790772528.471759:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:1.0:1790772528.472559:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:1.0:1790772528.472700:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:1.0:1790772528.472718:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:1.0:1790772528.472732:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:1.0:1790772528.472736:0:23488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:1.0:1790772528.473970:0:23488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8093100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506309376:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790772528.474037:0:23488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772528.474103:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506309376 00000100:00100000:1.0:1790772528.474110:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506309376 00000100:00100000:3.0:1790772528.477915:0:23488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc30f1180 going to sleep for 11 seconds 00000100:00100000:1.0:1790772528.478274:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790772528.478290:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+18:23488:x1877760506309376:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790772528.481918:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+18:23488:x1877760506309376:12345-0@lo:501:mount.lustre.0 Request processed in 3625us (7871us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772528.481932:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790772528.486740:0:23488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8093100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506309376:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790772528.487113:0:23488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506309504:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790772528.492576:0:23488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772528.492633:0:23488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc3566780 going to sleep for 11 seconds 00000100:00100000:0.0:1790772528.492918:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506309504 00000100:00100000:0.0:1790772528.492927:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506309504 00000100:00100000:0.0:1790772528.493212:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790772528.493223:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+18:23488:x1877760506309504:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790772528.493622:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+18:23488:x1877760506309504:12345-0@lo:503:mount.lustre.0 Request processed in 400us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772528.493630:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790772528.493890:0:23488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506309504:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790772528.494554:0:23488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790772528.494628:0:23488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506309632:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790772528.494676:0:23488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772528.494713:0:23488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc3566780 going to sleep for 11 seconds 00000100:00100000:1.0:1790772528.495891:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506309632 00000100:00100000:1.0:1790772528.495902:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506309632 00000100:00100000:1.0:1790772528.495954:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790772528.495963:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+18:23488:x1877760506309632:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790772528.496104:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+18:23488:x1877760506309632:12345-0@lo:502:mount.lustre.0 Request processed in 141us (1427us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772528.496112:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790772528.497052:0:23488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506309632:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790772528.497951:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1790772528.497991:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:3.0:1790772528.498009:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:3.0:1790772528.498023:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:3.0:1790772528.498037:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:3.0:1790772528.498048:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:3.0:1790772528.498059:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:3.0:1790772528.498069:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:3.0:1790772528.498080:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:3.0:1790772528.498093:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:3.0:1790772528.498105:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:3.0:1790772528.498115:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:3.0:1790772528.498125:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:3.0:1790772528.498149:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:3.0:1790772528.498162:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:3.0:1790772528.498192:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:3.0:1790772528.498205:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:3.0:1790772528.498216:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:3.0:1790772528.498227:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:3.0:1790772528.498239:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:3.0:1790772528.498251:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:3.0:1790772528.498265:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:3.0:1790772528.498277:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:3.0:1790772528.498291:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:3.0:1790772528.499502:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:3.0:1790772528.499561:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:3.0:1790772528.499577:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:3.0:1790772528.499590:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:3.0:1790772528.499604:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:3.0:1790772528.499630:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:3.0:1790772528.499646:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:3.0:1790772528.499660:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:3.0:1790772528.499673:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:3.0:1790772528.499686:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:3.0:1790772528.499699:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:3.0:1790772528.499712:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:3.0:1790772528.499726:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:3.0:1790772528.499738:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:3.0:1790772528.499750:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:3.0:1790772528.499761:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:3.0:1790772528.501612:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:3.0:1790772528.501638:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:3.0:1790772528.501653:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:3.0:1790772528.501666:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:3.0:1790772528.501681:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:3.0:1790772528.501708:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:3.0:1790772528.501724:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:3.0:1790772528.501737:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:3.0:1790772528.502643:0:23488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506309760:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790772528.502718:0:23488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772528.502759:0:23488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc3566780 going to sleep for 11 seconds 00000100:00100000:0.0:1790772528.502931:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506309760 00000100:00100000:0.0:1790772528.502939:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506309760 00000100:00100000:0.0:1790772528.503055:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790772528.503065:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+18:23488:x1877760506309760:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790772528.503198:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+18:23488:x1877760506309760:12345-0@lo:502:mount.lustre.0 Request processed in 134us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772528.503205:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790772528.503293:0:23488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506309760:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790772528.503486:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:3.0:1790772528.503508:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:3.0:1790772528.503532:0:23488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506309888:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790772528.503572:0:23488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772528.504079:0:23488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc3566780 going to sleep for 11 seconds 00000100:00100000:1.0:1790772528.504138:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506309888 00000100:00100000:1.0:1790772528.504144:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506309888 00000100:00100000:1.0:1790772528.504198:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790772528.504206:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+18:23488:x1877760506309888:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790772528.504289:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+18:23488:x1877760506309888:12345-0@lo:502:mount.lustre.0 Request processed in 84us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772528.504296:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790772528.504417:0:23488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506309888:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790772528.504475:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:3.0:1790772528.504484:0:23488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1790772528.507379:0:23507:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1790772528.507395:0:23507:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9ecdfa984d40) 00000020:00000080:1.0:1790772528.507417:0:23507:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1790772528.507739:0:23507:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ecde1727000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1790772528.507744:0:23507:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ecde1727000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1790772528.507747:0:23507:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ecde1727000 3 00010000:00080000:1.0:1790772528.507788:0:23507:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9eccc307d000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.114@tcp at head 00010000:00010000:1.0:1790772528.509808:0:23507:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1790772528.510306:0:23507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1790772528.510341:0:23507:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790772528.510351:0:23507:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x418ffb1c3bcc961c 00000100:00080000:1.0:1790772528.510369:0:23507:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790772528.510378:0:23507:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9eccc307d000 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:1.0:1790772528.510409:0:23507:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdf8093b80 x1877760506310016/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790772528.510573:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877760506310016:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790772528.510646:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772528.510702:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506310016 00000100:00100000:1.0:1790772528.510709:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506310016 00000100:00100000:1.0:1790772528.510735:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790772528.510742:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf8090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1877760506310016:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1790772528.510762:0:22757:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 628 last 0 00000020:00000080:1.0:1790772528.510860:0:22757:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x418ffb1c3bcc9623 00000004:00100000:1.0:1790772528.510873:0:22757:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790772528.510910:0:22757:0:(import.c:65:import_set_state_nolock()) ffff9eccc32cf000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790772528.510955:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf8090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877760506310016:12345-0@lo:38:llog_process_th.0 Request processed in 212us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772528.510962:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1790772528.510996:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ecdf8093b80 x1877760506310016/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790772538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772528.511006:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790772528.511012:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1790772528.511217:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1790772528.511220:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790772528.511223:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9eccc307d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790772528.511229:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877760506310016:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1790772528.511246:0:23507:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790772528.511412:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790772528.511417:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790772528.511420:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790772528.511431:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1790772528.513044:0:23507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:3.0:1790772528.513160:0:23488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1790772528.513206:0:23488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790772528.513222:0:23488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdef3a7600/0x418ffb1c3bcc9607 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc960e expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772528.513234:0:23488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9ecdef3a7600/0x418ffb1c3bcc9607 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc960e expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790772528.513277:0:23488:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790772528.513279:0:23488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1790772528.513280:0:23488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790772528.513281:0:23488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790772528.513282:0:23488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790772528.513284:0:23488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790772528.513285:0:23488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790772528.513287:0:23488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790772528.513288:0:23488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790772528.513292:0:23488:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1790772528.513294:0:23488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790772528.513295:0:23488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1790772528.513299:0:23488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790772528.513300:0:23488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790772528.513301:0:23488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790772528.513302:0:23488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790772528.513303:0:23488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790772528.513304:0:23488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790772528.513305:0:23488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790772528.513334:0:23488:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1790772528.513349:0:23488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506310144:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790772528.513563:0:23488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772528.513593:0:23488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc3566300 going to sleep for 11 seconds 00000100:00100000:1.0:1790772528.514520:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506310144 00000100:00100000:1.0:1790772528.514530:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506310144 00000100:00100000:1.0:1790772528.514579:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790772528.514587:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+18:23488:x1877760506310144:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790772528.514613:0:22751:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1790772528.514625:0:22751:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1790772528.517269:0:22736:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1790772528.517303:0:22751:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790772528.517313:0:22751:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1790772528.517626:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+18:23488:x1877760506310144:12345-0@lo:253:mount.lustre.0 Request processed in 3037us (4059us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772528.517638:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 20000000:01000000:2.0:1790772528.517726:0:22772:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790772528.517731:0:22772:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790772528.517750:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ecdf4bd9400/0x418ffb1c3bcc962a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.518564:0:22772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ecdef3a7400/0x418ffb1c3bcc952e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9527 expref: 17 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.518580:0:22772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ecdfbab0e00/0x418ffb1c3bcc95f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc95eb expref: 17 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.518589:0:22772:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ecdf4bd9400/0x418ffb1c3bcc962a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.518625:0:22772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ecdfbab0e00/0x418ffb1c3bcc95f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x418ffb1c3bcc95eb expref: 17 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.518640:0:22772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ecdfbab0e00/0x418ffb1c3bcc95f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x418ffb1c3bcc95eb expref: 17 pid: 22749 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772528.518654:0:22772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e5f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22772:1877760506310272:0@lo:104: 00000100:00100000:2.0:1790772528.518691:0:22772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790772528.518726:0:22772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ecdef3a7400/0x418ffb1c3bcc952e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x418ffb1c3bcc9527 expref: 17 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.518734:0:22772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ecdef3a7400/0x418ffb1c3bcc952e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x418ffb1c3bcc9527 expref: 17 pid: 22750 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772528.518754:0:22772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22772:1877760506310400:0@lo:104: 00000100:00100000:2.0:1790772528.518933:0:22772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772528.518951:0:22772:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc1254840 going to sleep for 11 seconds 00000100:00100000:2.0:1790772528.518984:0:22740:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506310272 00000100:00100000:2.0:1790772528.518991:0:22740:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506310272 00000100:00100000:2.0:1790772528.519029:0:22740:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506310400 00000100:00100000:2.0:1790772528.519032:0:22740:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506310400 00000100:00100000:2.0:1790772528.519046:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790772528.519053:0:22740:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf62e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+4:22772:x1877760506310272:12345-0@lo:104: 00010000:00010000:2.0:1790772528.519065:0:22740:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9200/0x418ffb1c3bcc95eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x418ffb1c3bcc95f2 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.519105:0:22740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790772528.519110:0:22740:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf62e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+4:22772:x1877760506310272:12345-0@lo:104: Request processed in 57us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772528.519115:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790772528.519129:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790772528.519134:0:22740:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf62e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+3:22772:x1877760506310400:12345-0@lo:104: 00010000:00010000:2.0:1790772528.519140:0:22740:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8200/0x418ffb1c3bcc9527 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x418ffb1c3bcc952e expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.519180:0:22740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790772528.519185:0:22740:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf62e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+3:22772:x1877760506310400:12345-0@lo:104: Request processed in 51us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772528.519191:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1790772528.519206:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790772528.519211:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9200/0x418ffb1c3bcc95eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x418ffb1c3bcc95f2 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.519224:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf4bd9200 already unused, calling callback (ffffffffc11ffc20) 10000000:00010000:2.0:1790772528.519228:0:22744:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9200/0x418ffb1c3bcc95eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x418ffb1c3bcc95f2 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.519237:0:22744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9200/0x418ffb1c3bcc95eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x418ffb1c3bcc95f2 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772528.519244:0:22744:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9200/0x418ffb1c3bcc95eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x418ffb1c3bcc95f2 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772528.519250:0:22744:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790772528.519274:0:22744:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9200/0x418ffb1c3bcc95eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc95f2 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.519280:0:22744:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790772528.519295:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9200/0x418ffb1c3bcc95eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc95f2 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.519314:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9200/0x418ffb1c3bcc95eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc95f2 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.519327:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772528.519330:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8200/0x418ffb1c3bcc9527 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x418ffb1c3bcc952e expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.519335:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf4bd8200 already unused, calling callback (ffffffffc11ffc20) 10000000:00010000:2.0:1790772528.519338:0:22744:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8200/0x418ffb1c3bcc9527 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x418ffb1c3bcc952e expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.519355:0:22744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8200/0x418ffb1c3bcc9527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x418ffb1c3bcc952e expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772528.519372:0:22744:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8200/0x418ffb1c3bcc9527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x418ffb1c3bcc952e expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772528.519377:0:22744:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790772528.519390:0:22744:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8200/0x418ffb1c3bcc9527 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc952e expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.519395:0:22744:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790772528.519410:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8200/0x418ffb1c3bcc9527 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc952e expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.519417:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8200/0x418ffb1c3bcc9527 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc952e expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772528.519587:0:23488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:23488:1877760506310144:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790772528.519599:0:23488:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1790772528.519602:0:23488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790772528.519603:0:23488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1790772528.519605:0:23488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790772528.519606:0:23488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790772528.519607:0:23488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790772528.519609:0:23488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790772528.519610:0:23488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790772528.519612:0:23488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790772528.519613:0:23488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790772528.519625:0:23488:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1790772528.520556:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772528.520560:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772528.520562:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772528.520584:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3646:1877760506310528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790772528.520628:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772528.520678:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3643:1877760506310656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790772528.520700:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772528.520736:0:22742:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506310528 00000100:00100000:2.0:1790772528.520742:0:22742:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506310528 00010000:00010000:2.0:1790772528.520763:0:22742:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ecdfbab0e00/0x418ffb1c3bcc95f2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x418ffb1c3bcc95eb expref: 18 pid: 22749 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772528.521345:0:22742:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506310656 00000100:00100000:2.0:1790772528.521349:0:22742:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506310656 00010000:00010000:2.0:1790772528.521368:0:22742:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ecdef3a7400/0x418ffb1c3bcc952e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x418ffb1c3bcc9527 expref: 19 pid: 22750 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772528.521380:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790772528.521386:0:22742:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf62e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+19:3646:x1877760506310528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790772528.521397:0:22742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772528.521401:0:22742:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ecdfbab0e00/0x418ffb1c3bcc95f2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x418ffb1c3bcc95eb expref: 19 pid: 22749 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.521412:0:22742:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ecdfbab0e00/0x418ffb1c3bcc95f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x418ffb1c3bcc95eb expref: 19 pid: 22749 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.521764:0:22742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772528.521896:0:22742:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf62e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+19:3646:x1877760506310528:12345-0@lo:103:ldlm_bl.0 Request processed in 509us (1267us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772528.521905:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790772528.521924:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790772528.521931:0:22742:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf62e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+18:3643:x1877760506310656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790772528.521940:0:22742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772528.521945:0:22742:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ecdef3a7400/0x418ffb1c3bcc952e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x418ffb1c3bcc9527 expref: 18 pid: 22750 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.521954:0:22742:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ecdef3a7400/0x418ffb1c3bcc952e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x418ffb1c3bcc9527 expref: 18 pid: 22750 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772528.522253:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3646:1877760506310528:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790772528.523128:0:22742:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ecdf4bd9400/0x418ffb1c3bcc962a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.523149:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ecdf4bd9400/0x418ffb1c3bcc962a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790772528.523188:0:22742:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009740906s 00010000:00010000:2.0:1790772528.523194:0:22742:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ecdf4bd9400/0x418ffb1c3bcc962a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.523201:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ecdf4bd9400/0x418ffb1c3bcc962a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.523208:0:22742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ecdf4bd9400/0x418ffb1c3bcc962a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.523215:0:22742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ecdf4bd9400/0x418ffb1c3bcc962a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.523221:0:22742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf4bd9400 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:2.0:1790772528.523225:0:22742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ecdf4bd9400/0x418ffb1c3bcc962a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.523233:0:22742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ecdf4bd9400/0x418ffb1c3bcc962a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.523242:0:22742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ecdf4bd9400/0x418ffb1c3bcc962a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.523252:0:22742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772528.523316:0:22742:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf62e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+18:3643:x1877760506310656:12345-0@lo:103:ldlm_bl.0 Request processed in 1374us (2603us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772528.523324:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790772528.523387:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3643:1877760506310656:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790772528.523417:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ecdfbab0e00/0x418ffb1c3bcc95f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x418ffb1c3bcc95eb expref: 17 pid: 22749 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772528.523606:0:22772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e5f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22772:1877760506310272:0@lo:104: 00010000:00010000:2.0:1790772528.523622:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ecdef3a7400/0x418ffb1c3bcc952e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x418ffb1c3bcc9527 expref: 16 pid: 22750 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772528.523635:0:22772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22772:1877760506310400:0@lo:104: 00010000:00010000:2.0:1790772528.523648:0:22772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ecdf4bd9400/0x418ffb1c3bcc962a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.523655:0:22772:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ecdf4bd9400/0x418ffb1c3bcc962a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.523661:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ecdf4bd9400/0x418ffb1c3bcc962a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772528.523668:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ecdf4bd9400/0x418ffb1c3bcc962a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772528.524150:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1790772528.539727:0:23488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1790772528.539940:0:23512:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1790772528.539944:0:23512:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1790772528.540088:0:23513:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1790772528.540490:0:23513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790772528.542748:0:23513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1790772528.542814:0:23513:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:01000000:1.0:1790772528.544003:0:23488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1790772528.544800:0:23515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec53100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23515:1877760506310784:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1790772528.544857:0:23515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772528.544898:0:23515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdef0fab40 going to sleep for 11 seconds 00000040:01000000:1.0:1790772528.545080:0:23488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1790772528.545108:0:23488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1790772528.545656:0:23488:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1790772528.545665:0:23488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1790772528.545704:0:23488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790772528.546467:0:22762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506310784 00000100:00100000:2.0:1790772528.546475:0:22762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506310784 00000100:00100000:2.0:1790772528.546521:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790772528.546529:0:22762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeec53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23515:x1877760506310784:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1790772528.546626:0:22762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeec53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23515:x1877760506310784:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 98us (1768us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772528.546634:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000040:00080000:1.0:1790772528.547702:0:23488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:0.0:1790772528.547922:0:23515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec53100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23515:1877760506310784:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1790772528.547957:0:23515:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1790772528.547998:0:23515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec53100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23515:1877760506310912:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1790772528.548048:0:23515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772528.548081:0:23515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdef0fab40 going to sleep for 11 seconds 00000100:00100000:2.0:1790772528.548142:0:22761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506310912 00000100:00100000:2.0:1790772528.548153:0:22761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506310912 00000100:00100000:2.0:1790772528.548216:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790772528.548225:0:22761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeec52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23515:x1877760506310912:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1790772528.548359:0:22761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeec52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23515:x1877760506310912:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 135us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772528.548366:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790772528.548412:0:23515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec53100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23515:1877760506310912:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1790772528.548666:0:23515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e4000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23515:1877760506311040:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1790772528.548696:0:23515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1790772528.549591:0:23488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1790772528.549641:0:23488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1790772528.549761:0:23488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1790772528.550791:0:23488:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:1.0:1790772528.554916:0:23488:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:2.0:1790772528.555608:0:23515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc3ccaa80 going to sleep for 11 seconds 00000100:00100000:3.0:1790772528.562913:0:22767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506311040 00000100:00100000:3.0:1790772528.562929:0:22767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506311040 00000100:00100000:3.0:1790772528.563061:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790772528.563071:0:22767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf62e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23515:x1877760506311040:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1790772528.563161:0:22767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf62e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23515:x1877760506311040:12345-0@lo:900:lod0001_rec0000.0 Request processed in 92us (14464us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772528.563526:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790772528.563608:0:23515:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ecdf62e4000 x1877760506311040/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790772544 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772528.563623:0:23515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e4000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23515:1877760506311040:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1790772528.563694:0:23515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e4000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23515:1877760506311168:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1790772528.563745:0:23515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772528.563785:0:23515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc3cca180 going to sleep for 11 seconds 00000100:00100000:0.0:1790772528.563925:0:22761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506311168 00000100:00100000:0.0:1790772528.563931:0:22761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506311168 00000100:00100000:0.0:1790772528.563968:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790772528.563976:0:22761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf62e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23515:x1877760506311168:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1790772528.564040:0:22761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf62e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23515:x1877760506311168:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 66us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772528.564046:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790772528.564103:0:23515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e4000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23515:1877760506311168:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1790772528.564143:0:23515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790772528.570871:0:23515:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1790772528.570953:0:23515:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1790772528.570959:0:23515:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:2.0:1790772528.574026:0:23488:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1790772528.574060:0:23488:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb37a01c5f988 00100000:10000000:2.0:1790772528.574067:0:23488:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1790772528.575203:0:23488:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790772528.575232:0:23488:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.114@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790772528.575247:0:23488:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1790772528.575266:0:23488:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1790772528.576133:0:23488:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790772528.576331:0:23488:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1790772528.663064:0:22798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdea11d3c0 going to sleep for 0 seconds 00010000:00010000:3.0:1790772529.301612:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790772529.556848:0:23514:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790772529.684927:0:22798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdea11d3c0 going to sleep for 0 seconds 10000000:01000000:2.0:1790772530.134534:0:22754:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790772530.134540:0:22754:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ecde1727000 from 12 10000000:01000000:2.0:1790772530.134545:0:22754:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790772530.134587:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9800/0x418ffb1c3bcc9631 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772530.134599:0:22754:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9800/0x418ffb1c3bcc9631 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772530.134611:0:22754:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9800/0x418ffb1c3bcc9631 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772530.134635:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506311296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790772530.134698:0:22754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772530.134744:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc3cca180 going to sleep for 11 seconds 00000100:00100000:3.0:1790772530.134804:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506311296 00000100:00100000:3.0:1790772530.134812:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506311296 00000100:00100000:3.0:1790772530.134878:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790772530.134888:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+16:22754:x1877760506311296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772530.134902:0:22749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772530.134915:0:22749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ecdfbab0a00/0x418ffb1c3bcc9638 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x418ffb1c3bcc9631 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772530.134937:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ecdfbab0a00/0x418ffb1c3bcc9638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9631 expref: 17 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772530.134947:0:22749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ecdfbab0a00/0x418ffb1c3bcc9638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9631 expref: 17 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772530.134956:0:22749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdfbab0a00, rc 0) 00000100:00100000:3.0:1790772530.134999:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+17:22754:x1877760506311296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772530.135005:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790772530.135049:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506311296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772530.135063:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9800/0x418ffb1c3bcc9631 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9638 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772530.135072:0:22754:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9800/0x418ffb1c3bcc9631 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc9638 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772530.135121:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506311424:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1790772530.135185:0:22754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772530.135199:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecde116cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790772530.135367:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506311424 00000100:00100000:1.0:1790772530.135372:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506311424 00000100:00100000:1.0:1790772530.135401:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790772530.135408:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+17:22754:x1877760506311424:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1790772530.135421:0:22750:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790772530.135434:0:22750:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790772530.135437:0:22750:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1790772530.135506:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+17:22754:x1877760506311424:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 99us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772530.135513:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790772530.135650:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506311424:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1790772530.135691:0:22754:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790772530.135698:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9800/0x418ffb1c3bcc9631 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9638 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772530.135707:0:22754:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9800/0x418ffb1c3bcc9631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9638 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772530.135716:0:22754:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790772530.135718:0:22754:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ecdfb45f000 from 12 10000000:01000000:3.0:1790772530.135720:0:22754:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790772530.135736:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1c00/0x418ffb1c3bcc963f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772530.135743:0:22754:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1c00/0x418ffb1c3bcc963f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772530.135750:0:22754:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1c00/0x418ffb1c3bcc963f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772530.135763:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506311552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790772530.135787:0:22754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772530.135814:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecde116cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1790772530.135879:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506311552 00000100:00100000:2.0:1790772530.135884:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506311552 00000100:00100000:2.0:1790772530.135914:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790772530.135921:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+17:22754:x1877760506311552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790772530.135929:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772530.135938:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ecdf4bd8600/0x418ffb1c3bcc9646 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x418ffb1c3bcc963f expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772530.135953:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ecdf4bd8600/0x418ffb1c3bcc9646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x418ffb1c3bcc963f expref: 18 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772530.135968:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ecdf4bd8600/0x418ffb1c3bcc9646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc963f expref: 18 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772530.135975:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdf4bd8600, rc 0) 00000100:00100000:2.0:1790772530.136004:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+18:22754:x1877760506311552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772530.136009:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790772530.136093:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506311552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772530.136104:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1c00/0x418ffb1c3bcc963f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9646 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772530.136111:0:22754:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1c00/0x418ffb1c3bcc963f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc9646 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772530.136180:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506311680:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1790772530.136208:0:22754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772530.136228:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecde116cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1790772530.136724:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506311680 00000100:00100000:2.0:1790772530.136729:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506311680 00000100:00100000:2.0:1790772530.136756:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790772530.136763:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+18:22754:x1877760506311680:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790772530.136774:0:22751:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790772530.136788:0:22751:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790772530.136791:0:22751:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1790772530.136880:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+18:22754:x1877760506311680:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772530.136887:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790772530.136923:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506311680:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790772530.136957:0:22754:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790772530.136964:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1c00/0x418ffb1c3bcc963f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9646 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772530.136974:0:22754:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1c00/0x418ffb1c3bcc963f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9646 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772530.326821:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790772530.580860:0:23514:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790772530.710855:0:22798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdea11d3c0 going to sleep for 0 seconds 00010000:00010000:3.0:1790772531.351024:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772531.737263:0:22798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdea11d3c0 going to sleep for 0 seconds 00010000:00010000:2.0:1790772532.387600:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772532.757394:0:22798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdea11d3c0 going to sleep for 0 seconds 00010000:00010000:3.0:1790772533.400515:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772533.535440:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1877760506311808:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790772533.535514:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790772533.535612:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790772533.535617:0:19463:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1790772533.535620:0:19463:0:(import.c:65:import_set_state_nolock()) ffff9ecdd1145800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790772533.535631:0:19463:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ecdd1145800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:2.0:1790772533.535652:0:19463:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdf62e7100 x1877760506312064/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790772533.535669:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790772533.535673:0:19463:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790772533.535675:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790772533.535678:0:19463:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790772533.535688:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790772533.535691:0:19463:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790772533.535694:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790772533.535697:0:19463:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790772533.535882:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3645:1877760506311936:0@lo:400:kworker.0 00000100:00100000:2.0:1790772533.535917:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772533.535946:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790772533.535952:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1877760506312192:0@lo:400:kworker.0 00000100:00100000:2.0:1790772533.535979:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772533.536009:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506312064:0@lo:38:kworker.0 00000100:00100000:2.0:1790772533.536050:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772533.536135:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506311936 00000100:00100000:2.0:1790772533.536142:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506311936 00000100:00100000:2.0:1790772533.536205:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790772533.536212:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+18:3645:x1877760506311936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772533.536253:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+18:3645:x1877760506311936:12345-0@lo:400:kworker.0 Request processed in 41us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772533.536259:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790772533.536289:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506312192 00000100:00100000:2.0:1790772533.536292:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506312192 00000100:00100000:2.0:1790772533.536316:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790772533.536321:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf62e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1877760506312192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772533.536348:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf62e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1877760506312192:12345-0@lo:400:kworker.0 Request processed in 27us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772533.536354:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790772533.536383:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1877760506312320:0@lo:400:kworker.0 00000100:00100000:2.0:1790772533.536402:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772533.536423:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506312320 00000100:00100000:2.0:1790772533.536426:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506312320 00000100:00100000:2.0:1790772533.536443:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790772533.536448:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf62e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1877760506312320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772533.536477:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf62e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1877760506312320:12345-0@lo:400:kworker.0 Request processed in 29us (75us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772533.536483:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1790772533.536510:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ecdf62e7b80 x1877760506312320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772533.536523:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1877760506312320:0@lo:400:kworker.0 00010000:00080000:2.0:1790772533.536562:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ecdf62e5500 x1877760506312192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772533.536571:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1877760506312192:0@lo:400:kworker.0 00000100:00100000:2.0:1790772533.536580:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3645:1877760506311936:0@lo:400:kworker.0 00000100:00100000:0.0:1790772533.537529:0:23497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506311808 00000100:00100000:0.0:1790772533.537536:0:23497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506311808 00000100:00100000:0.0:1790772533.537564:0:23497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506312064 00000100:00100000:0.0:1790772533.537567:0:23497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506312064 00000100:00100000:0.0:1790772533.537578:0:23497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790772533.537584:0:23497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf62e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1877760506311808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790772533.537611:0:23497:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1790772533.537657:0:23497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf62e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1877760506311808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (2143us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772533.537662:0:23497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790772533.537675:0:23497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790772533.537679:0:23497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf62e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3642:x1877760506312064:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1790772533.537701:0:23497:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 633 last 0 00000020:00000080:0.0:1790772533.537730:0:23497:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x418ffb1c3bcc964d 00000004:00100000:0.0:1790772533.537742:0:23497:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1790772533.537748:0:23497:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:2.0:1790772533.538833:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1877760506311808:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1790772533.554761:0:23497:0:(import.c:65:import_set_state_nolock()) ffff9ecde10bb000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790772533.554949:0:23497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf62e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1877760506312064:12345-0@lo:38:kworker.0 Request processed in 17264us (18894us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772533.554965:0:23497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1790772533.555020:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1790772533.555035:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1790772533.555041:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1790772533.555046:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ecdd1145800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1790772533.555076:0:3642:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000007e889f1b): req@ffff9ecdf62e5180 x1877760506304640/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772533.555096:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506312064:0@lo:38:kworker.0 00000100:00100000:3.0:1790772533.555213:0:22798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772533.555244:0:22798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdea11d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772533.555341:0:22761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506304640 00000100:00100000:0.0:1790772533.555350:0:22761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506304640 00000100:00100000:3.0:1790772533.555609:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1877760506312448:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790772533.555626:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790772533.555644:0:22761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc12ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22798:x1877760506304640:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1790772533.555654:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772533.555767:0:22761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc12ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22798:x1877760506304640:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 129us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772533.555777:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790772533.555798:0:22761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506312448 00000100:00100000:0.0:1790772533.555802:0:22761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506312448 00000100:00100000:3.0:1790772533.555813:0:22798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e5180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22798:1877760506304640:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1790772533.555844:0:22798:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1790772533.555893:0:22798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12aea00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22798:1877760506312576:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1790772533.555926:0:22798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772533.555937:0:22798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc2f68cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772533.556006:0:22761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506312576 00000100:00100000:0.0:1790772533.556012:0:22761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506312576 00000100:00100000:0.0:1790772533.556027:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790772533.556033:0:22761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc12af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3644:x1877760506312448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790772533.556061:0:22761:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790772533.556120:0:22761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc12af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3644:x1877760506312448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772533.556127:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790772533.556140:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790772533.556229:0:22761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc12ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22798:x1877760506312576:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1790772533.557105:0:22761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc12ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22798:x1877760506312576:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 956us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772533.557116:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790772533.557629:0:22798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12aea00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22798:1877760506312576:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1790772533.558626:0:22798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec50a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22798:1877760506312704:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1790772533.558694:0:22798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772533.558739:0:22798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdd07f4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790772533.558772:0:23497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506312704 00000100:00100000:0.0:1790772533.558779:0:23497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506312704 00000100:00100000:3.0:1790772533.559279:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1877760506312448:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790772533.559503:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790772533.559518:0:22762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeec53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22798:x1877760506312704:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1790772533.559644:0:22762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeec53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22798:x1877760506312704:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 132us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772533.559653:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790772533.560090:0:22798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec50a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22798:1877760506312704:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1790772533.560155:0:22798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790772533.562382:0:22798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1790772533.562507:0:22798:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:3.0:1790772533.562513:0:22798:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:02000400:3.0:1790772533.667997:0:23757:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg614-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1790772534.426138:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1790772534.682957:0:23810:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790772534.683905:0:23810:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790772535.448238:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790772535.875114:0:23860:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790772535.875481:0:23860:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790772536.469257:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790772536.856031:0:22792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:2.0:1790772537.361096:0:23908:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdbd8bcf70 20000000:00000080:2.0:1790772537.361118:0:23908:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ecdeffc4000 uarg=0000000000000000 20000000:01000000:2.0:1790772537.361194:0:23908:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1790772537.361203:0:23908:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1790772537.361209:0:23908:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1790772537.364421:0:23909:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1790772537.369135:0:23908:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1790772537.381276:0:23908:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790772537.381322:0:23908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eccc1bd0000/0x418ffb1c3bcc9654 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.382032:0:23908:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ecdf4bd9000/0x418ffb1c3bcc94fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc94f6 expref: 17 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.382043:0:23908:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ecdf4bd8e00/0x418ffb1c3bcc9600 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc95f9 expref: 17 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.382053:0:23908:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eccc1bd0000/0x418ffb1c3bcc9654 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772537.383046:0:23908:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ecdf4bd8e00/0x418ffb1c3bcc9600 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x418ffb1c3bcc95f9 expref: 17 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772537.383067:0:23908:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ecdf4bd8e00/0x418ffb1c3bcc9600 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x418ffb1c3bcc95f9 expref: 17 pid: 22749 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772537.383084:0:23908:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8090000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23908:1877760506312832:0@lo:104: 00000100:00100000:1.0:1790772537.383286:0:23908:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772537.383556:0:22739:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506312832 00000100:00100000:2.0:1790772537.383566:0:22739:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506312832 00000100:00100000:2.0:1790772537.383809:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790772537.383822:0:22739:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf8091c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+3:23908:x1877760506312832:12345-0@lo:104: 00010000:00010000:2.0:1790772537.383847:0:22739:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1c00/0x418ffb1c3bcc95f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x418ffb1c3bcc9600 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772537.383908:0:22739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790772537.383929:0:22739:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf8091c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+3:23908:x1877760506312832:12345-0@lo:104: Request processed in 111us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772537.383937:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1790772537.383968:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772537.383975:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1c00/0x418ffb1c3bcc95f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x418ffb1c3bcc9600 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772537.383983:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc1bd1c00 already unused, calling callback (ffffffffc11ffc20) 10000000:00010000:2.0:1790772537.383989:0:22744:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1c00/0x418ffb1c3bcc95f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x418ffb1c3bcc9600 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772537.383999:0:22744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1c00/0x418ffb1c3bcc95f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x418ffb1c3bcc9600 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772537.384007:0:22744:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1c00/0x418ffb1c3bcc95f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x418ffb1c3bcc9600 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772537.384014:0:22744:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790772537.384047:0:22744:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1c00/0x418ffb1c3bcc95f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc9600 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772537.384054:0:22744:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790772537.384075:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1c00/0x418ffb1c3bcc95f9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc9600 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772537.384083:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1c00/0x418ffb1c3bcc95f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc9600 expref: -99 pid: 23488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772537.384094:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772537.384096:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772537.384098:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772537.384121:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3645:1877760506312960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790772537.384154:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772537.384206:0:22741:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506312960 00000100:00100000:2.0:1790772537.384210:0:22741:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506312960 00010000:00010000:2.0:1790772537.384228:0:22741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ecdf4bd8e00/0x418ffb1c3bcc9600 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x418ffb1c3bcc95f9 expref: 18 pid: 22749 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772537.384250:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790772537.384256:0:22741:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf62e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+18:3645:x1877760506312960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790772537.384268:0:22741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772537.384273:0:22741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ecdf4bd8e00/0x418ffb1c3bcc9600 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x418ffb1c3bcc95f9 expref: 18 pid: 22749 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772537.384284:0:22741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ecdf4bd8e00/0x418ffb1c3bcc9600 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x418ffb1c3bcc95f9 expref: 18 pid: 22749 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772537.384303:0:22741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772537.384874:0:22741:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf62e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+18:3645:x1877760506312960:12345-0@lo:103:ldlm_bl.0 Request processed in 617us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772537.384882:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1790772537.384991:0:23908:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ecdf4bd9000/0x418ffb1c3bcc94fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x418ffb1c3bcc94f6 expref: 17 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772537.385018:0:23908:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ecdf4bd9000/0x418ffb1c3bcc94fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x418ffb1c3bcc94f6 expref: 17 pid: 22750 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772537.385030:0:23908:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8093800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23908:1877760506313088:0@lo:104: 00000100:00100000:1.0:1790772537.385059:0:23908:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772537.385187:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3645:1877760506312960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790772537.385951:0:23908:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecde116c9c0 going to sleep for 11 seconds 00010000:00010000:1.0:1790772537.385978:0:23908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ecdf4bd8e00/0x418ffb1c3bcc9600 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x418ffb1c3bcc95f9 expref: 17 pid: 22749 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772537.385995:0:23908:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8090000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23908:1877760506312832:0@lo:104: 00000100:00100000:2.0:1790772537.387123:0:22739:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506313088 00000100:00100000:2.0:1790772537.387136:0:22739:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506313088 00000100:00100000:2.0:1790772537.387219:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790772537.387229:0:22739:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf8091f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+3:23908:x1877760506313088:12345-0@lo:104: 00010000:00010000:2.0:1790772537.387249:0:22739:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1000/0x418ffb1c3bcc94f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x418ffb1c3bcc94fd expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772537.387357:0:22739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790772537.387364:0:22739:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf8091f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+3:23908:x1877760506313088:12345-0@lo:104: Request processed in 137us (2304us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772537.387384:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1790772537.387410:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772537.387417:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1000/0x418ffb1c3bcc94f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x418ffb1c3bcc94fd expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772537.387425:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdfbab1000 already unused, calling callback (ffffffffc11ffc20) 10000000:00010000:2.0:1790772537.387430:0:22745:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1000/0x418ffb1c3bcc94f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x418ffb1c3bcc94fd expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772537.387440:0:22745:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1000/0x418ffb1c3bcc94f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x418ffb1c3bcc94fd expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772537.387448:0:22745:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1000/0x418ffb1c3bcc94f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x418ffb1c3bcc94fd expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772537.387454:0:22745:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790772537.387495:0:22745:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1000/0x418ffb1c3bcc94f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc94fd expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772537.387512:0:22745:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790772537.387542:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1000/0x418ffb1c3bcc94f6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc94fd expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772537.387549:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1000/0x418ffb1c3bcc94f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc94fd expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772537.387567:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772537.387568:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772537.387570:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772537.387583:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3646:1877760506313216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790772537.388024:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772537.388129:0:22742:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506313216 00000100:00100000:3.0:1790772537.388135:0:22742:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506313216 00010000:00010000:3.0:1790772537.388159:0:22742:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ecdf4bd9000/0x418ffb1c3bcc94fd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x418ffb1c3bcc94f6 expref: 17 pid: 22750 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772537.388212:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790772537.388219:0:22742:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf62e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+17:3646:x1877760506313216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790772537.388231:0:22742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772537.388236:0:22742:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ecdf4bd9000/0x418ffb1c3bcc94fd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x418ffb1c3bcc94f6 expref: 17 pid: 22750 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772537.388249:0:22742:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ecdf4bd9000/0x418ffb1c3bcc94fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x418ffb1c3bcc94f6 expref: 17 pid: 22750 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772537.388270:0:22742:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eccc1bd0000/0x418ffb1c3bcc9654 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772537.388279:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eccc1bd0000/0x418ffb1c3bcc9654 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772537.388298:0:22742:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eccc1bd0000/0x418ffb1c3bcc9654 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772537.388323:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eccc1bd0000/0x418ffb1c3bcc9654 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772537.388337:0:22742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eccc1bd0000/0x418ffb1c3bcc9654 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772537.388345:0:22742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eccc1bd0000/0x418ffb1c3bcc9654 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772537.388351:0:22742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc1bd0000 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:3.0:1790772537.388356:0:22742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eccc1bd0000/0x418ffb1c3bcc9654 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772537.388365:0:22742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eccc1bd0000/0x418ffb1c3bcc9654 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772537.388375:0:22742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eccc1bd0000/0x418ffb1c3bcc9654 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772537.388385:0:22742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772537.388420:0:22742:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf62e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+17:3646:x1877760506313216:12345-0@lo:103:ldlm_bl.0 Request processed in 202us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772537.388427:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790772537.389023:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3646:1877760506313216:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790772537.389194:0:23908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ecdf4bd9000/0x418ffb1c3bcc94fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x418ffb1c3bcc94f6 expref: 16 pid: 22750 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772537.389209:0:23908:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8093800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23908:1877760506313088:0@lo:104: 00010000:00010000:1.0:1790772537.389229:0:23908:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eccc1bd0000/0x418ffb1c3bcc9654 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772537.389239:0:23908:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eccc1bd0000/0x418ffb1c3bcc9654 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772537.389246:0:23908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eccc1bd0000/0x418ffb1c3bcc9654 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772537.389254:0:23908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eccc1bd0000/0x418ffb1c3bcc9654 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772537.494622:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772538.516810:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790772538.645814:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790772538.645832:0:19463:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790772538.645836:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790772538.645839:0:19463:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790772538.645864:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790772538.645867:0:19463:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790772538.645870:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790772538.645873:0:19463:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790772538.645960:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3643:1877760506313344:0@lo:400:kworker.0 00000100:00100000:0.0:1790772538.646054:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772538.646103:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1877760506313856:0@lo:400:kworker.0 00000100:00100000:0.0:1790772538.646138:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772538.646185:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790772538.646190:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1877760506313472:0@lo:400:kworker.0 00000100:00100000:0.0:1790772538.646216:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772538.646352:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506313344 00000100:00100000:0.0:1790772538.646361:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506313344 00000100:00100000:0.0:1790772538.646415:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790772538.646425:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+16:3643:x1877760506313344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772538.646484:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+16:3643:x1877760506313344:12345-0@lo:400:kworker.0 Request processed in 60us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772538.646492:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790772538.646906:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1877760506313600:0@lo:400:kworker.0 00000100:00100000:2.0:1790772538.646939:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772538.646965:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790772538.646971:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506313728:0@lo:400:kworker.0 00000100:00100000:2.0:1790772538.646994:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772538.647027:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506313856 00000100:00100000:2.0:1790772538.647031:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506313856 00000100:00100000:2.0:1790772538.647060:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506313600 00000100:00100000:2.0:1790772538.647063:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506313600 00000100:00100000:2.0:1790772538.647077:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790772538.647083:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeec52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1877760506313856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772538.647119:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeec52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1877760506313856:12345-0@lo:400:kworker.0 Request processed in 35us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772538.647125:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790772538.647139:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790772538.647145:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf62e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1877760506313600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772538.647193:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf62e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1877760506313600:12345-0@lo:400:kworker.0 Request processed in 48us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772538.647199:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790772538.647217:0:22762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506313472 00000100:00100000:2.0:1790772538.647221:0:22762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506313472 00000100:00100000:2.0:1790772538.647246:0:22762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506313728 00000100:00100000:2.0:1790772538.647249:0:22762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506313728 00000100:00100000:2.0:1790772538.647261:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790772538.647280:0:22762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeec50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1877760506313472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772538.647314:0:22762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeec50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1877760506313472:12345-0@lo:400:kworker.0 Request processed in 36us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772538.647321:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790772538.647333:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790772538.647339:0:22762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf62e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506313728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772538.647366:0:22762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf62e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506313728:12345-0@lo:400:kworker.0 Request processed in 28us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772538.647372:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790772538.647422:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506313728:0@lo:400:kworker.0 00010000:00080000:2.0:1790772538.647435:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ecdeec51c00 x1877760506313600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772538.647446:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1877760506313600:0@lo:400:kworker.0 00000100:00100000:2.0:1790772538.647474:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1877760506313984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790772538.647622:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1877760506313472:0@lo:400:kworker.0 00000100:00100000:0.0:1790772538.647702:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3643:1877760506313344:0@lo:400:kworker.0 00010000:00080000:0.0:1790772538.647715:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ecdeec51180 x1877760506313856/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772538.647725:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1877760506313856:0@lo:400:kworker.0 00000100:00100000:2.0:1790772538.647856:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772538.648351:0:22762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506313984 00000100:00100000:0.0:1790772538.648357:0:22762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506313984 00000100:00100000:0.0:1790772538.648392:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790772538.648399:0:22762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf62e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1877760506313984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790772538.648432:0:22762:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1790772538.648494:0:22762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf62e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1877760506313984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772538.648812:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790772528/real 1790772528] req@ffff9ecdc12aed80 x1877760506308224/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790772538 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772538.648932:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ecdc12aed80 x1877760506308224/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790772538 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772538.648944:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790772528/real 1790772528] req@ffff9ecdc12af480 x1877760506308096/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790772538 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772538.648956:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ecdc12af480 x1877760506308096/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790772538 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790772538.648985:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ecdf8089800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790772538.649006:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790772538.649010:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1877760506308224:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1790772538.649016:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9eccc3cac800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790772538.649021:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790772538.649024:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1877760506308096:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1790772538.649056:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506314112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790772538.649198:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1790772538.649230:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790772538.649237:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790772538.649240:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790772538.649243:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790772538.649246:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790772538.649250:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1790772538.649253:0:8:0:(import.c:65:import_set_state_nolock()) ffff9eccc3cac800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790772538.649258:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 628 00000100:00080000:0.0:1790772538.649724:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790772538.649736:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9eccc3cac800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:0.0:1790772538.649767:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdeec51180 x1877760506314240/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790772538.649788:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790772538.649792:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790772538.649794:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ecdf8089800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790772538.649798:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 628 00000100:00080000:0.0:1790772538.649801:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790772538.649807:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ecdf8089800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:0.0:1790772538.649819:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdeec51500 x1877760506314368/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790772538.650262:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772538.650378:0:23497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506314112 00000100:00100000:2.0:1790772538.650384:0:23497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506314112 00000100:00100000:2.0:1790772538.650431:0:23497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790772538.650440:0:23497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf62e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1877760506314112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790772538.650473:0:23497:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790772538.650532:0:23497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf62e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1877760506314112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772538.650539:0:23497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790772538.650571:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1877760506314240:0@lo:8:kworker.0 00000400:00000100:2.0:1790772538.650601:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877760506314240 offset 0 length 520: 4 00000100:00100000:2.0:1790772538.651458:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1877760506314368:0@lo:8:kworker.0 00000400:00000100:2.0:1790772538.651502:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877760506314368 offset 0 length 520: 4 00000100:00100000:2.0:1790772538.651583:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506314112:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790772538.651808:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1877760506313984:0@lo:41:osp-pre-0-1.0 10000000:01000000:2.0:1790772539.284339:0:22754:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790772539.284351:0:22754:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ecde1727000 from 13 10000000:01000000:2.0:1790772539.284358:0:22754:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790772539.284425:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc965b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.284439:0:22754:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc965b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.284452:0:22754:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc965b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772539.284486:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506314496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790772539.284572:0:22754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772539.284631:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc30f1180 going to sleep for 11 seconds 00000100:00100000:3.0:1790772539.284808:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506314496 00000100:00100000:3.0:1790772539.284831:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506314496 00000100:00100000:3.0:1790772539.284892:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790772539.284903:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+16:22754:x1877760506314496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772539.284921:0:22749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772539.284940:0:22749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ecdfbab0e00/0x418ffb1c3bcc9662 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x418ffb1c3bcc965b expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.285081:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ecdfbab0e00/0x418ffb1c3bcc9662 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x418ffb1c3bcc965b expref: 17 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.285093:0:22749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ecdfbab0e00/0x418ffb1c3bcc9662 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc965b expref: 17 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.285104:0:22749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdfbab0e00, rc 0) 00000100:00100000:3.0:1790772539.285184:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+17:22754:x1877760506314496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 260us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772539.285193:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790772539.285541:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506314496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790772539.285561:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc965b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9662 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.285572:0:22754:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc965b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc9662 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772539.285646:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506314624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790772539.285676:0:22754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772539.285709:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc30f1180 going to sleep for 11 seconds 00000100:00100000:3.0:1790772539.285770:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506314624 00000100:00100000:3.0:1790772539.285775:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506314624 00000100:00100000:3.0:1790772539.285842:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790772539.285850:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+17:22754:x1877760506314624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772539.285994:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+17:22754:x1877760506314624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772539.286001:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790772539.286057:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506314624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790772539.286087:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506314752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790772539.286138:0:22754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772539.301563:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc30f1180 going to sleep for 11 seconds 00000100:00100000:1.0:1790772539.303273:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506314752 00000100:00100000:1.0:1790772539.303421:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506314752 00000100:00100000:1.0:1790772539.303489:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790772539.303499:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+17:22754:x1877760506314752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790772539.303744:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+17:22754:x1877760506314752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 246us (17603us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772539.303753:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790772539.309159:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506314752:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790772539.322469:0:23977:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1790772539.327105:0:22754:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1790772539.327203:0:22754:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790772539.327219:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc965b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9662 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772539.327236:0:22754:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc965b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9662 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772539.327253:0:22754:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790772539.327257:0:22754:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ecdfb45f000 from 13 10000000:01000000:0.0:1790772539.327260:0:22754:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790772539.328231:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1e00/0x418ffb1c3bcc9669 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772539.328249:0:22754:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1e00/0x418ffb1c3bcc9669 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772539.328263:0:22754:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1e00/0x418ffb1c3bcc9669 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772539.328297:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec53800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506314880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790772539.328401:0:22754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772539.328461:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc516ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1790772539.328894:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506314880 00000100:00100000:1.0:1790772539.328904:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506314880 00000100:00100000:1.0:1790772539.329101:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790772539.329113:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+17:22754:x1877760506314880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772539.329132:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772539.329148:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ecdef3a7200/0x418ffb1c3bcc9670 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x418ffb1c3bcc9669 expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.329205:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ecdef3a7200/0x418ffb1c3bcc9670 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9669 expref: 18 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.329217:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ecdef3a7200/0x418ffb1c3bcc9670 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9669 expref: 18 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.329227:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdef3a7200, rc 0) 00000100:00100000:1.0:1790772539.329288:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+18:22754:x1877760506314880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772539.329296:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790772539.329622:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec53800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506314880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790772539.329640:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1e00/0x418ffb1c3bcc9669 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9670 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772539.329650:0:22754:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1e00/0x418ffb1c3bcc9669 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc9670 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772539.329741:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec53800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506315008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772539.329782:0:22754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772539.333658:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506315008 00000100:00100000:3.0:1790772539.335451:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc516ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1790772539.335565:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506315008 00000100:00100000:2.0:1790772539.335630:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790772539.335642:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+18:22754:x1877760506315008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790772539.335929:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+18:22754:x1877760506315008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 290us (6145us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772539.335939:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790772539.336201:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec53800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506315008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772539.336273:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506315136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772539.336439:0:22754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772539.336472:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc2f68000 going to sleep for 11 seconds 00000100:00100000:2.0:1790772539.336546:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506315136 00000100:00100000:2.0:1790772539.336551:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506315136 00000100:00100000:2.0:1790772539.336586:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790772539.336593:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+18:22754:x1877760506315136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790772539.336800:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+18:22754:x1877760506315136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772539.336807:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790772539.337004:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506315136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790772539.338630:0:23978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1790772539.338890:0:22754:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1790772539.338935:0:22754:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790772539.339002:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1e00/0x418ffb1c3bcc9669 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9670 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.339016:0:22754:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1e00/0x418ffb1c3bcc9669 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9670 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.541546:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772539.672782:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790772524/real 1790772524] req@ffff9ecdf8090e00 x1877760506306048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790772539 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772539.672839:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ecdf8090e00 x1877760506306048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790772539 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772539.672851:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790772524/real 1790772524] req@ffff9ecdf8092680 x1877760506306176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790772539 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772539.672861:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ecdf8092680 x1877760506306176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790772539 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790772539.672883:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ecdd1143800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790772539.672907:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790772539.672911:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506306048:0@lo:8:kworker.0 00000100:00080000:3.0:1790772539.672917:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ecdff753800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790772539.672923:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790772539.672925:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506306176:0@lo:8:kworker.0 00000001:00100000:0.0:1790772539.681955:0:23489:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00080000:3.0:1790772539.688098:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790772539.688111:0:19463:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1790772539.688115:0:19463:0:(import.c:65:import_set_state_nolock()) ffff9ecdd1143800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790772539.688125:0:19463:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 625 00000100:00080000:3.0:1790772539.688146:0:19463:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790772539.688162:0:19463:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ecdd1143800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:0.0:1790772539.688221:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790772539.688227:0:19463:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdc12aca80 x1877760506315392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790772539.688264:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506315264:0@lo:400:kworker.0 00000100:00080000:3.0:1790772539.688271:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790772539.688277:0:19463:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790772539.688280:0:19463:0:(import.c:65:import_set_state_nolock()) ffff9ecdff753800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790772539.688284:0:19463:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 625 00000100:00080000:3.0:1790772539.688287:0:19463:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790772539.688294:0:19463:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ecdff753800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:3.0:1790772539.688307:0:19463:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdc12ad500 x1877760506315520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790772539.688350:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790772539.688354:0:19463:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790772539.688357:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790772539.688361:0:19463:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790772539.688370:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772539.688414:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877760506315648:0@lo:400:kworker.0 00000100:00100000:3.0:1790772539.688452:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772539.688482:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1877760506315776:0@lo:400:kworker.0 00000100:00100000:3.0:1790772539.688523:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772539.688560:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506315648 00000100:00100000:3.0:1790772539.688570:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506315648 00000100:00100000:3.0:1790772539.688624:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790772539.688634:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc12ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877760506315648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772539.688878:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc12ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877760506315648:12345-0@lo:400:kworker.0 Request processed in 245us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772539.688888:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790772539.688898:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1877760506315904:0@lo:400:kworker.0 00000100:00100000:3.0:1790772539.688917:0:22761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506315264 00000100:00100000:3.0:1790772539.688922:0:22761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506315264 00000100:00100000:0.0:1790772539.688933:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772539.688966:0:22761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506315776 00000100:00100000:3.0:1790772539.688970:0:22761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506315776 00000100:00100000:0.0:1790772539.688997:0:23497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790772539.689013:0:23497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeec51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1877760506315264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772539.689063:0:23497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeec51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1877760506315264:12345-0@lo:400:kworker.0 Request processed in 56us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772539.690878:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506315904 00000100:00100000:2.0:1790772539.690888:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506315904 00000100:00100000:2.0:1790772539.690952:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790772539.690962:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeec53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1877760506315904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772539.691044:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeec53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1877760506315904:12345-0@lo:400:kworker.0 Request processed in 83us (2110us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772539.691051:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790772539.691084:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506315392:0@lo:8:kworker.0 00000400:00000100:2.0:1790772539.691133:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877760506315392 offset 0 length 520: 4 00000100:00100000:2.0:1790772539.691185:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506315520:0@lo:8:kworker.0 00000400:00000100:2.0:1790772539.691209:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877760506315520 offset 0 length 520: 4 00000100:00100000:3.0:1790772539.691648:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790772539.693987:0:22761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc12adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877760506315776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772539.694117:0:22761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc12adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877760506315776:12345-0@lo:400:kworker.0 Request processed in 153us (5593us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772539.698080:0:23497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1790772539.698233:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ecdc12ae680 x1877760506315904/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1790772539.698410:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ecdc12ad180 x1877760506315648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772539.698427:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877760506315648:0@lo:400:kworker.0 00000100:00100000:2.0:1790772539.698526:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1877760506315776:0@lo:400:kworker.0 00000100:00100000:0.0:1790772539.699036:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1877760506315904:0@lo:400:kworker.0 00000100:00100000:0.0:1790772539.699058:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506315264:0@lo:400:kworker.0 00000100:00100000:3.0:1790772539.707775:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1790772540.569514:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790772540.821426:0:23514:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790772541.589685:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772542.617483:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772543.636899:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772543.765738:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790772543.765768:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506316032:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790772543.765877:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772543.765955:0:23497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506316032 00000100:00100000:0.0:1790772543.765965:0:23497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506316032 00000100:00100000:0.0:1790772543.766021:0:23497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790772543.766042:0:23497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeec50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506316032:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790772543.766884:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1877760506316160:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790772543.766942:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772543.767015:0:22761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506316160 00000100:00100000:1.0:1790772543.767021:0:22761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506316160 00000100:00100000:1.0:1790772543.767053:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790772543.767061:0:22761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf8090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1877760506316160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790772543.767205:0:23497:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1790772543.769301:0:23497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeec50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506316032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3249us (3411us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772543.769317:0:23497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790772543.769418:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506316032:0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790772543.770361:0:22761:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790772543.770440:0:22761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf8090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1877760506316160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3377us (3495us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772543.770449:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790772543.770660:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1877760506316160:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1790772544.660544:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790772544.790106:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790772544.790113:0:19463:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790772544.790116:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790772544.790119:0:19463:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790772544.790137:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790772544.790140:0:19463:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790772544.790143:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790772544.790146:0:19463:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790772544.790198:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3644:1877760506316288:0@lo:400:kworker.0 00000100:00100000:2.0:1790772544.790271:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772544.790326:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3e92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877760506316800:0@lo:400:kworker.0 00000100:00100000:2.0:1790772544.790352:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772544.790378:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790772544.790393:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3e90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1877760506316672:0@lo:400:kworker.0 00000100:00100000:2.0:1790772544.790420:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772544.790450:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506316416:0@lo:400:kworker.0 00000100:00100000:2.0:1790772544.790472:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772544.790490:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790772544.790496:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1877760506316544:0@lo:400:kworker.0 00000100:00100000:2.0:1790772544.790516:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772544.790547:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506316288 00000100:00100000:2.0:1790772544.790556:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506316288 00000100:00100000:2.0:1790772544.790598:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790772544.790607:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf118bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+18:3644:x1877760506316288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772544.790660:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf118bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+18:3644:x1877760506316288:12345-0@lo:400:kworker.0 Request processed in 53us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772544.790667:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790772544.790700:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506316800 00000100:00100000:2.0:1790772544.790704:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506316800 00000100:00100000:2.0:1790772544.790725:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506316544 00000100:00100000:2.0:1790772544.790728:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506316544 00000100:00100000:2.0:1790772544.790740:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790772544.790745:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877760506316800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772544.790775:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877760506316800:12345-0@lo:400:kworker.0 Request processed in 30us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772544.790781:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790772544.790806:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790772544.790812:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1877760506316544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772544.790845:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1877760506316544:12345-0@lo:400:kworker.0 Request processed in 33us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772544.790861:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790772544.790882:0:23497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506316672 00000100:00100000:2.0:1790772544.790886:0:23497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506316672 00000100:00100000:2.0:1790772544.790910:0:23497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506316416 00000100:00100000:2.0:1790772544.790912:0:23497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506316416 00000100:00100000:2.0:1790772544.790925:0:23497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790772544.790930:0:23497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1877760506316672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772544.790965:0:23497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1877760506316672:12345-0@lo:400:kworker.0 Request processed in 34us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772544.790970:0:23497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790772544.790981:0:23497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790772544.790987:0:23497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1877760506316416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772544.791014:0:23497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1877760506316416:12345-0@lo:400:kworker.0 Request processed in 27us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772544.791020:0:23497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1790772544.791064:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eccc3e91180 x1877760506316544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772544.791077:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1877760506316544:0@lo:400:kworker.0 00000100:00100000:2.0:1790772544.791088:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506316416:0@lo:400:kworker.0 00000100:00100000:2.0:1790772544.791116:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3e90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1877760506316672:0@lo:400:kworker.0 00000100:00100000:2.0:1790772544.791123:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3644:1877760506316288:0@lo:400:kworker.0 00010000:00080000:2.0:1790772544.791131:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eccc3e92300 x1877760506316800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772544.791139:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3e92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877760506316800:0@lo:400:kworker.0 00000020:01000004:2.0:1790772545.208150:0:24258:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790772545.208155:0:24258:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1790772545.208156:0:24258:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1790772545.208508:0:24258:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ecdfbb15000 00000020:01000004:2.0:1790772545.208525:0:24258:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1790772545.208542:0:24258:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1790772545.208559:0:24258:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9eccc3744d40) 00000020:00000080:2.0:1790772545.208576:0:24258:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1790772545.254892:0:24258:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1790772545.261135:0:24258:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1790772545.261720:0:24258:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1790772545.261978:0:24258:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1790772545.262198:0:24258:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1790772545.262418:0:24258:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1790772545.262692:0:24258:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:2.0:1790772545.263691:0:24258:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1790772545.263954:0:24258:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1790772545.263966:0:24258:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790772545.263976:0:24258:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x418ffb1c3bcc967e 00000020:01000004:2.0:1790772545.263983:0:24258:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1790772545.264002:0:24258:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.114@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790772545.264006:0:24258:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790772545.264013:0:24258:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1790772545.264019:0:24258:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1790772545.264032:0:24258:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9eccc30ab380) 00000020:00000080:2.0:1790772545.264043:0:24258:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1790772545.265732:0:24258:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790772545.265914:0:24258:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1790772545.265920:0:24258:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1790772545.267005:0:24258:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1790772545.267014:0:24258:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1790772545.267611:0:24258:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1790772545.267618:0:24258:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1790772545.269756:0:24258:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790772545.269945:0:24258:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1790772545.269952:0:24258:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1790772545.277320:0:24258:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1790772545.277340:0:24258:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1790772545.297519:0:24258:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790772545.297761:0:24258:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1790772545.297768:0:24258:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1790772545.299771:0:24258:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1790772545.299784:0:24258:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1790772545.301108:0:24258:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1790772545.301118:0:24258:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1790772545.303580:0:24258:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790772545.304531:0:24258:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1790772545.304538:0:24258:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1790772545.305669:0:24258:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1790772545.305678:0:24258:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1790772545.373710:0:24258:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790772545.373937:0:24258:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1790772545.373944:0:24258:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1790772545.386339:0:24258:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1790772545.386358:0:24258:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1790772545.387124:0:24258:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1790772545.387153:0:24258:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1790772545.387158:0:24258:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.114@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1790772545.425645:0:24258:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.114@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790772545.425708:0:24258:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.114@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1790772545.425713:0:24258:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790772545.425715:0:24258:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790772545.425716:0:24258:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790772545.425718:0:24258:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790772545.425719:0:24258:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790772545.425721:0:24258:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790772545.425723:0:24258:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790772545.425729:0:24258:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790772545.425730:0:24258:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790772545.425734:0:24258:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1790772545.425736:0:24258:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790772545.425737:0:24258:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790772545.425738:0:24258:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790772545.425739:0:24258:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790772545.425740:0:24258:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790772545.425741:0:24258:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790772545.425742:0:24258:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790772545.425743:0:24258:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790772545.425744:0:24258:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790772545.425771:0:24258:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1790772545.425801:0:24258:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506316928:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790772545.425877:0:24258:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772545.425969:0:24258:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc4c6b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772545.427340:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506316928 00000100:00100000:0.0:1790772545.427350:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506316928 00000100:00100000:0.0:1790772545.427415:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790772545.427438:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1189450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+18:24258:x1877760506316928:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790772545.427470:0:22749:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1790772545.427474:0:22749:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1790772545.427479:0:22749:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1790772545.427878:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1189450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+18:24258:x1877760506316928:12345-0@lo:253:mount.lustre.0 Request processed in 455us (2000us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772545.427886:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790772545.429455:0:24258:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506316928:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790772545.429475:0:24258:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1790772545.429479:0:24258:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790772545.429480:0:24258:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790772545.429482:0:24258:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790772545.429483:0:24258:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790772545.429484:0:24258:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790772545.429485:0:24258:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790772545.429487:0:24258:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790772545.429489:0:24258:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790772545.429490:0:24258:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790772545.429531:0:24258:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ecdfbb15000 from lustre-OST0000 10000000:01000000:3.0:1790772545.429567:0:24258:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1790772545.429570:0:24258:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1790772545.429580:0:24258:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ecdfc7f0000 local copy 00010000:00010000:3.0:1790772545.429590:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8a00/0x418ffb1c3bcc9439 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9440 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772545.429681:0:24258:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506317056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790772545.429744:0:24258:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772545.429872:0:24258:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc4c6b480 going to sleep for 11 seconds 00000100:00100000:2.0:1790772545.430358:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506317056 00000100:00100000:2.0:1790772545.430365:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506317056 00000100:00100000:2.0:1790772545.430497:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790772545.430507:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1189c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+18:24258:x1877760506317056:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790772545.430604:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1189c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+18:24258:x1877760506317056:12345-0@lo:501:mount.lustre.0 Request processed in 97us (859us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790772545.430611:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790772545.430677:0:24258:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506317056:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1790772545.430694:0:24258:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790772545.430712:0:24258:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790772545.430719:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8a00/0x418ffb1c3bcc9439 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9440 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772545.430729:0:24258:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8a00/0x418ffb1c3bcc9439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9440 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772545.430757:0:24258:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ecdfbb15000 10000000:01000000:3.0:1790772545.430762:0:24258:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790772545.430768:0:24258:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1790772545.430771:0:24258:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790772545.430775:0:24258:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1790772545.430777:0:24258:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790772545.430814:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0600/0x418ffb1c3bcc968c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772545.430824:0:24258:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0600/0x418ffb1c3bcc968c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772545.430833:0:24258:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0600/0x418ffb1c3bcc968c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772545.430848:0:24258:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506317184:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790772545.430876:0:24258:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772545.436508:0:24258:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc4c6b480 going to sleep for 11 seconds 00000100:00100000:0.0:1790772545.436907:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506317184 00000100:00100000:0.0:1790772545.436917:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506317184 00000100:00100000:0.0:1790772545.436967:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790772545.436977:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1188c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+18:24258:x1877760506317184:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790772545.436994:0:22749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772545.437011:0:22749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eccc1bd1c00/0x418ffb1c3bcc9693 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x418ffb1c3bcc968c expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.437052:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eccc1bd1c00/0x418ffb1c3bcc9693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x418ffb1c3bcc968c expref: 19 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.437063:0:22749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eccc1bd1c00/0x418ffb1c3bcc9693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc968c expref: 19 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.437072:0:22749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eccc1bd1c00, rc 0) 00000100:00100000:0.0:1790772545.437146:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1188c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+19:24258:x1877760506317184:12345-0@lo:101:mount.lustre.0 Request processed in 171us (6268us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772545.437153:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790772545.440847:0:24258:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506317184:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790772545.440880:0:24258:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0600/0x418ffb1c3bcc968c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9693 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772545.440892:0:24258:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0600/0x418ffb1c3bcc968c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc9693 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790772545.441935:0:24258:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:3.0:1790772545.442762:0:24258:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790772545.446888:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1790772545.446943:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1790772545.446958:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1790772545.446971:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1790772545.446985:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1790772545.447016:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1790772545.447032:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1790772545.447045:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1790772545.447057:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:3.0:1790772545.447070:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:3.0:1790772545.447083:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:3.0:1790772545.447097:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:3.0:1790772545.447123:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:3.0:1790772545.447128:0:24258:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:3.0:1790772545.447248:0:24258:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506317312:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790772545.447827:0:24258:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772545.447934:0:24258:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc4c6bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1790772545.448113:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506317312 00000100:00100000:1.0:1790772545.448121:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506317312 00000100:00100000:0.0:1790772545.448619:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790772545.448633:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf118ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+19:24258:x1877760506317312:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790772545.448824:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf118ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+19:24258:x1877760506317312:12345-0@lo:501:mount.lustre.0 Request processed in 195us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772545.448832:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790772545.450092:0:24258:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506317312:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790772545.450149:0:24258:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506317440:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790772545.450240:0:24258:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772545.454668:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506317440 00000100:00100000:1.0:1790772545.454685:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506317440 00000100:00100000:1.0:1790772545.454983:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790772545.454994:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf118b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+19:24258:x1877760506317440:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790772545.456118:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf118b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+19:24258:x1877760506317440:12345-0@lo:503:mount.lustre.0 Request processed in 1121us (5872us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772545.456128:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790772545.456356:0:24258:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc4c6bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1790772545.456381:0:24258:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506317440:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790772545.457467:0:24258:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790772545.457578:0:24258:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3e92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506317568:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790772545.457641:0:24258:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772545.457679:0:24258:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc73a0240 going to sleep for 11 seconds 00000100:00100000:1.0:1790772545.457966:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506317568 00000100:00100000:1.0:1790772545.457974:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506317568 00000100:00100000:1.0:1790772545.458019:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790772545.458235:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcba8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+19:24258:x1877760506317568:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790772545.458947:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcba8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+19:24258:x1877760506317568:12345-0@lo:502:mount.lustre.0 Request processed in 794us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772545.458955:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790772545.458963:0:24258:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3e92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506317568:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790772545.459353:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1790772545.459381:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1790772545.459397:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1790772545.459410:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1790772545.459424:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1790772545.459438:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1790772545.459452:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1790772545.459465:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1790772545.459480:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:2.0:1790772545.459492:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:2.0:1790772545.459506:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:2.0:1790772545.459534:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:2.0:1790772545.459565:0:24258:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3e92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506317696:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790772545.459606:0:24258:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772545.459644:0:24258:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc73a0240 going to sleep for 11 seconds 00000100:00100000:0.0:1790772545.460248:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506317696 00000100:00100000:0.0:1790772545.460255:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506317696 00000100:00100000:0.0:1790772545.460303:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790772545.460311:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcbaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+19:24258:x1877760506317696:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790772545.460692:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcbaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+19:24258:x1877760506317696:12345-0@lo:502:mount.lustre.0 Request processed in 381us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772545.460700:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790772545.465542:0:24258:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3e92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506317696:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790772545.465662:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:2.0:1790772545.465678:0:24258:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1790772545.467719:0:24275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790772545.467731:0:24275:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1790772545.467737:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772545.467740:0:24275:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1790772545.467753:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790772545.467769:0:24275:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9ecdf5e78000) 00000020:00000080:0.0:1790772545.467805:0:24275:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1790772545.467812:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790772545.467890:0:24275:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ecdfbb15000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1790772545.467899:0:24275:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790772545.467906:0:24275:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x418ffb1c3bcc96a1 00010000:00010000:1.0:1790772545.473013:0:24275:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1790772545.477392:0:24275:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:1.0:1790772545.479203:0:24275:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1790772545.480547:0:24275:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1790772545.480558:0:24275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790772545.480564:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772545.480566:0:24275:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1790772545.480569:0:24275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790772545.480571:0:24275:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1790772545.480573:0:24275:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790772545.480575:0:24275:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790772545.480576:0:24275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790772545.480578:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772545.480579:0:24275:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790772545.480581:0:24275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790772545.480584:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772545.480585:0:24275:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790772545.480587:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790772545.480589:0:24275:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790772545.480591:0:24275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790772545.480592:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772545.480593:0:24275:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1790772545.480596:0:24275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790772545.480597:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772545.480599:0:24275:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790772545.480602:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1790772545.480625:0:24275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790772545.480628:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772545.480629:0:24275:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790772545.480631:0:24275:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:0.0:1790772545.481032:0:24258:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1790772545.481062:0:24258:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1790772545.481085:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0600/0x418ffb1c3bcc968c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9693 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.481098:0:24258:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0600/0x418ffb1c3bcc968c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9693 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772545.481106:0:24258:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ecdfbb15000 from 1 10000000:01000000:0.0:1790772545.481109:0:24258:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790772545.481141:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd0a00/0x418ffb1c3bcc96a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.481151:0:24258:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd0a00/0x418ffb1c3bcc96a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.481162:0:24258:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd0a00/0x418ffb1c3bcc96a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772545.481215:0:24258:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec51c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506317824:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790772545.481285:0:24258:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772545.481319:0:24258:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc516ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1790772545.482400:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506317824 00000100:00100000:1.0:1790772545.482415:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506317824 00000100:00100000:1.0:1790772545.482473:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790772545.482483:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcbab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+19:24258:x1877760506317824:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790772545.482499:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772545.482517:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ecdef3a6000/0x418ffb1c3bcc96af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x418ffb1c3bcc96a8 expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772545.482543:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ecdef3a6000/0x418ffb1c3bcc96af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x418ffb1c3bcc96a8 expref: 20 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772545.482555:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ecdef3a6000/0x418ffb1c3bcc96af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc96a8 expref: 20 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772545.482564:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdef3a6000, rc 0) 00000100:00100000:1.0:1790772545.482627:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcbab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+20:24258:x1877760506317824:12345-0@lo:101:mount.lustre.0 Request processed in 145us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772545.482634:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790772545.482847:0:24258:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec51c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506317824:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790772545.482866:0:24258:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd0a00/0x418ffb1c3bcc96a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc96af expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.482881:0:24258:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd0a00/0x418ffb1c3bcc96a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc96af expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790772545.484969:0:24258:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1790772545.487401:0:24258:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790772545.487677:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1790772545.487704:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1790772545.487732:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1790772545.487749:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1790772545.487770:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1790772545.487784:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1790772545.487813:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1790772545.487826:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1790772545.487840:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1790772545.487852:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1790772545.487864:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1790772545.487879:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1790772545.487884:0:24258:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1790772545.487967:0:24258:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec51c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506317952:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790772545.488032:0:24258:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772545.488078:0:24258:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc516ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1790772545.490068:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506317952 00000100:00100000:1.0:1790772545.490081:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506317952 00000100:00100000:1.0:1790772545.490137:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790772545.490147:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcbaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+20:24258:x1877760506317952:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790772545.490345:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcbaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+20:24258:x1877760506317952:12345-0@lo:501:mount.lustre.0 Request processed in 199us (2312us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772545.490354:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790772545.490681:0:24258:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec51c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506317952:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790772545.490725:0:24258:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec51c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506318080:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790772545.490770:0:24258:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772545.490816:0:24258:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc516ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1790772545.490872:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506318080 00000100:00100000:1.0:1790772545.490877:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506318080 00000100:00100000:1.0:1790772545.490907:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790772545.490914:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcbab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+20:24258:x1877760506318080:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790772545.491005:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcbab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+20:24258:x1877760506318080:12345-0@lo:503:mount.lustre.0 Request processed in 90us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772545.491011:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790772545.491375:0:24258:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec51c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506318080:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790772545.491772:0:24258:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790772545.491852:0:24258:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec51c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506318208:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790772545.491893:0:24258:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772545.491925:0:24258:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc516ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1790772545.492026:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506318208 00000100:00100000:1.0:1790772545.492032:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506318208 00000100:00100000:1.0:1790772545.492068:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790772545.492075:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcba8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+20:24258:x1877760506318208:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790772545.492160:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcba8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+20:24258:x1877760506318208:12345-0@lo:502:mount.lustre.0 Request processed in 86us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772545.492191:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790772545.493024:0:24258:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec51c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506318208:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790772545.493253:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1790772545.494386:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1790772545.494416:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1790772545.494561:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1790772545.494596:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1790772545.494614:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1790772545.494628:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1790772545.494640:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1790772545.494653:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1790772545.494665:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1790772545.494677:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1790772545.494712:0:24258:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec51c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506318336:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790772545.494773:0:24258:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772545.496201:0:24258:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc516ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1790772545.500697:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506318336 00000100:00100000:1.0:1790772545.500711:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506318336 00000100:00100000:1.0:1790772545.500991:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790772545.501002:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcba8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+20:24258:x1877760506318336:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790772545.501265:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcba8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+20:24258:x1877760506318336:12345-0@lo:502:mount.lustre.0 Request processed in 265us (6491us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772545.501274:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790772545.502448:0:24258:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec51c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506318336:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790772545.502543:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1790772545.502558:0:24258:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1790772545.505012:0:24279:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790772545.505024:0:24279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772545.505027:0:24279:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790772545.505035:0:24279:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ecdfbb15000 00000020:00000080:0.0:1790772545.505037:0:24279:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790772545.505046:0:24279:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790772545.505048:0:24279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772545.505050:0:24279:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1790772545.505059:0:24279:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790772545.505062:0:24279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772545.505063:0:24279:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790772545.505066:0:24279:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ecdfbb15000 00000020:00000080:0.0:1790772545.505068:0:24279:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790772545.505180:0:24279:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790772545.505184:0:24279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772545.505185:0:24279:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1790772545.505188:0:24279:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790772545.505190:0:24279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772545.505192:0:24279:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790772545.505195:0:24279:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ecdfbb15000 00000020:00000080:0.0:1790772545.505197:0:24279:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790772545.512654:0:24279:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790772545.512678:0:24279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772545.512681:0:24279:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790772545.512685:0:24279:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790772545.512688:0:24279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772545.512690:0:24279:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1790772545.512694:0:24279:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ecdfbb15000 00000020:00000080:0.0:1790772545.512696:0:24279:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790772545.512755:0:24279:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790772545.512759:0:24279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772545.512760:0:24279:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1790772545.512764:0:24279:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1790772545.512932:0:24258:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1790772545.512960:0:24258:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790772545.512986:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd0a00/0x418ffb1c3bcc96a8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc96af expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772545.512999:0:24258:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd0a00/0x418ffb1c3bcc96a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc96af expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772545.513070:0:24258:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790772545.513073:0:24258:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ecdfbb15000 10000000:01000000:1.0:1790772545.513080:0:24258:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ecdfbb15000 10000000:01000000:1.0:1790772545.513084:0:24258:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790772545.513090:0:24258:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ecdfbb15000 from 1 10000000:01000000:1.0:1790772545.513093:0:24258:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790772545.513126:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdef3a6c00/0x418ffb1c3bcc96b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772545.513135:0:24258:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9ecdef3a6c00/0x418ffb1c3bcc96b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772545.513147:0:24258:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9ecdef3a6c00/0x418ffb1c3bcc96b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772545.513192:0:24258:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8093800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506318464:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790772545.513259:0:24258:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772545.513304:0:24258:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdd99db9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772545.513450:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506318464 00000100:00100000:2.0:1790772545.513458:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506318464 00000100:00100000:2.0:1790772545.513494:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790772545.513502:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcba9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+20:24258:x1877760506318464:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790772545.513516:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772545.513528:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ecdf4bd9a00/0x418ffb1c3bcc96bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x418ffb1c3bcc96b6 expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772545.513548:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ecdf4bd9a00/0x418ffb1c3bcc96bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x418ffb1c3bcc96b6 expref: 21 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772545.513566:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ecdf4bd9a00/0x418ffb1c3bcc96bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc96b6 expref: 21 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772545.513575:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdf4bd9a00, rc 0) 00000100:00100000:2.0:1790772545.513615:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcba9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:24258:x1877760506318464:12345-0@lo:101:mount.lustre.0 Request processed in 114us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772545.513623:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790772545.513779:0:24258:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8093800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506318464:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790772545.513803:0:24258:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9ecdef3a6c00/0x418ffb1c3bcc96b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc96bd expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772545.513813:0:24258:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9ecdef3a6c00/0x418ffb1c3bcc96b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc96bd expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790772545.525266:0:24258:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1790772545.525589:0:24258:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790772545.525773:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1790772545.525811:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1790772545.525825:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1790772545.525838:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1790772545.525850:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1790772545.525863:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1790772545.525875:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1790772545.525888:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1790772545.525901:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1790772545.525913:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1790772545.525925:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1790772545.525938:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1790772545.525950:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1790772545.525961:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1790772545.525973:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1790772545.525986:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1790772545.525999:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1790772545.526011:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1790772545.526024:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1790772545.526037:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1790772545.526050:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1790772545.526074:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1790772545.526087:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1790772545.526117:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1790772545.526131:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1790772545.526142:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1790772545.526154:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1790772545.526196:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1790772545.526213:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1790772545.526225:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1790772545.526238:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1790772545.526249:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1790772545.526259:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1790772545.526270:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1790772545.526279:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1790772545.526291:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1790772545.526303:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1790772545.526314:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1790772545.526327:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1790772545.526357:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1790772545.526371:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1790772545.526381:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1790772545.526392:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1790772545.526404:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1790772545.526415:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1790772545.526427:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1790772545.526439:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1790772545.526452:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1790772545.526561:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1790772545.526580:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1790772545.526597:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1790772545.526603:0:24258:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1790772545.526687:0:24258:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3e92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506318592:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790772545.526770:0:24258:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772545.528741:0:24258:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc89603c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772545.534533:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506318592 00000100:00100000:1.0:1790772545.534548:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506318592 00000100:00100000:1.0:1790772545.534612:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790772545.534622:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcba9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:24258:x1877760506318592:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790772545.534782:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcba9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:24258:x1877760506318592:12345-0@lo:501:mount.lustre.0 Request processed in 162us (8012us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772545.534809:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790772545.534962:0:24258:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3e92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506318592:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790772545.535005:0:24258:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3e92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506318720:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790772545.535047:0:24258:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772545.535085:0:24258:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc89603c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772545.535135:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506318720 00000100:00100000:1.0:1790772545.535140:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506318720 00000100:00100000:1.0:1790772545.535196:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1790772545.535203:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcbaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:24258:x1877760506318720:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790772545.535289:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcbaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:24258:x1877760506318720:12345-0@lo:503:mount.lustre.0 Request processed in 86us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772545.535297:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1790772545.535345:0:24258:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3e92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506318720:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790772545.535694:0:24258:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790772545.535769:0:24258:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8093800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506318848:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790772545.535816:0:24258:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772545.535831:0:24258:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdd99db9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772545.535844:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506318848 00000100:00100000:1.0:1790772545.535847:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506318848 00000100:00100000:1.0:1790772545.535867:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790772545.535873:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcbab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:24258:x1877760506318848:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790772545.535949:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcbab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:24258:x1877760506318848:12345-0@lo:502:mount.lustre.0 Request processed in 75us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772545.535957:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790772545.535993:0:24258:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8093800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506318848:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790772545.536144:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1790772545.536194:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1790772545.536210:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1790772545.536224:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1790772545.536248:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1790772545.536261:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1790772545.536274:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1790772545.536299:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1790772545.536314:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1790772545.536327:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1790772545.536340:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1790772545.536352:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1790772545.536365:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1790772545.536379:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1790772545.536393:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1790772545.536405:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1790772545.536418:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1790772545.536431:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1790772545.536444:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1790772545.536457:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1790772545.536468:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1790772545.536479:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1790772545.536492:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1790772545.536519:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1790772545.536543:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1790772545.536555:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1790772545.536566:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1790772545.536577:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1790772545.536588:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1790772545.536599:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1790772545.536611:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1790772545.536622:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1790772545.536633:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1790772545.536644:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1790772545.536655:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1790772545.536665:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1790772545.536676:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1790772545.536698:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1790772545.536710:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1790772545.536730:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1790772545.536745:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1790772545.536757:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1790772545.536767:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1790772545.536778:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1790772545.536803:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1790772545.536817:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1790772545.536828:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1790772545.536839:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1790772545.536869:0:24258:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8093800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506318976:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790772545.536907:0:24258:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772545.536925:0:24258:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdd99db9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772545.536944:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506318976 00000100:00100000:1.0:1790772545.536948:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506318976 00000100:00100000:1.0:1790772545.536976:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790772545.536982:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcba8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:24258:x1877760506318976:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790772545.537054:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcba8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:24258:x1877760506318976:12345-0@lo:502:mount.lustre.0 Request processed in 72us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772545.537061:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790772545.537103:0:24258:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8093800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506318976:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790772545.537236:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1790772545.537255:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1790772545.537274:0:24258:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8093800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506319104:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790772545.537306:0:24258:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772545.537319:0:24258:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdd99db9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772545.537330:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506319104 00000100:00100000:1.0:1790772545.537337:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506319104 00000100:00100000:1.0:1790772545.537356:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1790772545.537361:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcbabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:24258:x1877760506319104:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790772545.537415:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcbabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:24258:x1877760506319104:12345-0@lo:502:mount.lustre.0 Request processed in 53us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772545.537421:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1790772545.537456:0:24258:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8093800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506319104:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790772545.537486:0:24258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1790772545.537493:0:24258:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1790772545.552532:0:24284:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1790772545.552551:0:24284:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9ecdfa980000) 00000020:00000080:1.0:1790772545.552574:0:24284:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1790772545.552669:0:24284:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ecdfbb15000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790772545.552674:0:24284:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ecdfbb15000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790772545.552677:0:24284:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ecdfbb15000 3 00010000:00080000:1.0:1790772545.552708:0:24284:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9eccc26ac800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.114@tcp at head 00010000:00010000:1.0:1790772545.559252:0:24284:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1790772545.559461:0:24284:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1790772545.559500:0:24284:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790772545.559511:0:24284:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x418ffb1c3bcc96cb 00000100:00080000:1.0:1790772545.559520:0:24284:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790772545.559530:0:24284:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9eccc26ac800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:1.0:1790772545.559560:0:24284:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdf8093800 x1877760506319232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790772545.559598:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1877760506319232:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790772545.559656:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772545.559714:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506319232 00000100:00100000:1.0:1790772545.559726:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506319232 00000100:00100000:1.0:1790772545.559756:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790772545.559762:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf8092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1877760506319232:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1790772545.559783:0:22756:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 645 last 0 00000020:00000080:1.0:1790772545.559834:0:22756:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x418ffb1c3bcc96d2 00000004:00100000:1.0:1790772545.559847:0:22756:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790772545.559875:0:22756:0:(import.c:65:import_set_state_nolock()) ffff9eccc26a9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790772545.560265:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf8092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1877760506319232:12345-0@lo:38:llog_process_th.0 Request processed in 501us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772545.560284:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1790772545.560326:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ecdf8093800 x1877760506319232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790772555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772545.560337:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790772545.560344:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1790772545.560352:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790772545.560356:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790772545.560358:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9eccc26ac800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790772545.560363:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1877760506319232:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1790772545.560381:0:24284:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790772545.560401:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790772545.560406:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790772545.560408:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790772545.560412:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790772545.560415:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790772545.560435:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790772545.560438:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790772545.560441:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000004:1.0:1790772545.561696:0:24284:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1790772545.561713:0:24284:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9ecdfc590000) 00000020:00000080:1.0:1790772545.561732:0:24284:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1790772545.561832:0:24284:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ecdfbb15000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790772545.561836:0:24284:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ecdfbb15000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790772545.561839:0:24284:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ecdfbb15000 3 00010000:00080000:1.0:1790772545.561874:0:24284:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9eccc3078000@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.114@tcp at head 00010000:00010000:1.0:1790772545.564135:0:24284:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1790772545.576533:0:24284:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1790772545.576579:0:24284:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790772545.576591:0:24284:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x418ffb1c3bcc96e0 00000100:00080000:1.0:1790772545.576603:0:24284:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790772545.576615:0:24284:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9eccc3078000 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:1.0:1790772545.576650:0:24284:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdf8093800 x1877760506319360/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790772545.576686:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1877760506319360:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1790772545.577207:0:24284:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1790772545.577275:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790772545.577334:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790772545.577339:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790772545.577341:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790772545.577344:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790772545.577348:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790772545.577359:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790772545.577361:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790772545.577364:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790772545.578004:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506319360 00000100:00100000:1.0:1790772545.578013:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506319360 00000040:00080000:0.0:1790772545.578133:0:24284:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000100:00100000:1.0:1790772545.578593:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790772545.578600:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf8090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1877760506319360:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1790772545.578629:0:22757:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 645 last 0 00000020:00000080:1.0:1790772545.578670:0:22757:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x418ffb1c3bcc96e7 00000004:00100000:1.0:1790772545.578685:0:22757:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790772545.578716:0:22757:0:(import.c:65:import_set_state_nolock()) ffff9eccc26ad000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790772545.578847:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf8090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1877760506319360:12345-0@lo:38:llog_process_th.0 Request processed in 246us (1572us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772545.578854:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1790772545.578962:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ecdf8093800 x1877760506319360/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790772555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772545.578973:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790772545.578981:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1790772545.578986:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790772545.578990:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1790772545.578992:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9eccc3078000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790772545.578998:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1877760506319360:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1790772545.579099:0:24258:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1790772545.579129:0:24258:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790772545.579150:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdef3a6c00/0x418ffb1c3bcc96b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc96bd expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772545.579188:0:24258:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9ecdef3a6c00/0x418ffb1c3bcc96b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc96bd expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790772545.579231:0:24258:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790772545.579233:0:24258:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790772545.579234:0:24258:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790772545.579235:0:24258:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790772545.579237:0:24258:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790772545.579238:0:24258:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790772545.579239:0:24258:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790772545.579241:0:24258:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790772545.579242:0:24258:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790772545.579245:0:24258:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1790772545.579247:0:24258:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790772545.579249:0:24258:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790772545.579250:0:24258:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790772545.579251:0:24258:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790772545.579252:0:24258:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790772545.579254:0:24258:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790772545.579255:0:24258:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790772545.579256:0:24258:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790772545.579257:0:24258:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790772545.579274:0:24258:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1790772545.579288:0:24258:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8093800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506319488:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790772545.579326:0:24258:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772545.579352:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506319488 00000100:00100000:1.0:1790772545.579356:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506319488 00000100:00100000:1.0:1790772545.579384:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790772545.579391:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcbaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:24258:x1877760506319488:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790772545.579410:0:22749:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790772545.579961:0:22749:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1790772545.580251:0:24258:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdda0db540 going to sleep for 11 seconds 20000000:01000000:1.0:1790772545.586555:0:22749:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790772545.586584:0:22749:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1790772545.586679:0:22772:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790772545.586685:0:22772:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790772545.586706:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eccc1bd0800/0x418ffb1c3bcc96ee lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.586725:0:22772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ecdfbab0a00/0x418ffb1c3bcc9638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9631 expref: 21 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.586745:0:22772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ecdf4bd8600/0x418ffb1c3bcc9646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc963f expref: 21 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.586753:0:22772:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eccc1bd0800/0x418ffb1c3bcc96ee lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.586800:0:22772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ecdf4bd8600/0x418ffb1c3bcc9646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x418ffb1c3bcc963f expref: 21 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.586814:0:22772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ecdf4bd8600/0x418ffb1c3bcc9646 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x418ffb1c3bcc963f expref: 21 pid: 22751 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772545.586828:0:22772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec51c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22772:1877760506319616:0@lo:104: 00000100:00100000:0.0:1790772545.586892:0:22772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790772545.586947:0:22772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ecdfbab0a00/0x418ffb1c3bcc9638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x418ffb1c3bcc9631 expref: 21 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.586955:0:22772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ecdfbab0a00/0x418ffb1c3bcc9638 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x418ffb1c3bcc9631 expref: 21 pid: 22749 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772545.586963:0:22772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80e9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22772:1877760506319744:0@lo:104: 00000100:00100000:0.0:1790772545.586987:0:22772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772545.587003:0:22772:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecde10c3180 going to sleep for 11 seconds 00000100:00100000:0.0:1790772545.587026:0:22739:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790772545.587039:0:22739:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506319616 00000100:00100000:0.0:1790772545.587045:0:22739:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506319616 00000100:00100000:0.0:1790772545.587072:0:22739:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506319744 00000100:00100000:0.0:1790772545.587074:0:22739:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506319744 00000100:00100000:0.0:1790772545.587086:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790772545.587100:0:22739:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf80e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+4:22772:x1877760506319616:12345-0@lo:104: 00010000:00010000:0.0:1790772545.587112:0:22739:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1c00/0x418ffb1c3bcc963f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x418ffb1c3bcc9646 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.587157:0:22739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790772545.587700:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcbaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:24258:x1877760506319488:12345-0@lo:253:mount.lustre.0 Request processed in 8308us (8372us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772545.587710:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790772545.587756:0:24258:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8093800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:24258:1877760506319488:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790772545.587767:0:24258:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1790772545.587770:0:24258:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790772545.587772:0:24258:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790772545.587773:0:24258:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790772545.587774:0:24258:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790772545.587775:0:24258:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790772545.587777:0:24258:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790772545.587778:0:24258:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790772545.587780:0:24258:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790772545.587781:0:24258:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790772545.587805:0:24258:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1790772545.588585:0:22739:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf80e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+4:22772:x1877760506319616:12345-0@lo:104: Request processed in 64us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772545.588596:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790772545.588615:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790772545.588622:0:22739:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf720e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+3:22772:x1877760506319744:12345-0@lo:104: 00010000:00010000:0.0:1790772545.588633:0:22739:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9800/0x418ffb1c3bcc9631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x418ffb1c3bcc9638 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.588680:0:22739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790772545.588686:0:22739:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf720e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+3:22772:x1877760506319744:12345-0@lo:104: Request processed in 66us (1699us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772545.588691:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1790772545.588723:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790772545.588729:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1c00/0x418ffb1c3bcc963f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x418ffb1c3bcc9646 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.588736:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdfbab1c00 already unused, calling callback (ffffffffc11ffc20) 10000000:00010000:0.0:1790772545.588740:0:22744:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1c00/0x418ffb1c3bcc963f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x418ffb1c3bcc9646 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.588749:0:22744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1c00/0x418ffb1c3bcc963f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x418ffb1c3bcc9646 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790772545.588756:0:22744:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1c00/0x418ffb1c3bcc963f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x418ffb1c3bcc9646 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772545.588768:0:22744:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790772545.588805:0:22744:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1c00/0x418ffb1c3bcc963f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc9646 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.588812:0:22744:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790772545.588829:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1c00/0x418ffb1c3bcc963f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc9646 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.588836:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab1c00/0x418ffb1c3bcc963f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc9646 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.588847:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772545.588850:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9800/0x418ffb1c3bcc9631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x418ffb1c3bcc9638 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.588855:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf4bd9800 already unused, calling callback (ffffffffc11ffc20) 10000000:00010000:0.0:1790772545.588859:0:22744:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9800/0x418ffb1c3bcc9631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x418ffb1c3bcc9638 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.588866:0:22744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9800/0x418ffb1c3bcc9631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x418ffb1c3bcc9638 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790772545.588872:0:22744:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9800/0x418ffb1c3bcc9631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x418ffb1c3bcc9638 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772545.588877:0:22744:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790772545.588885:0:22744:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9800/0x418ffb1c3bcc9631 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc9638 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.588890:0:22744:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790772545.588903:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9800/0x418ffb1c3bcc9631 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc9638 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.588909:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9800/0x418ffb1c3bcc9631 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc9638 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.588921:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772545.588923:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772545.588924:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772545.588931:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772545.588945:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3645:1877760506319872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790772545.588977:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772545.589008:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790772545.589014:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3645:1877760506320000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790772545.589034:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772545.589065:0:22742:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506319872 00000100:00100000:0.0:1790772545.589070:0:22742:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506319872 00010000:00010000:0.0:1790772545.589089:0:22742:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ecdf4bd8600/0x418ffb1c3bcc9646 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x418ffb1c3bcc963f expref: 21 pid: 22751 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772545.589109:0:22742:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506320000 00000100:00100000:0.0:1790772545.589111:0:22742:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506320000 00010000:00010000:0.0:1790772545.589122:0:22742:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ecdfbab0a00/0x418ffb1c3bcc9638 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x418ffb1c3bcc9631 expref: 22 pid: 22749 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772545.589133:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790772545.589139:0:22742:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf80e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+22:3645:x1877760506319872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790772545.589150:0:22742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772545.589155:0:22742:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ecdf4bd8600/0x418ffb1c3bcc9646 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x418ffb1c3bcc963f expref: 22 pid: 22751 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.589197:0:22742:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ecdf4bd8600/0x418ffb1c3bcc9646 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x418ffb1c3bcc963f expref: 22 pid: 22751 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.589212:0:22742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772545.589238:0:22742:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf80e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+22:3645:x1877760506319872:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772545.589244:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790772545.589256:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790772545.589261:0:22742:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfb40d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:3645:x1877760506320000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790772545.589268:0:22742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772545.589340:0:22742:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ecdfbab0a00/0x418ffb1c3bcc9638 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x418ffb1c3bcc9631 expref: 21 pid: 22749 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.589350:0:22742:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ecdfbab0a00/0x418ffb1c3bcc9638 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x418ffb1c3bcc9631 expref: 21 pid: 22749 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.589363:0:22742:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eccc1bd0800/0x418ffb1c3bcc96ee lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.589370:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eccc1bd0800/0x418ffb1c3bcc96ee lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790772545.589385:0:22742:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009740906s 00010000:00010000:0.0:1790772545.589389:0:22742:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eccc1bd0800/0x418ffb1c3bcc96ee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.589395:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eccc1bd0800/0x418ffb1c3bcc96ee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.589410:0:22742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eccc1bd0800/0x418ffb1c3bcc96ee lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.589416:0:22742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eccc1bd0800/0x418ffb1c3bcc96ee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.589532:0:22742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc1bd0800 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:0.0:1790772545.589537:0:22742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eccc1bd0800/0x418ffb1c3bcc96ee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.589545:0:22742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eccc1bd0800/0x418ffb1c3bcc96ee lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.589554:0:22742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eccc1bd0800/0x418ffb1c3bcc96ee lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.589564:0:22742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772545.589586:0:22742:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfb40d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:3645:x1877760506320000:12345-0@lo:103:ldlm_bl.0 Request processed in 325us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772545.589592:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790772545.589654:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3645:1877760506320000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790772545.589662:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3645:1877760506319872:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790772545.589689:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ecdf4bd8600/0x418ffb1c3bcc9646 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x418ffb1c3bcc963f expref: 20 pid: 22751 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772545.589699:0:22772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec51c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22772:1877760506319616:0@lo:104: 00010000:00010000:0.0:1790772545.589708:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ecdfbab0a00/0x418ffb1c3bcc9638 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x418ffb1c3bcc9631 expref: 19 pid: 22749 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772545.589722:0:22772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80e9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22772:1877760506319744:0@lo:104: 00010000:00010000:0.0:1790772545.589736:0:22772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eccc1bd0800/0x418ffb1c3bcc96ee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.589745:0:22772:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eccc1bd0800/0x418ffb1c3bcc96ee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.589751:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eccc1bd0800/0x418ffb1c3bcc96ee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772545.589757:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eccc1bd0800/0x418ffb1c3bcc96ee lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1790772545.600859:0:24258:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1790772545.605099:0:24258:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1790772545.605109:0:24258:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1790772545.605148:0:24258:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790772545.605842:0:24258:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.114@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790772545.605871:0:24258:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1790772545.605964:0:24258:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1790772545.606652:0:24258:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790772545.607093:0:24258:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790772545.684345:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790772546.069607:0:22792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:2.0:1790772546.695694:0:24338:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790772546.698817:0:24338:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790772546.710042:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790772546.969407:0:22754:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790772546.969417:0:22754:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ecde1727000 from 13 10000000:01000000:3.0:1790772546.969459:0:22754:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790772546.969515:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0200/0x418ffb1c3bcc96f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772546.969529:0:22754:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0200/0x418ffb1c3bcc96f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772546.969550:0:22754:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0200/0x418ffb1c3bcc96f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772546.969582:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506320128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790772546.969669:0:22754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772546.969717:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdef0fa840 going to sleep for 11 seconds 00000100:00100000:1.0:1790772546.972407:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506320128 00000100:00100000:1.0:1790772546.972420:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506320128 00000100:00100000:1.0:1790772546.972515:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1790772546.972525:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcba9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+19:22754:x1877760506320128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772546.972546:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772546.972569:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ecdef3a7e00/0x418ffb1c3bcc96fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x418ffb1c3bcc96f5 expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772546.972601:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ecdef3a7e00/0x418ffb1c3bcc96fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x418ffb1c3bcc96f5 expref: 20 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772546.972613:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ecdef3a7e00/0x418ffb1c3bcc96fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc96f5 expref: 20 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772546.972633:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdef3a7e00, rc 0) 00000100:00100000:1.0:1790772546.972720:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcba9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+20:22754:x1877760506320128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (3050us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772546.972728:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790772546.985441:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506320128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772546.985628:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0200/0x418ffb1c3bcc96f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc96fc expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772546.985643:0:22754:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0200/0x418ffb1c3bcc96f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc96fc expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772546.985740:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506320256:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1790772546.985905:0:22754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772546.985947:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506320256 00000100:00100000:3.0:1790772546.985949:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdef0fa840 going to sleep for 11 seconds 00000100:00100000:1.0:1790772546.985956:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506320256 00000100:00100000:1.0:1790772546.986014:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1790772546.986024:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcba9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+20:22754:x1877760506320256:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1790772546.986062:0:22749:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790772546.986083:0:22749:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790772546.986086:0:22749:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1790772546.986214:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcba9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+20:22754:x1877760506320256:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 191us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772546.986223:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1790772546.986274:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506320256:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790772546.986340:0:22754:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790772546.986349:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0200/0x418ffb1c3bcc96f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc96fc expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772546.986359:0:22754:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0200/0x418ffb1c3bcc96f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc96fc expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772546.986370:0:22754:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790772546.986373:0:22754:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ecdfb45f000 from 13 10000000:01000000:1.0:1790772546.986377:0:22754:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790772546.986404:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdef3a7400/0x418ffb1c3bcc9703 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772546.986419:0:22754:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9ecdef3a7400/0x418ffb1c3bcc9703 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772546.986430:0:22754:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9ecdef3a7400/0x418ffb1c3bcc9703 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772546.986444:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8093800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506320384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790772546.986472:0:22754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772546.986488:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecde012bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790772546.986503:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506320384 00000100:00100000:1.0:1790772546.986507:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506320384 00000100:00100000:1.0:1790772546.986532:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1790772546.986656:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+20:22754:x1877760506320384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772546.986668:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772546.986682:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ecdef3a7800/0x418ffb1c3bcc970a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x418ffb1c3bcc9703 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772546.986704:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ecdef3a7800/0x418ffb1c3bcc970a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9703 expref: 21 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772546.986714:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ecdef3a7800/0x418ffb1c3bcc970a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9703 expref: 21 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772546.986722:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdef3a7800, rc 0) 00000100:00100000:1.0:1790772546.986752:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:22754:x1877760506320384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 214us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772546.986758:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1790772546.986811:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8093800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506320384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772546.986823:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9ecdef3a7400/0x418ffb1c3bcc9703 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc970a expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772546.986831:0:22754:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9ecdef3a7400/0x418ffb1c3bcc9703 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc970a expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772546.986870:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8093800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506320512:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790772546.986900:0:22754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772546.987284:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdeedebf00 going to sleep for 11 seconds 00000100:00100000:1.0:1790772546.987301:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506320512 00000100:00100000:1.0:1790772546.987306:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506320512 00000100:00100000:1.0:1790772546.987338:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1790772546.987345:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:22754:x1877760506320512:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1790772546.987359:0:22750:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790772546.987378:0:22750:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790772546.987380:0:22750:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1790772546.987463:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:22754:x1877760506320512:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772546.987471:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1790772546.987507:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8093800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506320512:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790772546.987686:0:22754:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790772546.987695:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdef3a7400/0x418ffb1c3bcc9703 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc970a expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772546.987704:0:22754:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9ecdef3a7400/0x418ffb1c3bcc9703 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc970a expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772547.734037:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772548.767644:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772548.884416:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790772548.884435:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1877760506320640:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790772548.884500:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772548.884548:0:23497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506320640 00000100:00100000:0.0:1790772548.884556:0:23497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506320640 00000100:00100000:0.0:1790772548.884595:0:23497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790772548.884604:0:23497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf80e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1877760506320640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790772548.884644:0:23497:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1790772548.884691:0:23497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf80e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1877760506320640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772548.884712:0:23497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790772548.884762:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1877760506320640:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790772548.885586:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1877760506320768:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790772548.885620:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772548.894573:0:22761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506320768 00000100:00100000:1.0:1790772548.894586:0:22761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506320768 00000100:00100000:1.0:1790772548.894645:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790772548.894655:0:22761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf80e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877760506320768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790772548.894690:0:22761:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790772548.894788:0:22761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf80e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877760506320768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (9166us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772548.894796:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790772548.894892:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1877760506320768:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1790772549.786529:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790772550.036934:0:23514:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790772550.804496:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790772550.932775:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790772550.932781:0:19463:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790772550.932784:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790772550.932787:0:19463:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790772550.932812:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790772550.932815:0:19463:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790772550.932817:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790772550.932820:0:19463:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790772550.932854:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877760506321152:0@lo:400:kworker.0 00000100:00100000:2.0:1790772550.932916:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772550.932974:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3e90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1877760506321664:0@lo:400:kworker.0 00000100:00100000:2.0:1790772550.933000:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772550.933040:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790772550.933055:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3e91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506321280:0@lo:400:kworker.0 00000100:00100000:2.0:1790772550.933104:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772550.933143:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506321152 00000100:00100000:2.0:1790772550.933151:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506321152 00000100:00100000:2.0:1790772550.933204:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506321664 00000100:00100000:2.0:1790772550.933208:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506321664 00000100:00100000:2.0:1790772550.933232:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790772550.933240:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877760506321152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772550.933292:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877760506321152:12345-0@lo:400:kworker.0 Request processed in 53us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772550.933314:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790772550.933334:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790772550.933341:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877760506321664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772550.933371:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877760506321664:12345-0@lo:400:kworker.0 Request processed in 31us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772550.933376:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790772550.933398:0:22762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506321280 00000100:00100000:2.0:1790772550.933401:0:22762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506321280 00000100:00100000:2.0:1790772550.933423:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790772550.933429:0:22762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3e90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506321280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772550.933460:0:22762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3e90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506321280:12345-0@lo:400:kworker.0 Request processed in 31us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772550.933466:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790772550.933504:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3e91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506321280:0@lo:400:kworker.0 00010000:00080000:2.0:1790772550.933517:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eccc3e92d80 x1877760506321152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772550.933526:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877760506321152:0@lo:400:kworker.0 00010000:00080000:2.0:1790772550.933545:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eccc3e90e00 x1877760506321664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772550.933554:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3e90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1877760506321664:0@lo:400:kworker.0 00000100:00100000:3.0:1790772550.933706:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3e90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3645:1877760506320896:0@lo:400:kworker.0 00000100:00100000:3.0:1790772550.933742:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772550.933791:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3e92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1877760506321408:0@lo:400:kworker.0 00000100:00100000:3.0:1790772550.933818:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772550.933835:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790772550.933841:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506321024:0@lo:400:kworker.0 00000100:00100000:3.0:1790772550.933860:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772550.933892:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1877760506321536:0@lo:400:kworker.0 00000100:00100000:3.0:1790772550.933914:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772550.933982:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506320896 00000100:00100000:2.0:1790772550.933986:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506320896 00000100:00100000:2.0:1790772550.934021:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790772550.934029:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:3645:x1877760506320896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772550.934063:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:3645:x1877760506320896:12345-0@lo:400:kworker.0 Request processed in 36us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772550.934070:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790772550.934097:0:23497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506321024 00000100:00100000:2.0:1790772550.934100:0:23497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506321024 00000100:00100000:2.0:1790772550.934122:0:23497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790772550.934127:0:23497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc12af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1877760506321024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772550.934157:0:23497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc12af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1877760506321024:12345-0@lo:400:kworker.0 Request processed in 30us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772550.934178:0:23497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790772550.934195:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506321408 00000100:00100000:2.0:1790772550.934198:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506321408 00000100:00100000:2.0:1790772550.934214:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506321536 00000100:00100000:2.0:1790772550.934217:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506321536 00000100:00100000:2.0:1790772550.934229:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790772550.934235:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc12aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1877760506321408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772550.934263:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc12aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1877760506321408:12345-0@lo:400:kworker.0 Request processed in 28us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772550.934269:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790772550.934287:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790772550.934292:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc12ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1877760506321536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772550.934386:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc12ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1877760506321536:12345-0@lo:400:kworker.0 Request processed in 93us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772550.934393:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790772550.935447:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506321024:0@lo:400:kworker.0 00010000:00080000:3.0:1790772550.935462:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eccc3e93800 x1877760506321536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772550.935471:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1877760506321536:0@lo:400:kworker.0 00000100:00100000:3.0:1790772550.935480:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3e90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3645:1877760506320896:0@lo:400:kworker.0 00010000:00080000:3.0:1790772550.935490:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eccc3e92a00 x1877760506321408/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772550.935498:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3e92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1877760506321408:0@lo:400:kworker.0 00000100:00080000:1.0:1790772550.935598:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790772550.935602:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1790772551.832953:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790772552.387356:0:24629:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg614-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790772552.853407:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790772553.418765:0:24681:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790772553.418963:0:24681:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1790772553.748260:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790772538/real 1790772538] req@ffff9ecdeec51180 x1877760506314240/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790772553 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772553.748291:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ecdeec51180 x1877760506314240/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790772553 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772553.748302:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790772538/real 1790772538] req@ffff9ecdeec51500 x1877760506314368/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790772553 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772553.748313:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ecdeec51500 x1877760506314368/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790772553 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790772553.748332:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9eccc3cac800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790772553.748352:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790772553.748356:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1877760506314240:0@lo:8:kworker.0 00000100:00080000:0.0:1790772553.748361:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ecdf8089800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790772553.748366:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790772553.748369:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1877760506314368:0@lo:8:kworker.0 00000100:00080000:2.0:1790772553.748523:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790772553.748528:0:19463:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790772553.748530:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790772553.748533:0:19463:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790772553.748547:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790772553.748550:0:19463:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1790772553.748553:0:19463:0:(import.c:65:import_set_state_nolock()) ffff9eccc3cac800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790772553.748557:0:19463:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 638 00000100:00080000:2.0:1790772553.748562:0:19463:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790772553.748572:0:19463:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9eccc3cac800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:2.0:1790772553.748590:0:19463:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eccc3e90000 x1877760506322304/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790772553.748602:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790772553.748604:0:19463:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790772553.748606:0:19463:0:(import.c:65:import_set_state_nolock()) ffff9ecdf8089800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790772553.748609:0:19463:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 638 00000100:00080000:2.0:1790772553.748611:0:19463:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790772553.748615:0:19463:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ecdf8089800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:2.0:1790772553.748624:0:19463:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eccc3e92680 x1877760506322432/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790772553.748752:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506321920:0@lo:400:kworker.0 00000100:00100000:1.0:1790772553.748809:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772553.748851:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3e90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1877760506322688:0@lo:400:kworker.0 00000100:00100000:1.0:1790772553.748873:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772553.748908:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790772553.748914:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3e91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1877760506322048:0@lo:400:kworker.0 00000100:00100000:1.0:1790772553.748936:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772553.748954:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1877760506322816:0@lo:400:kworker.0 00000100:00100000:1.0:1790772553.748974:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772553.749003:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506322688 00000100:00100000:1.0:1790772553.749015:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506322688 00000100:00100000:1.0:1790772553.749052:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506322048 00000100:00100000:1.0:1790772553.749054:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506322048 00000100:00100000:1.0:1790772553.749063:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506322816 00000100:00100000:1.0:1790772553.749065:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506322816 00000100:00100000:1.0:1790772553.749079:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790772553.749088:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf8093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1877760506322688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772553.749134:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf8093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1877760506322688:12345-0@lo:400:kworker.0 Request processed in 47us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772553.749141:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790772553.749155:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790772553.749160:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf8092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1877760506322048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772553.749213:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf8092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1877760506322048:12345-0@lo:400:kworker.0 Request processed in 54us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772553.749219:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790772553.749230:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790772553.749242:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf8091880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1877760506322816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772553.749275:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf8091880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1877760506322816:12345-0@lo:400:kworker.0 Request processed in 39us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772553.749281:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1790772553.749306:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790772553.749310:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790772553.749331:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eccc3e91880 x1877760506322048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772553.749342:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3e91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1877760506322048:0@lo:400:kworker.0 00010000:00080000:1.0:1790772553.749352:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eccc3e93800 x1877760506322816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772553.749373:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1877760506322816:0@lo:400:kworker.0 00010000:00080000:1.0:1790772553.749385:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eccc3e90380 x1877760506322688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772553.749392:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3e90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1877760506322688:0@lo:400:kworker.0 00000100:00100000:3.0:1790772553.749497:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3e90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3644:1877760506321792:0@lo:400:kworker.0 00000100:00100000:0.0:1790772553.749580:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3e91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506322176:0@lo:400:kworker.0 00000100:00100000:1.0:1790772553.749648:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1877760506322304:0@lo:8:kworker.0 00000100:00100000:2.0:1790772553.749702:0:22761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506321920 00000100:00100000:2.0:1790772553.749707:0:22761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506321920 00000100:00100000:2.0:1790772553.749738:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790772553.749757:0:22761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf8093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1877760506321920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772553.754546:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772553.754652:0:22762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506322176 00000100:00100000:0.0:1790772553.754664:0:22762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506322176 00000100:00100000:0.0:1790772553.754764:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790772553.754774:0:22762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf80ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506322176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772553.754837:0:22762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf80ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506322176:12345-0@lo:400:kworker.0 Request processed in 65us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772553.754845:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790772553.754915:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3e91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506322176:0@lo:400:kworker.0 00000100:00100000:1.0:1790772553.758625:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772553.758692:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1877760506322432:0@lo:8:kworker.0 00000100:00100000:1.0:1790772553.758725:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772553.759017:0:24262:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506322304 00000100:00100000:2.0:1790772553.759025:0:24262:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506322304 00000100:00100000:2.0:1790772553.759062:0:24262:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506322432 00000100:00100000:2.0:1790772553.759066:0:24262:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506322432 00000100:00100000:2.0:1790772553.759079:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790772553.759086:0:24262:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf8091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1877760506322304:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1790772553.759116:0:24262:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 654 last 0 00000020:00000080:2.0:1790772553.759144:0:24262:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x418ffb1c3bcc9711 00002000:00100000:2.0:1790772553.759157:0:24262:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9eccc3750000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b03 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1790772553.759161:0:24262:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1790772553.759190:0:24262:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790772553.759404:0:24262:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00100000:0.0:1790772553.759861:0:22761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf8093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1877760506321920:12345-0@lo:400:kworker.0 Request processed in 10113us (11049us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772553.759871:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790772553.760036:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506321920:0@lo:400:kworker.0 00000100:00080000:2.0:1790772553.760508:0:24262:0:(import.c:65:import_set_state_nolock()) ffff9eccc3753000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790772553.760556:0:24262:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf8091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1877760506322304:12345-0@lo:8:kworker.0 Request processed in 1470us (1939us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772553.760564:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790772553.760580:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790772553.760585:0:24262:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf8093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1877760506322432:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1790772553.760601:0:24262:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1790772553.761026:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eccc3e90000 x1877760506322304/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790772573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772553.761036:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790772553.761043:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1790772553.761049:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790772553.761054:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1790772553.761056:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9eccc3cac800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790772553.761079:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790772553.761083:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1877760506322304:0@lo:8:kworker.0 00000004:00080000:1.0:1790772553.761107:0:23498:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1790772553.761196:0:23498:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 654060029946ns, next at 0ns, rc = 0 00080000:00080000:1.0:1790772553.761201:0:23498:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1790772553.761517:0:23499:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1790772553.761533:0:23499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80ead80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23499:1877760506323072:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1790772553.761569:0:23499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772553.761585:0:23499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc4c6b480 going to sleep for 11 seconds 00000100:00100000:1.0:1790772553.762563:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506322944:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790772553.762616:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772553.762668:0:24264:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1790772553.762675:0:24264:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1790772553.763018:0:24266:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506322944 00000100:00100000:0.0:1790772553.763026:0:24266:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506322944 00000100:00100000:0.0:1790772553.763073:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790772553.763081:0:24266:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf8091c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1877760506322944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790772553.763107:0:24266:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1790772553.763153:0:24266:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf8091c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1877760506322944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772553.763160:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790772553.763214:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ecdf80e9500 x1877760506322944/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772569 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772553.763232:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506322944:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1790772553.763250:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1790772553.765558:0:23489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1790772553.765996:0:24264:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506323072 00000100:00100000:0.0:1790772553.766006:0:24264:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506323072 00000100:00100000:3.0:1790772553.766035:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772553.766089:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506321792 00000100:00100000:3.0:1790772553.766094:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506321792 00000100:00100000:3.0:1790772553.766134:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790772553.766143:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:3644:x1877760506321792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772553.766297:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:3644:x1877760506321792:12345-0@lo:400:kworker.0 Request processed in 156us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772553.766320:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790772553.766375:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3e90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3644:1877760506321792:0@lo:400:kworker.0 00000100:00100000:3.0:1790772553.766386:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3e92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877760506322560:0@lo:400:kworker.0 00000100:00100000:3.0:1790772553.766415:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772553.766436:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506322560 00000100:00100000:3.0:1790772553.766440:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506322560 00000100:00100000:3.0:1790772553.766462:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790772553.766468:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc12ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877760506322560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772553.766496:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc12ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877760506322560:12345-0@lo:400:kworker.0 Request processed in 28us (80us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772553.766501:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1790772553.766526:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eccc3e92a00 x1877760506322560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772553.766537:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3e92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877760506322560:0@lo:400:kworker.0 00000100:00100000:1.0:1790772553.767126:0:24695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790772553.767137:0:24695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf80e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23499:x1877760506323072:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:1.0:1790772553.790764:0:24695:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1790772553.790773:0:24695:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1790772553.790870:0:24695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf80e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23499:x1877760506323072:12345-0@lo:7:osp-pre-0-1.0 Request processed in 23733us (29297us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772553.790880:0:24695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790772553.790977:0:23499:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ecdf80ead80 x1877760506323072/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790772569 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772553.790991:0:23499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80ead80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23499:1877760506323072:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1790772553.791003:0:23499:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:3.0:1790772553.791037:0:23499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12aed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23499:1877760506323200:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1790772553.791065:0:23499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772553.791093:0:23499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc5229cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772553.792350:0:24264:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506323200 00000100:00100000:1.0:1790772553.792360:0:24264:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506323200 00000100:00100000:1.0:1790772553.792416:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790772553.792424:0:24264:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc12af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23499:x1877760506323200:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1790772553.792450:0:24264:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1790772553.792505:0:24264:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc12af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23499:x1877760506323200:12345-0@lo:5:osp-pre-0-1.0 Request processed in 81us (1437us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772553.792511:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1790772553.792548:0:23499:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ecdc12aed80 x1877760506323200/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790772569 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772553.792559:0:23499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12aed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23499:1877760506323200:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1790772553.792581:0:23499:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1790772553.792612:0:23499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8091f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23499:1877760506323328:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1790772553.792657:0:23499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772553.792674:0:23499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdd82b0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772553.792686:0:24695:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506323328 00000100:00100000:1.0:1790772553.792690:0:24695:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506323328 00000100:00100000:1.0:1790772553.792714:0:24695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790772553.792720:0:24695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7525c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23499:x1877760506323328:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1790772553.792753:0:24695:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:2.0:1790772553.805335:0:24262:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf8093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1877760506322432:12345-0@lo:8:kworker.0 Request processed in 44742us (46603us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790772553.805360:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1790772553.805410:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ecdf8089800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790772553.805416:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790772553.805420:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1877760506322432:0@lo:8:kworker.0 00000001:00080000:3.0:1790772553.822100:0:24259:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:3.0:1790772553.822117:0:24259:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1790772553.822349:0:24695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7525c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23499:x1877760506323328:12345-0@lo:5:osp-pre-0-1.0 Request processed in 29624us (29687us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1790772553.822360:0:24695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1790772553.822399:0:23499:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ecdf8091f80 x1877760506323328/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790772569 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772553.822423:0:23499:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1790772553.822430:0:23499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8091f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23499:1877760506323328:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1790772553.822444:0:23499:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:3.0:1790772553.822493:0:23499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12ac700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23499:1877760506323456:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1790772553.822528:0:23499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772553.822657:0:23499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc52290c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772553.827448:0:22767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506323456 00000100:00100000:0.0:1790772553.827463:0:22767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506323456 00000100:00100000:0.0:1790772553.827511:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790772553.827520:0:22767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc12ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23499:x1877760506323456:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1790772553.827844:0:22767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc12ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23499:x1877760506323456:12345-0@lo:900:osp-pre-0-1.0 Request processed in 324us (5314us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772553.827853:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790772553.828077:0:23499:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ecdc12ac700 x1877760506323456/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790772569 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772553.828093:0:23499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12ac700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23499:1877760506323456:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1790772553.878761:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772554.004488:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790772554.004510:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf7526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1877760506323584:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790772554.004588:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772554.004638:0:22762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506323584 00000100:00100000:1.0:1790772554.004646:0:22762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506323584 00000100:00100000:1.0:1790772554.004694:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790772554.004703:0:22762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1877760506323584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790772554.004756:0:22762:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790772554.004838:0:22762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1877760506323584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772554.004844:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790772554.004892:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf7526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1877760506323584:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790772554.017780:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790772554.017800:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1877760506323712:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790772554.017863:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772554.017944:0:22761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506323712 00000100:00100000:2.0:1790772554.017952:0:22761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506323712 00000100:00100000:2.0:1790772554.017999:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790772554.018009:0:22761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf80e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1877760506323712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790772554.018039:0:22761:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1790772554.018127:0:22761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf80e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1877760506323712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772554.018134:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790772554.018203:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1877760506323712:0@lo:41:osp-pre-0-1.0 00000020:00000004:3.0:1790772554.463995:0:24732:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790772554.464375:0:24732:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790772554.901542:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772555.924449:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790772556.374703:0:22792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790772556.955452:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772557.973836:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772558.997030:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772559.124551:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1877760506323840:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790772559.124608:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790772559.124658:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1877760506323968:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1790772559.124770:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790772559.124775:0:19463:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790772559.124777:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790772559.124780:0:19463:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790772559.124797:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790772559.124800:0:19463:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790772559.124803:0:19463:0:(import.c:65:import_set_state_nolock()) ffff9ecdf8089800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790772559.124822:0:19463:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 654 00000100:00100000:1.0:1790772559.124856:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506324480:0@lo:400:kworker.0 00000100:00080000:0.0:1790772559.124890:0:19463:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1790772559.124900:0:19463:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ecdf8089800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:0.0:1790772559.124918:0:19463:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdf80eb100 x1877760506324736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790772559.125859:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772559.125942:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1877760506324352:0@lo:400:kworker.0 00000100:00100000:3.0:1790772559.126005:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772559.126024:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1877760506324992:0@lo:400:kworker.0 00000100:00100000:3.0:1790772559.126044:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772559.126059:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1790772559.126065:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1877760506324224:0@lo:400:kworker.0 00000100:00100000:3.0:1790772559.126084:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772559.126105:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1877760506324864:0@lo:400:kworker.0 00000100:00100000:3.0:1790772559.126125:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772559.126191:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1877760506324736:0@lo:8:kworker.0 00000100:00100000:0.0:1790772559.126351:0:23497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506323840 00000100:00100000:0.0:1790772559.126365:0:23497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506323840 00000100:00100000:0.0:1790772559.126401:0:23497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506324224 00000100:00100000:0.0:1790772559.126403:0:23497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506324224 00000100:00100000:0.0:1790772559.126419:0:23497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790772559.126440:0:23497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc12adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1877760506323840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790772559.126475:0:23497:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1790772559.126542:0:23497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc12adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1877760506323840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772559.126549:0:23497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790772559.126564:0:23497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790772559.126570:0:23497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc12aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1877760506324224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772559.126598:0:23497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc12aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1877760506324224:12345-0@lo:400:kworker.0 Request processed in 28us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772559.126604:0:23497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790772559.126898:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772559.126941:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506324352 00000100:00100000:3.0:1790772559.126945:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506324352 00000100:00100000:3.0:1790772559.126964:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506324992 00000100:00100000:3.0:1790772559.126966:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506324992 00000100:00100000:3.0:1790772559.126986:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506324864 00000100:00100000:3.0:1790772559.126988:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506324864 00000100:00100000:3.0:1790772559.126999:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790772559.127005:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc12ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1877760506324352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772559.127034:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc12ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1877760506324352:12345-0@lo:400:kworker.0 Request processed in 30us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772559.127041:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790772559.127052:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790772559.127057:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc12ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1877760506324992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772559.127079:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc12ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1877760506324992:12345-0@lo:400:kworker.0 Request processed in 22us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772559.127085:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790772559.127094:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790772559.127098:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf8091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1877760506324864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772559.127119:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf8091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1877760506324864:12345-0@lo:400:kworker.0 Request processed in 21us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772559.127124:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1790772559.127184:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772559.127468:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1877760506324224:0@lo:400:kworker.0 00010000:00080000:3.0:1790772559.127481:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ecdf80e9180 x1877760506324864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772559.127506:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1877760506324864:0@lo:400:kworker.0 00010000:00080000:3.0:1790772559.127518:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ecdf80e8e00 x1877760506324352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772559.127527:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1877760506324352:0@lo:400:kworker.0 00010000:00080000:3.0:1790772559.127535:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ecdf80ebb80 x1877760506324992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772559.127542:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1877760506324992:0@lo:400:kworker.0 00000100:00100000:3.0:1790772559.127558:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1877760506323840:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790772559.127907:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772559.127939:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1877760506325120:0@lo:400:kworker.0 00000100:00100000:1.0:1790772559.127960:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772559.127983:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790772559.127989:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3643:1877760506324096:0@lo:400:kworker.0 00000100:00100000:1.0:1790772559.128039:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772559.128063:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506324608:0@lo:400:kworker.0 00000100:00100000:1.0:1790772559.128084:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772559.128141:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506325120 00000100:00100000:1.0:1790772559.128159:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506325120 00000100:00100000:1.0:1790772559.128221:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790772559.128228:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877760506325120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772559.128265:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877760506325120:12345-0@lo:400:kworker.0 Request processed in 38us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772559.128272:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790772559.128289:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506324096 00000100:00100000:1.0:1790772559.128292:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506324096 00000100:00100000:1.0:1790772559.128313:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790772559.128318:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:3643:x1877760506324096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772559.128345:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:3643:x1877760506324096:12345-0@lo:400:kworker.0 Request processed in 27us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772559.128351:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790772559.128372:0:24264:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506324736 00000100:00100000:1.0:1790772559.128375:0:24264:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506324736 00000100:00100000:1.0:1790772559.128390:0:24264:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506324608 00000100:00100000:1.0:1790772559.128392:0:24264:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506324608 00000100:00100000:1.0:1790772559.128411:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790772559.128417:0:24264:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7525880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506324608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772559.128442:0:24264:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7525880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506324608:12345-0@lo:400:kworker.0 Request processed in 26us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772559.128457:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790772559.128468:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790772559.128472:0:24264:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc440c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1877760506324736:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1790772559.128488:0:24264:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790772559.128523:0:24264:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc440c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1877760506324736:12345-0@lo:8:kworker.0 Request processed in 49us (1624us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790772559.128529:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1790772559.128551:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790772559.128554:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790772559.128562:0:23497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506324480 00000100:00100000:1.0:1790772559.128565:0:23497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506324480 00000100:00100000:1.0:1790772559.128586:0:23497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790772559.128592:0:23497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506324480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772559.128861:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772559.128889:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf7527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1877760506325248:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790772559.128915:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772559.128945:0:22761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506323968 00000100:00100000:2.0:1790772559.128949:0:22761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506323968 00000100:00100000:2.0:1790772559.128966:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790772559.128973:0:22761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877760506323968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790772559.128994:0:22761:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790772559.129104:0:22761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877760506323968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772559.129118:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790772559.129156:0:24266:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506325248 00000100:00100000:2.0:1790772559.129160:0:24266:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506325248 00000100:00100000:2.0:1790772559.129216:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790772559.129222:0:24266:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3e92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877760506325248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790772559.129239:0:24266:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1790772559.129268:0:24266:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3e92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877760506325248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772559.129274:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790772559.129370:0:23497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506324480:12345-0@lo:400:kworker.0 Request processed in 776us (1462us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772559.129378:0:23497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1790772559.129412:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ecdf8089800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790772559.129417:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790772559.129421:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1877760506324736:0@lo:8:kworker.0 00000100:00100000:1.0:1790772559.129446:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3643:1877760506324096:0@lo:400:kworker.0 00010000:00080000:1.0:1790772559.129458:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ecdf80eb800 x1877760506324608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772559.129468:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506324608:0@lo:400:kworker.0 00010000:00080000:1.0:1790772559.129478:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ecdf80e8000 x1877760506325120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772559.129493:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1877760506325120:0@lo:400:kworker.0 00000100:00100000:1.0:1790772559.129504:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506324480:0@lo:400:kworker.0 00000100:00100000:0.0:1790772559.131300:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1877760506323968:0@lo:41:osp-pre-1-0.0 00010000:00080000:0.0:1790772559.131331:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ecdf7527800 x1877760506325248/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772575 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772559.131633:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf7527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1877760506325248:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1790772560.020724:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772560.153794:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790772539/real 1790772539] req@ffff9ecdc12aca80 x1877760506315392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790772559 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772560.153827:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ecdc12aca80 x1877760506315392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790772559 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772560.153838:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790772539/real 1790772539] req@ffff9ecdc12ad500 x1877760506315520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790772559 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772560.153850:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ecdc12ad500 x1877760506315520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790772559 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790772560.153879:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ecdd1143800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790772560.153909:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790772560.153913:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506315392:0@lo:8:kworker.0 00000100:00080000:2.0:1790772560.153919:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ecdff753800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790772560.153923:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790772560.153926:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506315520:0@lo:8:kworker.0 00000100:00080000:0.0:1790772560.157209:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790772560.157214:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1790772560.157217:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ecdd1143800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790772560.157224:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 639 00000100:00080000:0.0:1790772560.157230:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1790772560.157241:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ecdd1143800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:0.0:1790772560.157262:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdf80ea680 x1877760506325632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790772560.157290:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790772560.157293:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790772560.157295:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ecdff753800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790772560.157299:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 639 00000100:00080000:0.0:1790772560.157301:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1790772560.157306:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ecdff753800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:0.0:1790772560.157320:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdf80e8700 x1877760506325760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790772560.157356:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790772560.157359:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790772560.157361:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ecdf8089800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790772560.157364:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 659 00000100:00080000:0.0:1790772560.157366:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1790772560.157371:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ecdf8089800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:0.0:1790772560.157380:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdf80eb100 x1877760506326272/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790772560.157425:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877760506325888:0@lo:400:kworker.0 00000100:00100000:0.0:1790772560.157499:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772560.157533:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1877760506326528:0@lo:400:kworker.0 00000100:00100000:0.0:1790772560.157560:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772560.157586:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1790772560.157592:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506326016:0@lo:400:kworker.0 00000100:00100000:0.0:1790772560.157617:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772560.157641:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1877760506326656:0@lo:400:kworker.0 00000100:00100000:0.0:1790772560.157665:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772560.157698:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506325888 00000100:00100000:0.0:1790772560.157705:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506325888 00000100:00100000:0.0:1790772560.157753:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506326528 00000100:00100000:0.0:1790772560.157757:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506326528 00000100:00100000:0.0:1790772560.157769:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506326656 00000100:00100000:0.0:1790772560.157772:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506326656 00000100:00100000:0.0:1790772560.157788:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790772560.157796:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf80eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877760506325888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772560.157861:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf80eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877760506325888:12345-0@lo:400:kworker.0 Request processed in 66us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772560.157868:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790772560.157886:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790772560.157892:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf80ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1877760506326528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772560.157920:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf80ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1877760506326528:12345-0@lo:400:kworker.0 Request processed in 29us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772560.157925:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790772560.157936:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790772560.157942:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeec51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877760506326656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772560.157969:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeec51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877760506326656:12345-0@lo:400:kworker.0 Request processed in 28us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772560.157974:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1790772560.158013:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ecdf80e9180 x1877760506326656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772560.158026:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1877760506326656:0@lo:400:kworker.0 00010000:00080000:0.0:1790772560.158049:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ecdf80e8000 x1877760506325888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772560.158057:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877760506325888:0@lo:400:kworker.0 00010000:00080000:0.0:1790772560.158067:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ecdf80e8e00 x1877760506326528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772560.158074:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1877760506326528:0@lo:400:kworker.0 00000100:00100000:2.0:1790772560.158574:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3645:1877760506325376:0@lo:400:kworker.0 00000100:00100000:2.0:1790772560.158612:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772560.158640:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506326144:0@lo:400:kworker.0 00000100:00100000:2.0:1790772560.158660:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772560.158677:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790772560.158682:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506325504:0@lo:400:kworker.0 00000100:00100000:2.0:1790772560.158699:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772560.158727:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1877760506326400:0@lo:400:kworker.0 00000100:00100000:2.0:1790772560.158754:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772560.158777:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506325632:0@lo:8:kworker.0 00000100:00100000:2.0:1790772560.158796:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772560.158810:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506325760:0@lo:8:kworker.0 00000100:00100000:2.0:1790772560.158836:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772560.158851:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1877760506326272:0@lo:8:kworker.0 00000100:00100000:2.0:1790772560.158867:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772560.158889:0:22761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506326016 00000100:00100000:2.0:1790772560.158893:0:22761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506326016 00000100:00100000:2.0:1790772560.158917:0:22761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506325504 00000100:00100000:2.0:1790772560.158919:0:22761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506325504 00000100:00100000:2.0:1790772560.158930:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790772560.158935:0:22761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeec51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506326016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772560.158970:0:22761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeec51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506326016:12345-0@lo:400:kworker.0 Request processed in 35us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772560.158976:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790772560.158989:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790772560.158994:0:22761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3e90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1877760506325504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772560.159033:0:22761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3e90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1877760506325504:12345-0@lo:400:kworker.0 Request processed in 39us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772560.159039:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790772560.159056:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506325376 00000100:00100000:2.0:1790772560.159059:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506325376 00000100:00100000:2.0:1790772560.159080:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790772560.159085:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:3645:x1877760506325376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772560.159109:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:3645:x1877760506325376:12345-0@lo:400:kworker.0 Request processed in 25us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772560.159115:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790772560.159136:0:24264:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506326144 00000100:00100000:2.0:1790772560.159139:0:24264:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506326144 00000100:00100000:2.0:1790772560.159153:0:24264:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506325632 00000100:00100000:2.0:1790772560.159155:0:24264:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506325632 00000100:00100000:2.0:1790772560.159161:0:24264:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506325760 00000100:00100000:2.0:1790772560.159185:0:24264:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506325760 00000100:00100000:2.0:1790772560.159195:0:24264:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506326272 00000100:00100000:2.0:1790772560.159197:0:24264:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506326272 00000100:00100000:2.0:1790772560.159205:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790772560.159211:0:24264:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3e92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506326144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772560.159240:0:24264:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3e92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506326144:12345-0@lo:400:kworker.0 Request processed in 30us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772560.159246:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790772560.159258:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790772560.159262:0:24264:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3e92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1877760506325632:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1790772560.159284:0:24264:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 660 last 0 00000020:00000080:2.0:1790772560.159308:0:24264:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x418ffb1c3bcc9718 00002000:00100000:2.0:1790772560.159324:0:24264:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9eccc3755800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1790772560.159328:0:24264:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1790772560.159330:0:24264:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790772560.159389:0:24264:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790772560.159410:0:24264:0:(import.c:65:import_set_state_nolock()) ffff9eccc3750800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790772560.159446:0:24264:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3e92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1877760506325632:12345-0@lo:8:kworker.0 Request processed in 183us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772560.159453:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790772560.159465:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790772560.159469:0:24264:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3e91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1877760506325760:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1790772560.159652:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790772560.159657:0:24262:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3e90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1877760506326272:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1790772560.163541:0:24264:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790772560.163618:0:24264:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3e91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1877760506325760:12345-0@lo:8:kworker.0 Request processed in 4145us (4778us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790772560.163630:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790772560.163684:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506325504:0@lo:400:kworker.0 00000100:00100000:2.0:1790772560.163695:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3645:1877760506325376:0@lo:400:kworker.0 00010000:00080000:2.0:1790772560.163707:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ecdf80e8a80 x1877760506326144/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772560.163739:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506326144:0@lo:400:kworker.0 00010000:00080000:2.0:1790772560.163782:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ecdf80ea680 x1877760506325632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790772585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772560.163790:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790772560.163797:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1790772560.163804:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1790772560.163817:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1790772560.163820:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ecdd1143800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1790772560.163845:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1790772560.163851:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506325632:0@lo:8:kworker.0 00000100:00080000:2.0:1790772560.163864:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ecdff753800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790772560.163868:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790772560.163870:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506325760:0@lo:8:kworker.0 00000100:00100000:2.0:1790772560.163899:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506326016:0@lo:400:kworker.0 00000100:00100000:2.0:1790772560.164463:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506326400 00000100:00100000:2.0:1790772560.164470:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506326400 00000100:00100000:2.0:1790772560.164613:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790772560.164623:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1877760506326400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772560.164684:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1877760506326400:12345-0@lo:400:kworker.0 Request processed in 63us (5929us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772560.164691:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:1.0:1790772560.164802:0:22781:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00010000:00020000:0.0:1790772560.164875:0:24262:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1790772560.164933:0:24262:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3e90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1877760506326272:12345-0@lo:8:kworker.0 Request processed in 5273us (6063us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790772560.164941:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000004:00080000:0.0:1790772560.164967:0:22780:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1790772560.165051:0:22780:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 660463885113ns, next at 0ns, rc = 0 00080000:00080000:0.0:1790772560.165058:0:22780:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:0.0:1790772560.165102:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ecdf8089800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790772560.165107:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790772560.165110:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1877760506326272:0@lo:8:kworker.0 00000100:00100000:1.0:1790772560.165446:0:22781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf7524e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22781:1877760506326912:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1790772560.165495:0:22781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772560.165526:0:22781:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc266aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1790772560.165670:0:24264:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506326912 00000100:00100000:0.0:1790772560.165675:0:24264:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506326912 00000100:00100000:0.0:1790772560.165740:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790772560.165748:0:24264:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22781:x1877760506326912:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:0.0:1790772560.165996:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790772560.166337:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf7526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506326784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790772560.166381:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1790772560.166589:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ecdf80ebb80 x1877760506326400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772560.166602:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1877760506326400:0@lo:400:kworker.0 00002000:00080000:0.0:1790772560.167861:0:24264:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1790772560.167871:0:24264:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1790772560.167876:0:24264:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00000100:00100000:1.0:1790772560.171377:0:24266:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506326784 00000100:00100000:1.0:1790772560.171393:0:24266:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506326784 00000100:00100000:1.0:1790772560.171661:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790772560.171672:0:24266:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeec51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1877760506326784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790772560.171699:0:24266:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1790772560.171816:0:24266:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeec51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1877760506326784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (5434us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772560.171836:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790772560.171922:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ecdf7526300 x1877760506326784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772576 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772560.171944:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf7526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506326784:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1790772560.177284:0:22736:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1790772560.178022:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790772560.178033:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc971f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.178051:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=660s v=(0 0) 00010000:00010000:2.0:1790772560.178056:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772560.178079:0:24264:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc971f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.178099:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc971f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.178110:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc971f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.178118:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc971f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.178141:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790772560.178230:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772560.178238:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc971f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772560.178247:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf4bd9200 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:1.0:1790772560.178251:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc971f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772560.178261:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc971f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772560.178295:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc971f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772560.178304:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc971f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772560.178324:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772560.178326:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772560.178327:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790772560.194132:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790772560.194571:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009201e704/0x418ffb1c3bcc9726 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.194590:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=660s v=(0 0) 00010000:00010000:2.0:1790772560.194595:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772560.194602:0:24264:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009201e704/0x418ffb1c3bcc9726 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.194617:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009201e704/0x418ffb1c3bcc9726 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.194627:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009201e704/0x418ffb1c3bcc9726 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.194648:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009201e704/0x418ffb1c3bcc9726 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.194669:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790772560.194933:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772560.194941:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009201e704/0x418ffb1c3bcc9726 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.194950:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf4bd8200 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:3.0:1790772560.194954:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009201e704/0x418ffb1c3bcc9726 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.194963:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009201e704/0x418ffb1c3bcc9726 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.194982:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009201e704/0x418ffb1c3bcc9726 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.194999:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009201e704/0x418ffb1c3bcc9726 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.195032:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772560.195034:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772560.195036:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790772560.195908:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790772560.195916:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc972d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.195928:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=660s v=(0 0) 00010000:00010000:2.0:1790772560.195931:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772560.195936:0:24264:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc972d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.195946:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc972d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.195955:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc972d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.195962:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc972d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.195976:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790772560.195985:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772560.195989:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc972d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.196012:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf4bd9400 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:2.0:1790772560.196017:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc972d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.196025:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc972d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.196037:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc972d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.196044:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc972d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.196059:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772560.196061:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772560.196063:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790772560.197036:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790772560.197045:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c18200ea/0x418ffb1c3bcc9734 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.197058:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=660s v=(0 0) 00010000:00010000:2.0:1790772560.197062:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772560.197068:0:24264:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c18200ea/0x418ffb1c3bcc9734 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.197078:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c18200ea/0x418ffb1c3bcc9734 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.197095:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c18200ea/0x418ffb1c3bcc9734 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.197103:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c18200ea/0x418ffb1c3bcc9734 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.197127:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790772560.197272:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772560.197279:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c18200ea/0x418ffb1c3bcc9734 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.197287:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf4bd9c00 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:3.0:1790772560.197291:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c18200ea/0x418ffb1c3bcc9734 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.197299:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c18200ea/0x418ffb1c3bcc9734 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.197313:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c18200ea/0x418ffb1c3bcc9734 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.197320:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c18200ea/0x418ffb1c3bcc9734 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.197337:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772560.197339:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772560.197341:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790772560.198132:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790772560.198153:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d74757a/0x418ffb1c3bcc973b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.198185:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=660s v=(0 0) 00010000:00010000:2.0:1790772560.198189:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772560.198194:0:24264:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d74757a/0x418ffb1c3bcc973b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.198213:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d74757a/0x418ffb1c3bcc973b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.198221:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d74757a/0x418ffb1c3bcc973b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.198229:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d74757a/0x418ffb1c3bcc973b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.198261:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790772560.198615:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772560.198622:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d74757a/0x418ffb1c3bcc973b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.198630:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf4bd9000 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:3.0:1790772560.198634:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d74757a/0x418ffb1c3bcc973b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.198643:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d74757a/0x418ffb1c3bcc973b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.198658:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d74757a/0x418ffb1c3bcc973b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.198664:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d74757a/0x418ffb1c3bcc973b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.198679:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772560.198681:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772560.198682:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790772560.198917:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790772560.198924:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c79b70d/0x418ffb1c3bcc9742 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.198933:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=660s v=(0 0) 00010000:00010000:2.0:1790772560.198937:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772560.198942:0:24264:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c79b70d/0x418ffb1c3bcc9742 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.198951:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c79b70d/0x418ffb1c3bcc9742 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.198960:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c79b70d/0x418ffb1c3bcc9742 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.198968:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c79b70d/0x418ffb1c3bcc9742 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.198991:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790772560.199420:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790772560.199427:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002108b1e6/0x418ffb1c3bcc9749 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.199436:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=660s v=(0 0) 00010000:00010000:2.0:1790772560.199445:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772560.199450:0:24264:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002108b1e6/0x418ffb1c3bcc9749 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.199460:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002108b1e6/0x418ffb1c3bcc9749 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.199468:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002108b1e6/0x418ffb1c3bcc9749 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.199552:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002108b1e6/0x418ffb1c3bcc9749 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.199569:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790772560.199853:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790772560.199860:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c79b70d/0x418ffb1c3bcc9742 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.199868:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf4bd8e00 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:3.0:1790772560.199872:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c79b70d/0x418ffb1c3bcc9742 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.199892:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c79b70d/0x418ffb1c3bcc9742 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.199906:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c79b70d/0x418ffb1c3bcc9742 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.199914:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c79b70d/0x418ffb1c3bcc9742 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.199932:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772560.199936:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002108b1e6/0x418ffb1c3bcc9749 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.199943:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf4bd8000 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:3.0:1790772560.199946:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002108b1e6/0x418ffb1c3bcc9749 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.199952:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002108b1e6/0x418ffb1c3bcc9749 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.199962:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002108b1e6/0x418ffb1c3bcc9749 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.199968:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002108b1e6/0x418ffb1c3bcc9749 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.199992:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772560.199994:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772560.199996:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772560.200015:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790772560.200330:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790772560.200336:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fae2bea1/0x418ffb1c3bcc9750 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.200346:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=660s v=(0 0) 00010000:00010000:2.0:1790772560.200349:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772560.200354:0:24264:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fae2bea1/0x418ffb1c3bcc9750 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.200364:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fae2bea1/0x418ffb1c3bcc9750 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.200371:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fae2bea1/0x418ffb1c3bcc9750 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.200385:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fae2bea1/0x418ffb1c3bcc9750 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.200401:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790772560.201849:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772560.201860:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fae2bea1/0x418ffb1c3bcc9750 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.201872:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf4bd8800 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:3.0:1790772560.201876:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fae2bea1/0x418ffb1c3bcc9750 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.201887:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fae2bea1/0x418ffb1c3bcc9750 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.201906:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fae2bea1/0x418ffb1c3bcc9750 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.201913:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fae2bea1/0x418ffb1c3bcc9750 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.201936:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772560.201938:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772560.201939:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790772560.202313:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790772560.202321:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041cfdb78/0x418ffb1c3bcc9757 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.202333:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=660s v=(0 0) 00010000:00010000:2.0:1790772560.202338:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772560.202344:0:24264:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041cfdb78/0x418ffb1c3bcc9757 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.202355:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041cfdb78/0x418ffb1c3bcc9757 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.202364:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041cfdb78/0x418ffb1c3bcc9757 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.202372:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041cfdb78/0x418ffb1c3bcc9757 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.202389:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790772560.204362:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772560.204375:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041cfdb78/0x418ffb1c3bcc9757 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.204394:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf4bd9600 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:3.0:1790772560.204399:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041cfdb78/0x418ffb1c3bcc9757 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.204419:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041cfdb78/0x418ffb1c3bcc9757 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.204438:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041cfdb78/0x418ffb1c3bcc9757 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.204444:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041cfdb78/0x418ffb1c3bcc9757 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.204467:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772560.204469:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772560.204471:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790772560.205545:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790772560.205555:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc975e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.205578:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=660s v=(0 0) 00010000:00010000:2.0:1790772560.205582:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772560.205588:0:24264:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc975e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.205600:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc975e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.205609:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc975e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.205616:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc975e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.205636:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790772560.206387:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790772560.206396:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000498a1cd9/0x418ffb1c3bcc9765 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.206407:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=660s v=(0 0) 00010000:00010000:2.0:1790772560.206410:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772560.206415:0:24264:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000498a1cd9/0x418ffb1c3bcc9765 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.206425:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000498a1cd9/0x418ffb1c3bcc9765 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.206446:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000498a1cd9/0x418ffb1c3bcc9765 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.206454:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000498a1cd9/0x418ffb1c3bcc9765 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.206469:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790772560.206734:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790772560.206741:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc975e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.206749:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf4bd9400 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:3.0:1790772560.206753:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc975e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.206762:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc975e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.206785:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc975e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.206793:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc975e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.206809:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772560.206812:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000498a1cd9/0x418ffb1c3bcc9765 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.206818:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf4bd9800 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:3.0:1790772560.206821:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000498a1cd9/0x418ffb1c3bcc9765 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.206828:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000498a1cd9/0x418ffb1c3bcc9765 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.206837:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000498a1cd9/0x418ffb1c3bcc9765 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.206843:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000498a1cd9/0x418ffb1c3bcc9765 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.206853:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772560.206855:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772560.206861:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772560.206868:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790772560.206919:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790772560.206925:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc79d99d/0x418ffb1c3bcc976c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.206934:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=660s v=(0 0) 00010000:00010000:2.0:1790772560.206936:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772560.206941:0:24264:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc79d99d/0x418ffb1c3bcc976c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.206949:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc79d99d/0x418ffb1c3bcc976c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.206956:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc79d99d/0x418ffb1c3bcc976c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.206963:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc79d99d/0x418ffb1c3bcc976c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.206995:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790772560.207438:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790772560.207445:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc9773 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.207455:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=660s v=(0 0) 00010000:00010000:2.0:1790772560.207458:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772560.207463:0:24264:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc9773 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.207539:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc9773 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.207550:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc9773 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.207558:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc9773 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.207572:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790772560.207860:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790772560.207866:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc79d99d/0x418ffb1c3bcc976c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.207874:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf4bd8600 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:3.0:1790772560.207877:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc79d99d/0x418ffb1c3bcc976c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.207885:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc79d99d/0x418ffb1c3bcc976c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.207897:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc79d99d/0x418ffb1c3bcc976c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.207904:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc79d99d/0x418ffb1c3bcc976c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.207920:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772560.207923:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc9773 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.207929:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf4bd9200 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:3.0:1790772560.207932:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc9773 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.207952:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc9773 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.207962:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc9773 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.207969:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc9773 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.207982:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772560.207984:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772560.207986:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772560.207994:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790772560.208120:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790772560.208127:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013cb0772/0x418ffb1c3bcc977a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.208135:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=660s v=(0 0) 00010000:00010000:2.0:1790772560.208975:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772560.208983:0:24264:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013cb0772/0x418ffb1c3bcc977a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.208997:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013cb0772/0x418ffb1c3bcc977a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.209007:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013cb0772/0x418ffb1c3bcc977a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.209015:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013cb0772/0x418ffb1c3bcc977a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.209036:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790772560.209586:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772560.209593:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013cb0772/0x418ffb1c3bcc977a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.209603:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdc29cc000 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:3.0:1790772560.209607:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013cb0772/0x418ffb1c3bcc977a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.209616:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013cb0772/0x418ffb1c3bcc977a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.209631:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013cb0772/0x418ffb1c3bcc977a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.209647:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013cb0772/0x418ffb1c3bcc977a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.209667:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772560.209669:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772560.209671:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790772560.212041:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790772560.212053:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2298d24/0x418ffb1c3bcc9781 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.212069:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=660s v=(0 0) 00010000:00010000:2.0:1790772560.212074:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772560.212080:0:24264:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2298d24/0x418ffb1c3bcc9781 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.212093:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2298d24/0x418ffb1c3bcc9781 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.212103:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2298d24/0x418ffb1c3bcc9781 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.212119:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2298d24/0x418ffb1c3bcc9781 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.212143:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790772560.212570:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772560.212578:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2298d24/0x418ffb1c3bcc9781 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.212586:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdc29cd800 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:3.0:1790772560.212590:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2298d24/0x418ffb1c3bcc9781 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.212599:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2298d24/0x418ffb1c3bcc9781 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.212613:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2298d24/0x418ffb1c3bcc9781 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.212619:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2298d24/0x418ffb1c3bcc9781 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.212641:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772560.212643:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772560.212645:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790772560.215249:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790772560.215262:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e219a02/0x418ffb1c3bcc9788 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.215277:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=660s v=(0 0) 00010000:00010000:2.0:1790772560.215281:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772560.215287:0:24264:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e219a02/0x418ffb1c3bcc9788 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.215300:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e219a02/0x418ffb1c3bcc9788 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.215310:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e219a02/0x418ffb1c3bcc9788 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.215319:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e219a02/0x418ffb1c3bcc9788 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.215335:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790772560.217525:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772560.217537:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e219a02/0x418ffb1c3bcc9788 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.217549:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdc29cc800 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:3.0:1790772560.217554:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e219a02/0x418ffb1c3bcc9788 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.217565:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e219a02/0x418ffb1c3bcc9788 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.217585:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e219a02/0x418ffb1c3bcc9788 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.217592:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e219a02/0x418ffb1c3bcc9788 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.217613:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772560.217615:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772560.217617:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772560.218438:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790772560.218448:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f287548b/0x418ffb1c3bcc978f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.218461:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=660s v=(0 0) 00010000:00010000:3.0:1790772560.218466:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772560.218483:0:24264:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f287548b/0x418ffb1c3bcc978f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.218509:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f287548b/0x418ffb1c3bcc978f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.218519:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f287548b/0x418ffb1c3bcc978f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.218527:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f287548b/0x418ffb1c3bcc978f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.218541:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790772560.219403:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790772560.219412:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000780a7257/0x418ffb1c3bcc9796 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.219423:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=660s v=(0 0) 00010000:00010000:3.0:1790772560.219427:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772560.219431:0:24264:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000780a7257/0x418ffb1c3bcc9796 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.219441:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000780a7257/0x418ffb1c3bcc9796 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.219450:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000780a7257/0x418ffb1c3bcc9796 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.219469:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000780a7257/0x418ffb1c3bcc9796 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.219495:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790772560.219505:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790772560.219510:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f287548b/0x418ffb1c3bcc978f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.219518:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdfbab1400 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:3.0:1790772560.219523:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f287548b/0x418ffb1c3bcc978f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.219531:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f287548b/0x418ffb1c3bcc978f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.219546:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f287548b/0x418ffb1c3bcc978f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.219552:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f287548b/0x418ffb1c3bcc978f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.219566:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772560.219569:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000780a7257/0x418ffb1c3bcc9796 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.219586:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdfbab1200 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:3.0:1790772560.219589:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000780a7257/0x418ffb1c3bcc9796 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.219596:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000780a7257/0x418ffb1c3bcc9796 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.219607:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000780a7257/0x418ffb1c3bcc9796 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.219615:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000780a7257/0x418ffb1c3bcc9796 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.219626:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772560.219628:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772560.219630:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772560.220026:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790772560.220033:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000023e3dc4/0x418ffb1c3bcc979d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.220043:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=660s v=(0 0) 00010000:00010000:3.0:1790772560.220046:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772560.220051:0:24264:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000023e3dc4/0x418ffb1c3bcc979d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.220060:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000023e3dc4/0x418ffb1c3bcc979d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.220074:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000023e3dc4/0x418ffb1c3bcc979d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.220082:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000023e3dc4/0x418ffb1c3bcc979d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.220095:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790772560.220103:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772560.220107:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000023e3dc4/0x418ffb1c3bcc979d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.220114:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdfbab0400 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:3.0:1790772560.220117:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000023e3dc4/0x418ffb1c3bcc979d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.220125:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000023e3dc4/0x418ffb1c3bcc979d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.220137:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000023e3dc4/0x418ffb1c3bcc979d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.220278:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000023e3dc4/0x418ffb1c3bcc979d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.220293:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772560.220299:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772560.220301:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772560.220726:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790772560.220733:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416b97f4/0x418ffb1c3bcc97a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.220742:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=660s v=(0 0) 00010000:00010000:3.0:1790772560.220746:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772560.220751:0:24264:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416b97f4/0x418ffb1c3bcc97a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.220761:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416b97f4/0x418ffb1c3bcc97a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.220771:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416b97f4/0x418ffb1c3bcc97a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.220779:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416b97f4/0x418ffb1c3bcc97a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.220794:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790772560.220801:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772560.220805:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416b97f4/0x418ffb1c3bcc97a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.220813:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdfbab1e00 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:3.0:1790772560.220816:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416b97f4/0x418ffb1c3bcc97a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.220929:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772560.220975:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416b97f4/0x418ffb1c3bcc97a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.220988:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416b97f4/0x418ffb1c3bcc97a4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.220996:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416b97f4/0x418ffb1c3bcc97a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.221010:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772560.221012:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772560.221014:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772560.221409:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790772560.221416:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023b290df/0x418ffb1c3bcc97ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.221425:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=660s v=(0 0) 00010000:00010000:3.0:1790772560.221428:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772560.221432:0:24264:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023b290df/0x418ffb1c3bcc97ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.221441:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023b290df/0x418ffb1c3bcc97ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.221449:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023b290df/0x418ffb1c3bcc97ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.221462:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023b290df/0x418ffb1c3bcc97ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.221979:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790772560.226818:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790772560.226843:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040e2db3e/0x418ffb1c3bcc97b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772560.226860:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=660s v=(0 0) 00010000:00010000:1.0:1790772560.226864:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772560.226870:0:24264:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040e2db3e/0x418ffb1c3bcc97b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772560.226884:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040e2db3e/0x418ffb1c3bcc97b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772560.226894:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040e2db3e/0x418ffb1c3bcc97b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772560.226902:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040e2db3e/0x418ffb1c3bcc97b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.227420:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790772560.227434:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023b290df/0x418ffb1c3bcc97ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.227443:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdfbab1800 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:2.0:1790772560.227448:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023b290df/0x418ffb1c3bcc97ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.227458:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023b290df/0x418ffb1c3bcc97ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.227485:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023b290df/0x418ffb1c3bcc97ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.227493:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023b290df/0x418ffb1c3bcc97ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.227513:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772560.227516:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040e2db3e/0x418ffb1c3bcc97b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.227522:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdff438e00 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:2.0:1790772560.227525:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040e2db3e/0x418ffb1c3bcc97b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.227533:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040e2db3e/0x418ffb1c3bcc97b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.227554:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040e2db3e/0x418ffb1c3bcc97b2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.227562:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772560.227563:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772560.227565:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772560.228385:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790772560.228393:0:24264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040e2db3e/0x418ffb1c3bcc97b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.236593:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772560.236659:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790772560.236669:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c16cbe55/0x418ffb1c3bcc97b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.236685:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=660s v=(0 0) 00010000:00010000:3.0:1790772560.236689:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772560.236695:0:24264:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c16cbe55/0x418ffb1c3bcc97b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.236720:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c16cbe55/0x418ffb1c3bcc97b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.236731:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c16cbe55/0x418ffb1c3bcc97b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.236740:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c16cbe55/0x418ffb1c3bcc97b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.237287:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790772560.237916:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790772560.237924:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2a9451b/0x418ffb1c3bcc97c0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.237944:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=660s v=(0 0) 00010000:00010000:3.0:1790772560.237947:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772560.237952:0:24264:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2a9451b/0x418ffb1c3bcc97c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.237965:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2a9451b/0x418ffb1c3bcc97c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.237973:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2a9451b/0x418ffb1c3bcc97c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.237981:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2a9451b/0x418ffb1c3bcc97c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.240996:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790772560.241010:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c16cbe55/0x418ffb1c3bcc97b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.241023:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdfbab1a00 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:2.0:1790772560.241028:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c16cbe55/0x418ffb1c3bcc97b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.241039:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c16cbe55/0x418ffb1c3bcc97b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.241059:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c16cbe55/0x418ffb1c3bcc97b9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.241066:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c16cbe55/0x418ffb1c3bcc97b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.241090:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772560.241095:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2a9451b/0x418ffb1c3bcc97c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.241115:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdfbab1600 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:2.0:1790772560.241118:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2a9451b/0x418ffb1c3bcc97c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.241127:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2a9451b/0x418ffb1c3bcc97c0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.241150:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2a9451b/0x418ffb1c3bcc97c0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.241159:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772560.241161:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772560.241178:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772560.248226:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790772560.248242:0:24264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2a9451b/0x418ffb1c3bcc97c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790772560.249242:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790772560.249252:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a8c7164/0x418ffb1c3bcc97c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.249268:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=660s v=(0 0) 00010000:00010000:3.0:1790772560.249273:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772560.249280:0:24264:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a8c7164/0x418ffb1c3bcc97c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.249307:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a8c7164/0x418ffb1c3bcc97c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.249317:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a8c7164/0x418ffb1c3bcc97c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.249324:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a8c7164/0x418ffb1c3bcc97c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.249338:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790772560.249901:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790772560.249910:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000438ddcd1/0x418ffb1c3bcc97ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.249921:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=660s v=(0 0) 00010000:00010000:3.0:1790772560.249925:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772560.249930:0:24264:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000438ddcd1/0x418ffb1c3bcc97ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.249940:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000438ddcd1/0x418ffb1c3bcc97ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.249949:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000438ddcd1/0x418ffb1c3bcc97ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.249968:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000438ddcd1/0x418ffb1c3bcc97ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.249978:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1790772560.250356:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790772560.250363:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000260dd086/0x418ffb1c3bcc97d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.250373:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=660s v=(0 0) 00010000:00010000:3.0:1790772560.250376:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772560.250380:0:24264:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000260dd086/0x418ffb1c3bcc97d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.250390:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000260dd086/0x418ffb1c3bcc97d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.250397:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000260dd086/0x418ffb1c3bcc97d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.250404:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000260dd086/0x418ffb1c3bcc97d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.250414:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1790772560.251334:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790772560.251344:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f4acad2/0x418ffb1c3bcc97dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.251364:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=660s v=(0 0) 00010000:00010000:3.0:1790772560.251368:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772560.251373:0:24264:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f4acad2/0x418ffb1c3bcc97dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.251383:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f4acad2/0x418ffb1c3bcc97dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.251392:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f4acad2/0x418ffb1c3bcc97dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.251400:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f4acad2/0x418ffb1c3bcc97dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.251409:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1790772560.252313:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1790772560.252322:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a8c7164/0x418ffb1c3bcc97c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.252331:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdfbab0c00 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:2.0:1790772560.252336:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a8c7164/0x418ffb1c3bcc97c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.252347:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a8c7164/0x418ffb1c3bcc97c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.252365:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a8c7164/0x418ffb1c3bcc97c7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.252379:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a8c7164/0x418ffb1c3bcc97c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.252399:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790772560.252403:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000438ddcd1/0x418ffb1c3bcc97ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.252409:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdfbab0a00 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:2.0:1790772560.252412:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000438ddcd1/0x418ffb1c3bcc97ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.252420:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000438ddcd1/0x418ffb1c3bcc97ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.252430:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000438ddcd1/0x418ffb1c3bcc97ce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.252436:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000438ddcd1/0x418ffb1c3bcc97ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.252449:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790772560.252452:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000260dd086/0x418ffb1c3bcc97d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.252459:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdfbab1c00 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:2.0:1790772560.252468:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000260dd086/0x418ffb1c3bcc97d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772560.252597:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1790772560.253721:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790772560.253732:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a545803/0x418ffb1c3bcc97e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.253746:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=660s v=(0 0) 00010000:00010000:3.0:1790772560.253750:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772560.253757:0:24264:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a545803/0x418ffb1c3bcc97e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.253769:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a545803/0x418ffb1c3bcc97e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.253791:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a545803/0x418ffb1c3bcc97e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.253800:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a545803/0x418ffb1c3bcc97e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.253810:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790772560.254279:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000260dd086/0x418ffb1c3bcc97d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.254297:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000260dd086/0x418ffb1c3bcc97d5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.254304:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000260dd086/0x418ffb1c3bcc97d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.254321:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772560.254325:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a545803/0x418ffb1c3bcc97e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.254331:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdef3a6600 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:2.0:1790772560.254335:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a545803/0x418ffb1c3bcc97e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.254342:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a545803/0x418ffb1c3bcc97e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.254352:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a545803/0x418ffb1c3bcc97e3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.254359:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a545803/0x418ffb1c3bcc97e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.254381:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772560.254383:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772560.254385:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772560.255063:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772560.255066:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772560.255068:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772560.255110:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f4acad2/0x418ffb1c3bcc97dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772560.255120:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdfbab1000 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:0.0:1790772560.255123:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f4acad2/0x418ffb1c3bcc97dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772560.255131:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f4acad2/0x418ffb1c3bcc97dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790772560.255987:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790772560.255996:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002434fc6a/0x418ffb1c3bcc97ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.256011:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=660s v=(0 0) 00010000:00010000:3.0:1790772560.256016:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772560.256022:0:24264:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002434fc6a/0x418ffb1c3bcc97ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.256035:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002434fc6a/0x418ffb1c3bcc97ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.256044:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002434fc6a/0x418ffb1c3bcc97ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.256053:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002434fc6a/0x418ffb1c3bcc97ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.256083:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772560.256595:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f4acad2/0x418ffb1c3bcc97dc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772560.256605:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f4acad2/0x418ffb1c3bcc97dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772560.256627:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772560.256631:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002434fc6a/0x418ffb1c3bcc97ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772560.256644:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc3561e00 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:0.0:1790772560.256649:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002434fc6a/0x418ffb1c3bcc97ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772560.256658:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002434fc6a/0x418ffb1c3bcc97ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772560.256669:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002434fc6a/0x418ffb1c3bcc97ea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772560.256676:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002434fc6a/0x418ffb1c3bcc97ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772560.256688:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772560.256689:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772560.256691:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772560.257314:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772560.257929:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790772560.257938:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029b30956/0x418ffb1c3bcc97f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.257951:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=660s v=(0 0) 00010000:00010000:3.0:1790772560.257954:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772560.257960:0:24264:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029b30956/0x418ffb1c3bcc97f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.257971:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029b30956/0x418ffb1c3bcc97f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.257980:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029b30956/0x418ffb1c3bcc97f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.257988:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029b30956/0x418ffb1c3bcc97f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772560.258013:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1790772560.258076:0:24264:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00010000:00010000:2.0:1790772560.258631:0:25002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772560.258639:0:25002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029b30956/0x418ffb1c3bcc97f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.258647:0:25002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc3560200 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:2.0:1790772560.258652:0:25002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029b30956/0x418ffb1c3bcc97f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.258661:0:25002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029b30956/0x418ffb1c3bcc97f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.258677:0:25002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029b30956/0x418ffb1c3bcc97f1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.258685:0:25002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029b30956/0x418ffb1c3bcc97f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772560.258704:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772560.258706:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772560.258726:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772560.258772:0:24264:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22781:x1877760506326912:12345-0@lo:5:osp-pre-0-0.0 Request processed in 93022us (93274us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772560.258785:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790772560.263096:0:22781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf7524e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22781:1877760506326912:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1790772560.263115:0:22781:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:0.0:1790772560.263363:0:22781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec53480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22781:1877760506327040:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1790772560.263421:0:22781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772560.263453:0:22781:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc810e180 going to sleep for 11 seconds 00000100:00100000:1.0:1790772560.263671:0:24263:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506327040 00000100:00100000:1.0:1790772560.263678:0:24263:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506327040 00000100:00100000:1.0:1790772560.263733:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790772560.263742:0:24263:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeec50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22781:x1877760506327040:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1790772560.263779:0:24263:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:2.0:1790772560.271406:0:24259:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:2.0:1790772560.271448:0:24259:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1790772560.274026:0:24263:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeec50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22781:x1877760506327040:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10277us (10596us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1790772560.274039:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000040:00080000:3.0:1790772560.278641:0:23514:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790772560.284371:0:22781:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1790772560.284385:0:22781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec53480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22781:1877760506327040:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1790772560.284401:0:22781:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:0.0:1790772561.045833:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790772561.679596:0:25078:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790772561.679600:0:25078:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1790772561.679601:0:25078:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1790772561.679979:0:25078:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ecdfaa9d000 00000020:01000004:3.0:1790772561.679994:0:25078:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1790772561.680009:0:25078:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1790772561.680023:0:25078:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9ecdfa9fb380) 00000020:00000080:3.0:1790772561.680040:0:25078:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1790772561.805534:0:25078:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1790772561.810045:0:25078:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1790772561.815990:0:25078:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1790772561.817153:0:25078:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1790772561.817900:0:25078:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1790772561.819152:0:25078:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1790772561.821619:0:25078:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:0.0:1790772561.831100:0:25078:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1790772561.831370:0:25078:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1790772561.831384:0:25078:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:0.0:1790772561.831394:0:25078:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x418ffb1c3bcc97ff 00000020:01000004:0.0:1790772561.831401:0:25078:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1790772561.831421:0:25078:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.114@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1790772561.831424:0:25078:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1790772561.831430:0:25078:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1790772561.831457:0:25078:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1790772561.831461:0:25078:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.114@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1790772561.872765:0:25078:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.114@tcp ctxt 0 is initialized 00000020:01000004:1.0:1790772561.872818:0:25078:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.114@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1790772561.872823:0:25078:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1790772561.872824:0:25078:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790772561.872826:0:25078:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790772561.872827:0:25078:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790772561.872828:0:25078:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790772561.872830:0:25078:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790772561.872831:0:25078:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790772561.872833:0:25078:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790772561.872835:0:25078:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790772561.872838:0:25078:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1790772561.872841:0:25078:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790772561.872842:0:25078:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790772561.872843:0:25078:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790772561.872844:0:25078:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790772561.872845:0:25078:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790772561.872846:0:25078:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790772561.872853:0:25078:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790772561.872854:0:25078:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790772561.872855:0:25078:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790772561.872881:0:25078:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1790772561.872899:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf7524000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506327168:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790772561.872971:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772561.873017:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc266a900 going to sleep for 11 seconds 00000100:00100000:3.0:1790772561.873206:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506327168 00000100:00100000:3.0:1790772561.873214:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506327168 00000100:00100000:3.0:1790772561.873268:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790772561.873277:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:25078:x1877760506327168:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790772561.873304:0:22749:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1790772561.873308:0:22749:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1790772561.873312:0:22749:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1790772561.873840:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:25078:x1877760506327168:12345-0@lo:253:mount.lustre.0 Request processed in 562us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772561.873849:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790772561.874004:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf7524000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506327168:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790772561.874015:0:25078:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1790772561.874018:0:25078:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790772561.874019:0:25078:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790772561.874020:0:25078:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790772561.874021:0:25078:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790772561.874023:0:25078:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790772561.874024:0:25078:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790772561.874025:0:25078:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790772561.874027:0:25078:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790772561.874028:0:25078:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790772561.874046:0:25078:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ecdfaa9d000 from lustre-OST0001 10000000:01000000:1.0:1790772561.874074:0:25078:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1790772561.874077:0:25078:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1790772561.874085:0:25078:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ecdfc7f0000 local copy 00010000:00010000:1.0:1790772561.874095:0:25078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8a00/0x418ffb1c3bcc9439 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9440 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772561.874326:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf7524000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506327296:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790772561.874379:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772561.874411:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc266a480 going to sleep for 11 seconds 00000100:00100000:2.0:1790772561.874469:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506327296 00000100:00100000:2.0:1790772561.874474:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506327296 00000100:00100000:2.0:1790772561.874511:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1790772561.874518:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:25078:x1877760506327296:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790772561.874590:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:25078:x1877760506327296:12345-0@lo:501:mount.lustre.0 Request processed in 72us (210us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790772561.874597:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790772561.875238:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf7524000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506327296:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1790772561.875255:0:25078:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1790772561.875279:0:25078:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1790772561.875294:0:25078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8a00/0x418ffb1c3bcc9439 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9440 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772561.875304:0:25078:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8a00/0x418ffb1c3bcc9439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9440 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772561.875330:0:25078:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ecdfaa9d000 10000000:01000000:1.0:1790772561.875335:0:25078:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790772561.875341:0:25078:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1790772561.875343:0:25078:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790772561.875348:0:25078:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1790772561.875350:0:25078:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1790772561.875373:0:25078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdff438e00/0x418ffb1c3bcc9806 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772561.875381:0:25078:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9ecdff438e00/0x418ffb1c3bcc9806 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772561.875391:0:25078:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9ecdff438e00/0x418ffb1c3bcc9806 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772561.875405:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf7524000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506327424:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790772561.875436:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772561.875469:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc266a480 going to sleep for 11 seconds 00000100:00100000:3.0:1790772561.875590:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506327424 00000100:00100000:3.0:1790772561.875595:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506327424 00000100:00100000:3.0:1790772561.875631:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1790772561.875638:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:25078:x1877760506327424:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790772561.875649:0:22749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772561.875661:0:22749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eccc3560400/0x418ffb1c3bcc980d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x418ffb1c3bcc9806 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772561.875682:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eccc3560400/0x418ffb1c3bcc980d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9806 expref: 22 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772561.875711:0:22749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eccc3560400/0x418ffb1c3bcc980d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9806 expref: 22 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772561.875727:0:22749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eccc3560400, rc 0) 00000100:00100000:3.0:1790772561.875767:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+22:25078:x1877760506327424:12345-0@lo:101:mount.lustre.0 Request processed in 129us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772561.875773:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790772561.875908:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf7524000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506327424:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790772561.875920:0:25078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9ecdff438e00/0x418ffb1c3bcc9806 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc980d expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772561.875931:0:25078:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9ecdff438e00/0x418ffb1c3bcc9806 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc980d expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790772561.877204:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:1.0:1790772561.879663:0:25078:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790772561.888001:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1790772561.888063:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1790772561.888079:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1790772561.888091:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1790772561.888103:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1790772561.888116:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1790772561.888128:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1790772561.888142:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1790772561.888157:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:1.0:1790772561.888222:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:1.0:1790772561.888229:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:1.0:1790772561.888335:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf7524000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506327552:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790772561.888398:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772561.888434:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc266af00 going to sleep for 11 seconds 00000100:00100000:0.0:1790772561.888933:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506327552 00000100:00100000:0.0:1790772561.888941:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506327552 00000100:00100000:0.0:1790772561.888993:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1790772561.889003:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+22:25078:x1877760506327552:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790772561.889146:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+22:25078:x1877760506327552:12345-0@lo:501:mount.lustre.0 Request processed in 144us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772561.889154:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790772561.890139:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf7524000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506327552:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790772561.890221:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf7524000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506327680:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790772561.890282:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772561.890307:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc266af00 going to sleep for 11 seconds 00000100:00100000:2.0:1790772561.890424:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506327680 00000100:00100000:2.0:1790772561.890431:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506327680 00000100:00100000:2.0:1790772561.890476:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790772561.890484:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+22:25078:x1877760506327680:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790772561.891502:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+22:25078:x1877760506327680:12345-0@lo:503:mount.lustre.0 Request processed in 1015us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772561.891511:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790772561.891907:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf7524000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506327680:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790772561.894398:0:25078:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790772561.894489:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf7524000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506327808:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790772561.894565:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772561.894614:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc266a480 going to sleep for 11 seconds 00000100:00100000:3.0:1790772561.894839:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506327808 00000100:00100000:3.0:1790772561.894847:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506327808 00000100:00100000:3.0:1790772561.894887:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790772561.894896:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+22:25078:x1877760506327808:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790772561.896658:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+22:25078:x1877760506327808:12345-0@lo:502:mount.lustre.0 Request processed in 1758us (2088us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772561.896671:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790772561.898137:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf7524000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506327808:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790772561.898657:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1790772561.898719:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1790772561.898738:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1790772561.898751:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1790772561.898764:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1790772561.898805:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1790772561.898820:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1790772561.898832:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1790772561.898844:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:1.0:1790772561.898882:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf7524000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506327936:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790772561.898945:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772561.900754:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc266a480 going to sleep for 11 seconds 00000100:00100000:2.0:1790772561.908362:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506327936 00000100:00100000:2.0:1790772561.908377:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506327936 00000100:00100000:2.0:1790772561.908443:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790772561.908466:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+22:25078:x1877760506327936:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790772561.908698:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+22:25078:x1877760506327936:12345-0@lo:502:mount.lustre.0 Request processed in 223us (9742us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772561.908715:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790772561.911423:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf7524000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506327936:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790772561.914474:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:0.0:1790772561.914495:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1790772561.915956:0:25082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790772561.915966:0:25082:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1790772561.915972:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772561.915974:0:25082:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1790772561.915981:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790772561.915996:0:25082:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9eccc30acd40) 00000020:00000080:2.0:1790772561.916022:0:25082:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1790772561.916028:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790772561.916981:0:25082:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ecdfaa9d000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1790772561.916993:0:25082:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790772561.917002:0:25082:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x418ffb1c3bcc981b 00010000:00010000:3.0:1790772561.931781:0:25082:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1790772561.933294:0:25082:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:3.0:1790772561.936922:0:25082:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1790772561.939887:0:25082:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1790772561.939900:0:25082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790772561.939906:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772561.939908:0:25082:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1790772561.939911:0:25082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790772561.939915:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772561.939916:0:25082:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790772561.939919:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790772561.939921:0:25082:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790772561.939923:0:25082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790772561.939931:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772561.939933:0:25082:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1790772561.939936:0:25082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790772561.939938:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772561.939940:0:25082:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790772561.939943:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1790772561.939970:0:25082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790772561.939973:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772561.939974:0:25082:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790772561.939977:0:25082:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:1.0:1790772561.955641:0:25078:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1790772561.955682:0:25078:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1790772561.955724:0:25078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdff438e00/0x418ffb1c3bcc9806 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc980d expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772561.955737:0:25078:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9ecdff438e00/0x418ffb1c3bcc9806 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc980d expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772561.955745:0:25078:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ecdfaa9d000 from 1 10000000:01000000:1.0:1790772561.955748:0:25078:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790772561.955797:0:25078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdff439400/0x418ffb1c3bcc9822 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772561.955805:0:25078:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9ecdff439400/0x418ffb1c3bcc9822 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772561.955830:0:25078:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9ecdff439400/0x418ffb1c3bcc9822 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772561.955852:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf7524000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506328064:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790772561.955912:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772561.955946:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc266a480 going to sleep for 11 seconds 00000100:00100000:3.0:1790772561.956429:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506328064 00000100:00100000:3.0:1790772561.956436:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506328064 00000100:00100000:3.0:1790772561.956477:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1790772561.956486:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+22:25078:x1877760506328064:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790772561.956498:0:22749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772561.956511:0:22749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eccc3560a00/0x418ffb1c3bcc9829 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x418ffb1c3bcc9822 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772561.956534:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eccc3560a00/0x418ffb1c3bcc9829 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9822 expref: 23 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772561.956543:0:22749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eccc3560a00/0x418ffb1c3bcc9829 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9822 expref: 23 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772561.956560:0:22749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eccc3560a00, rc 0) 00000100:00100000:3.0:1790772561.956614:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+23:25078:x1877760506328064:12345-0@lo:101:mount.lustre.0 Request processed in 128us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772561.956620:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1790772561.957361:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf7524000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506328064:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790772561.957380:0:25078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9ecdff439400/0x418ffb1c3bcc9822 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9829 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772561.957390:0:25078:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9ecdff439400/0x418ffb1c3bcc9822 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc9829 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790772561.959378:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1790772561.959643:0:25078:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790772561.959985:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1790772561.960009:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1790772561.960024:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1790772561.960039:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1790772561.960051:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1790772561.960065:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1790772561.960080:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1790772561.960108:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1790772561.960125:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1790772561.960139:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1790772561.960153:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1790772561.960596:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1790772561.960606:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1790772561.961027:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec53480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506328192:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790772561.961090:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772561.961203:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc3779900 going to sleep for 11 seconds 00000100:00100000:3.0:1790772561.967025:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506328192 00000100:00100000:3.0:1790772561.967039:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506328192 00000100:00100000:2.0:1790772561.976737:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790772561.976752:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+23:25078:x1877760506328192:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790772561.979898:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+23:25078:x1877760506328192:12345-0@lo:501:mount.lustre.0 Request processed in 3142us (18801us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772561.979912:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1790772561.980727:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec53480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506328192:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790772561.980783:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec53480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506328320:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790772561.981031:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772561.981061:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc3779900 going to sleep for 11 seconds 00000100:00100000:1.0:1790772561.981870:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506328320 00000100:00100000:1.0:1790772561.981878:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506328320 00000100:00100000:1.0:1790772561.981934:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790772561.981943:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+23:25078:x1877760506328320:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790772561.982346:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+23:25078:x1877760506328320:12345-0@lo:503:mount.lustre.0 Request processed in 403us (1314us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772561.982358:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790772561.982608:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec53480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506328320:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790772561.983075:0:25078:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790772561.983336:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec53480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506328448:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790772561.983396:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772561.983479:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc3779180 going to sleep for 11 seconds 00000100:00100000:3.0:1790772561.984401:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506328448 00000100:00100000:3.0:1790772561.984410:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506328448 00000100:00100000:3.0:1790772561.984490:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790772561.984498:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+23:25078:x1877760506328448:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790772561.984629:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+23:25078:x1877760506328448:12345-0@lo:502:mount.lustre.0 Request processed in 131us (1232us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772561.984636:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790772561.984737:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec53480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506328448:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790772561.984933:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1790772561.984960:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1790772561.984973:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1790772561.984985:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1790772561.984997:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1790772561.985008:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1790772561.985021:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1790772561.985034:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1790772561.985045:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1790772561.985058:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1790772561.985070:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1790772561.985097:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf7525180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506328576:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790772561.985135:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772561.990947:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc266a600 going to sleep for 11 seconds 00000100:00100000:0.0:1790772561.991090:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506328576 00000100:00100000:0.0:1790772561.991099:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506328576 00000100:00100000:0.0:1790772561.991145:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790772561.991153:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+23:25078:x1877760506328576:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790772561.991345:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+23:25078:x1877760506328576:12345-0@lo:502:mount.lustre.0 Request processed in 191us (6208us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772561.991352:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790772561.991505:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf7525180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506328576:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790772561.991581:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1790772561.991593:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1790772561.992473:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790772561.992483:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772561.992485:0:25086:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790772561.992491:0:25086:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ecdfaa9d000 00000020:00000080:1.0:1790772561.992494:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790772561.992501:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772561.992503:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772561.992504:0:25086:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1790772561.992507:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790772561.992509:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772561.992510:0:25086:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790772561.992513:0:25086:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ecdfaa9d000 00000020:00000080:1.0:1790772561.992515:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790772561.992571:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772561.992575:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772561.992576:0:25086:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1790772561.992579:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790772561.992582:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772561.992583:0:25086:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790772561.992587:0:25086:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ecdfaa9d000 00000020:00000080:1.0:1790772561.992589:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790772561.992607:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772561.992610:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772561.992612:0:25086:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790772561.992615:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790772561.992617:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772561.992618:0:25086:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1790772561.992622:0:25086:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ecdfaa9d000 00000020:00000080:1.0:1790772561.992624:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790772561.992658:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772561.992662:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772561.992663:0:25086:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1790772561.992666:0:25086:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1790772561.997427:0:25078:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1790772561.997467:0:25078:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790772561.998490:0:25078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdff439400/0x418ffb1c3bcc9822 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9829 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772561.998505:0:25078:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9ecdff439400/0x418ffb1c3bcc9822 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9829 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772561.998579:0:25078:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790772561.998582:0:25078:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ecdfaa9d000 10000000:01000000:0.0:1790772561.998586:0:25078:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ecdfaa9d000 10000000:01000000:0.0:1790772561.998590:0:25078:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790772561.998596:0:25078:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ecdfaa9d000 from 1 10000000:01000000:0.0:1790772561.998599:0:25078:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790772561.998632:0:25078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd0c00/0x418ffb1c3bcc9830 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772561.998640:0:25078:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd0c00/0x418ffb1c3bcc9830 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772561.998650:0:25078:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd0c00/0x418ffb1c3bcc9830 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772561.998673:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec53480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506328704:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790772561.998912:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772561.998957:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc3779000 going to sleep for 11 seconds 00000100:00100000:0.0:1790772561.998983:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506328704 00000100:00100000:0.0:1790772561.998989:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506328704 00000100:00100000:0.0:1790772561.999028:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790772561.999037:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+23:25078:x1877760506328704:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790772561.999050:0:22749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772561.999062:0:22749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eccc1bd0800/0x418ffb1c3bcc9837 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x418ffb1c3bcc9830 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772561.999084:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eccc1bd0800/0x418ffb1c3bcc9837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9830 expref: 24 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772561.999106:0:22749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eccc1bd0800/0x418ffb1c3bcc9837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9830 expref: 24 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772561.999115:0:22749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eccc1bd0800, rc 0) 00000100:00100000:0.0:1790772561.999152:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+24:25078:x1877760506328704:12345-0@lo:101:mount.lustre.0 Request processed in 116us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772561.999159:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790772562.000493:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec53480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506328704:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790772562.000515:0:25078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd0c00/0x418ffb1c3bcc9830 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9837 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772562.000527:0:25078:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd0c00/0x418ffb1c3bcc9830 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc9837 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790772562.014267:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1790772562.014554:0:25078:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790772562.017338:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1790772562.017394:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1790772562.017409:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1790772562.017422:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1790772562.017436:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1790772562.017449:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1790772562.017464:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1790772562.017478:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1790772562.017491:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1790772562.017503:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1790772562.017515:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1790772562.017545:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1790772562.017568:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1790772562.017580:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1790772562.017593:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1790772562.017605:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1790772562.017616:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1790772562.017630:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1790772562.017643:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1790772562.017657:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1790772562.017670:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1790772562.017682:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1790772562.017722:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1790772562.017737:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1790772562.017750:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1790772562.017762:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1790772562.017775:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1790772562.017799:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1790772562.017814:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1790772562.017826:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1790772562.021192:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1790772562.021249:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1790772562.021265:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1790772562.021278:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1790772562.021290:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1790772562.021303:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1790772562.021316:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1790772562.021330:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1790772562.021344:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1790772562.021356:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1790772562.021368:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1790772562.021382:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1790772562.021396:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1790772562.021426:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1790772562.021442:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1790772562.021466:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1790772562.021481:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1790772562.021494:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1790772562.022214:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1790772562.022243:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1790772562.022263:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1790772562.022270:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1790772562.022364:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec53480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506328832:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790772562.022422:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772562.022462:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc3779600 going to sleep for 11 seconds 00000100:00100000:0.0:1790772562.022502:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506328832 00000100:00100000:0.0:1790772562.022509:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506328832 00000100:00100000:0.0:1790772562.022549:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790772562.022558:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+24:25078:x1877760506328832:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790772562.022670:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+24:25078:x1877760506328832:12345-0@lo:501:mount.lustre.0 Request processed in 112us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772562.022678:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790772562.022752:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec53480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506328832:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790772562.022784:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec53480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506328960:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790772562.022820:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772562.022834:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc3779600 going to sleep for 11 seconds 00000100:00100000:0.0:1790772562.022860:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506328960 00000100:00100000:0.0:1790772562.022864:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506328960 00000100:00100000:0.0:1790772562.022887:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790772562.022894:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+24:25078:x1877760506328960:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790772562.022967:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+24:25078:x1877760506328960:12345-0@lo:503:mount.lustre.0 Request processed in 73us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772562.022982:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790772562.023022:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec53480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506328960:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790772562.023407:0:25078:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790772562.023465:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec53480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506329088:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790772562.023503:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772562.023526:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc3779000 going to sleep for 11 seconds 00000100:00100000:0.0:1790772562.023541:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506329088 00000100:00100000:0.0:1790772562.023545:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506329088 00000100:00100000:0.0:1790772562.023569:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1790772562.023576:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+24:25078:x1877760506329088:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790772562.023650:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+24:25078:x1877760506329088:12345-0@lo:502:mount.lustre.0 Request processed in 74us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772562.023656:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1790772562.023695:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec53480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506329088:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790772562.023875:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1790772562.023898:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1790772562.023911:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1790772562.023923:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1790772562.023949:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1790772562.023967:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1790772562.023981:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1790772562.023995:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1790772562.024009:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1790772562.024023:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1790772562.024036:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1790772562.024047:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1790772562.024059:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1790772562.024082:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1790772562.024097:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1790772562.024108:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1790772562.024120:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1790772562.032229:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1790772562.032281:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1790772562.032299:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1790772562.032340:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1790772562.032357:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1790772562.032370:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1790772562.032387:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1790772562.032403:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1790772562.032415:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1790772562.032429:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1790772562.032442:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1790772562.032456:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1790772562.032471:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1790772562.032485:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1790772562.032498:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1790772562.032510:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1790772562.032522:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1790772562.032536:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1790772562.032560:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1790772562.032586:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1790772562.032600:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1790772562.032613:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1790772562.032625:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1790772562.032637:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1790772562.032650:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1790772562.032664:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1790772562.032677:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1790772562.037153:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1790772562.040522:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1790772562.040568:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1790772562.040593:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1790772562.040671:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3e93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506329216:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790772562.040801:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772562.041060:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc52290c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772562.041129:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506329216 00000100:00100000:0.0:1790772562.041151:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506329216 00000100:00100000:0.0:1790772562.041263:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1790772562.041271:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+24:25078:x1877760506329216:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790772562.041392:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+24:25078:x1877760506329216:12345-0@lo:502:mount.lustre.0 Request processed in 121us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772562.041400:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1790772562.041454:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3e93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506329216:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790772562.041648:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1790772562.041677:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1790772562.042016:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec53480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506329344:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790772562.042060:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772562.042145:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc3779600 going to sleep for 11 seconds 00000100:00100000:0.0:1790772562.042361:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506329344 00000100:00100000:0.0:1790772562.042382:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506329344 00000100:00100000:0.0:1790772562.042416:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1790772562.042423:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+24:25078:x1877760506329344:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790772562.043391:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+24:25078:x1877760506329344:12345-0@lo:502:mount.lustre.0 Request processed in 965us (1327us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772562.043402:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1790772562.043479:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec53480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506329344:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790772562.043556:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1790772562.043569:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1790772562.048554:0:25091:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1790772562.048571:0:25091:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9eccc30a8000) 00000020:00000080:2.0:1790772562.048596:0:25091:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1790772562.048723:0:25091:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ecdfaa9d000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790772562.048728:0:25091:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ecdfaa9d000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790772562.048731:0:25091:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ecdfaa9d000 3 00010000:00080000:2.0:1790772562.048764:0:25091:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9eccc3701000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.114@tcp at head 00010000:00010000:3.0:1790772562.073085:0:25091:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1790772562.077810:0:25091:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1790772562.077895:0:25091:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790772562.077909:0:25091:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x418ffb1c3bcc9845 00000100:00080000:3.0:1790772562.077919:0:25091:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790772562.077930:0:25091:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9eccc3701000 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:3.0:1790772562.077966:0:25091:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eccc440d880 x1877760506329472/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790772562.078004:0:25091:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790772562.078232:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790772562.078237:0:19463:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790772562.078239:0:19463:0:(import.c:65:import_set_state_nolock()) ffff9ecdff753800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790772562.078244:0:19463:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 660 00000100:00080000:0.0:1790772562.078254:0:19463:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1790772562.078259:0:19463:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ecdff753800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:0.0:1790772562.078274:0:19463:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdf80eb100 x1877760506329856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790772562.078299:0:19463:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790772562.078302:0:19463:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790772562.078304:0:19463:0:(import.c:65:import_set_state_nolock()) ffff9ecdf8089800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790772562.078307:0:19463:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 660 00000100:00080000:0.0:1790772562.078309:0:19463:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1790772562.078313:0:19463:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ecdf8089800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:0.0:1790772562.078323:0:19463:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdf80e8a80 x1877760506330368/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790772562.078451:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1877760506329984:0@lo:400:kworker.0 00000100:00100000:0.0:1790772562.078507:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772562.078538:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1877760506330624:0@lo:400:kworker.0 00000100:00100000:0.0:1790772562.078559:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772562.078582:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790772562.078587:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1877760506329728:0@lo:400:kworker.0 00000100:00100000:0.0:1790772562.078611:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772562.078627:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877760506330496:0@lo:400:kworker.0 00000100:00100000:0.0:1790772562.078646:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772562.078671:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506329984 00000100:00100000:0.0:1790772562.078678:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506329984 00000100:00100000:0.0:1790772562.078720:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506330624 00000100:00100000:0.0:1790772562.078723:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506330624 00000100:00100000:0.0:1790772562.078753:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506330496 00000100:00100000:0.0:1790772562.078756:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506330496 00000100:00100000:0.0:1790772562.078770:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790772562.078777:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf80e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1877760506329984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772562.078826:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf80e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1877760506329984:12345-0@lo:400:kworker.0 Request processed in 49us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772562.078833:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790772562.078848:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790772562.078855:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf80e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1877760506330624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772562.078882:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf80e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1877760506330624:12345-0@lo:400:kworker.0 Request processed in 28us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772562.078887:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790772562.078899:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790772562.078905:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877760506330496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772562.078931:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877760506330496:12345-0@lo:400:kworker.0 Request processed in 27us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772562.078954:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790772562.078974:0:24695:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506329728 00000100:00100000:0.0:1790772562.078978:0:24695:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506329728 00000100:00100000:0.0:1790772562.079001:0:24695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790772562.079007:0:24695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1877760506329728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772562.079037:0:24695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1877760506329728:12345-0@lo:400:kworker.0 Request processed in 30us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772562.079042:0:24695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1790772562.079057:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790772562.079061:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772562.079089:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1877760506329728:0@lo:400:kworker.0 00010000:00080000:0.0:1790772562.079109:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ecdf80eb480 x1877760506330496/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772562.079119:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877760506330496:0@lo:400:kworker.0 00010000:00080000:0.0:1790772562.079127:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ecdf80eb800 x1877760506329984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772562.079134:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1877760506329984:0@lo:400:kworker.0 00010000:00080000:0.0:1790772562.079142:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ecdf80e9c00 x1877760506330624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772562.079148:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1877760506330624:0@lo:400:kworker.0 00000100:00100000:3.0:1790772562.081082:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1877760506329600:0@lo:400:kworker.0 00000100:00100000:3.0:1790772562.081148:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772562.081319:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1877760506330240:0@lo:400:kworker.0 00000100:00100000:3.0:1790772562.081346:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772562.081378:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1790772562.081385:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1877760506330112:0@lo:400:kworker.0 00000100:00100000:3.0:1790772562.081407:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772562.081424:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1877760506330752:0@lo:400:kworker.0 00000100:00100000:3.0:1790772562.081448:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772562.081480:0:24264:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506330240 00000100:00100000:3.0:1790772562.081487:0:24264:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506330240 00000100:00100000:3.0:1790772562.081531:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790772562.081539:0:24264:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc440f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1877760506330240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772562.081589:0:24264:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc440f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1877760506330240:12345-0@lo:400:kworker.0 Request processed in 51us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772562.081596:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790772562.081655:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1877760506330240:0@lo:400:kworker.0 00000100:00100000:1.0:1790772562.081818:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc440d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1877760506329472:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790772562.081850:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772562.081888:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506329856:0@lo:8:kworker.0 00000100:00100000:1.0:1790772562.081911:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772562.081930:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1877760506330368:0@lo:8:kworker.0 00000100:00100000:1.0:1790772562.081950:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772562.081977:0:24263:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506329856 00000100:00100000:1.0:1790772562.081981:0:24263:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506329856 00000100:00100000:1.0:1790772562.081994:0:24263:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506330368 00000100:00100000:1.0:1790772562.081996:0:24263:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506330368 00000100:00100000:1.0:1790772562.082006:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790772562.082010:0:24263:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3642:x1877760506329856:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1790772562.082072:0:24263:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3642:x1877760506329856:12345-0@lo:8:kworker.0 Request processed in 59us (159us total) trans 0 rc -11/-11 00000100:00100000:1.0:1790772562.082079:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790772562.082091:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790772562.082095:0:24263:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3642:x1877760506330368:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1790772562.082125:0:24263:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3642:x1877760506330368:12345-0@lo:8:kworker.0 Request processed in 29us (174us total) trans 0 rc -11/-11 00000100:00100000:1.0:1790772562.082131:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790772562.082159:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790772562.082198:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ecdff753800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790772562.082203:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1790772562.082206:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506329856:0@lo:8:kworker.0 00000100:00100000:1.0:1790772562.082225:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790772562.082228:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ecdf8089800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790772562.082232:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1790772562.082235:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1877760506330368:0@lo:8:kworker.0 00000100:00100000:3.0:1790772562.083679:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506330752 00000100:00100000:3.0:1790772562.083690:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506330752 00000100:00100000:3.0:1790772562.083743:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506329472 00000100:00100000:3.0:1790772562.083747:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506329472 00000100:00100000:3.0:1790772562.083761:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790772562.083770:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc440f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1877760506330752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772562.083847:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc440f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1877760506330752:12345-0@lo:400:kworker.0 Request processed in 78us (2397us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772562.083853:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790772562.083870:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790772562.083886:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1877760506329472:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1790772562.083921:0:22758:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 662 last 0 00000020:00000080:3.0:1790772562.083955:0:22758:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x418ffb1c3bcc984c 00000004:00100000:3.0:1790772562.083972:0:22758:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790772562.084003:0:22758:0:(import.c:65:import_set_state_nolock()) ffff9eccc308a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790772562.084046:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1877760506329472:12345-0@lo:38:llog_process_th.0 Request processed in 158us (2194us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772562.084053:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790772562.085510:0:22762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506329600 00000100:00100000:0.0:1790772562.085520:0:22762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506329600 00000100:00100000:0.0:1790772562.085561:0:22762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506330112 00000100:00100000:0.0:1790772562.085565:0:22762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506330112 00000100:00100000:0.0:1790772562.085582:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790772562.085589:0:22762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc440d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1877760506329600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772562.085652:0:22762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc440d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1877760506329600:12345-0@lo:400:kworker.0 Request processed in 63us (4504us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772562.085660:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790772562.085675:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790772562.085681:0:22762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc440c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1877760506330112:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1790772562.085838:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ecdf80e8e00 x1877760506330752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772562.085853:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1877760506330752:0@lo:400:kworker.0 00000100:00100000:1.0:1790772562.085866:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1877760506329600:0@lo:400:kworker.0 00010000:00080000:1.0:1790772562.085902:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9eccc440d880 x1877760506329472/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790772572 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772562.085910:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790772562.085918:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1790772562.085925:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790772562.085929:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790772562.085932:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9eccc3701000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790772562.085938:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc440d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1877760506329472:0@lo:38:llog_process_th.0 00000020:01000004:1.0:1790772562.086050:0:25091:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1790772562.086063:0:25091:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9ecdfc593380) 00000020:00000080:1.0:1790772562.086084:0:25091:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1790772562.086157:0:25091:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ecdfaa9d000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790772562.086161:0:25091:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ecdfaa9d000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790772562.087296:0:25091:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ecdfaa9d000 3 00010000:00080000:1.0:1790772562.087337:0:25091:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ecdfb41c800@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.114@tcp at head 00000100:00100000:0.0:1790772562.088393:0:22762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc440c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1877760506330112:12345-0@lo:400:kworker.0 Request processed in 2707us (6979us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772562.088406:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1790772562.088448:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790772562.088461:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790772562.092590:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1877760506330112:0@lo:400:kworker.0 00010000:00010000:2.0:1790772562.094784:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772562.095936:0:25091:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1790772562.096116:0:25091:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1790772562.099569:0:25091:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790772562.099585:0:25091:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x418ffb1c3bcc985a 00000100:00080000:1.0:1790772562.099596:0:25091:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790772562.099606:0:25091:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9ecdfb41c800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:1.0:1790772562.099641:0:25091:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdf7526d80 x1877760506330880/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790772562.099720:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf7526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1877760506330880:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790772562.099779:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790772562.105447:0:25091:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1790772562.106314:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506330880 00000100:00100000:1.0:1790772562.106326:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506330880 00000100:00100000:1.0:1790772562.106369:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790772562.106376:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc440fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1877760506330880:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1790772562.106405:0:22758:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 662 last 0 00000020:00000080:1.0:1790772562.106448:0:22758:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x418ffb1c3bcc9861 00000004:00100000:1.0:1790772562.106464:0:22758:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790772562.106498:0:22758:0:(import.c:65:import_set_state_nolock()) ffff9ecdfb41d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790772562.113478:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc440fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1877760506330880:12345-0@lo:38:llog_process_th.0 Request processed in 7092us (13689us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772562.113493:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:1.0:1790772562.113664:0:25091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1790772562.115782:0:25078:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1790772562.115862:0:25078:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790772562.115882:0:25078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd0c00/0x418ffb1c3bcc9830 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9837 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772562.115896:0:25078:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd0c00/0x418ffb1c3bcc9830 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9837 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790772562.116018:0:25078:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790772562.116026:0:25078:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790772562.116027:0:25078:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790772562.116028:0:25078:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790772562.116029:0:25078:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790772562.116030:0:25078:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790772562.116032:0:25078:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790772562.116033:0:25078:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790772562.116034:0:25078:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790772562.116038:0:25078:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1790772562.116040:0:25078:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790772562.116042:0:25078:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790772562.116042:0:25078:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790772562.116043:0:25078:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790772562.116044:0:25078:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790772562.116045:0:25078:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790772562.116046:0:25078:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790772562.116047:0:25078:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790772562.116048:0:25078:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790772562.116104:0:25078:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1790772562.116136:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf7525500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506331008:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790772562.116313:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772562.116370:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc266a900 going to sleep for 11 seconds 00000100:00100000:1.0:1790772562.116403:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506331008 00000100:00100000:1.0:1790772562.116409:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506331008 00000100:00100000:1.0:1790772562.116452:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790772562.116464:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+24:25078:x1877760506331008:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790772562.116492:0:22749:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1790772562.116552:0:22749:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1790772562.117596:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ecdf7526d80 x1877760506330880/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790772572 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772562.117616:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790772562.117640:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1790772562.117648:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1790772562.117653:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1790772562.117656:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ecdfb41c800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790772562.117667:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf7526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1877760506330880:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1790772562.120323:0:22749:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790772562.120345:0:22749:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1790772562.120683:0:22772:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790772562.120689:0:22772:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790772562.120722:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ecdff439200/0x418ffb1c3bcc9868 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772562.120739:0:22772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ecdef3a7e00/0x418ffb1c3bcc96fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc96f5 expref: 24 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772562.120762:0:22772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ecdef3a7800/0x418ffb1c3bcc970a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9703 expref: 24 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772562.120771:0:22772:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ecdff439200/0x418ffb1c3bcc9868 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772562.120806:0:22772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ecdef3a7800/0x418ffb1c3bcc970a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x418ffb1c3bcc9703 expref: 24 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772562.120820:0:22772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ecdef3a7800/0x418ffb1c3bcc970a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x418ffb1c3bcc9703 expref: 24 pid: 22751 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772562.120835:0:22772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf7527100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22772:1877760506331136:0@lo:104: 00000100:00100000:1.0:1790772562.120899:0:22772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790772562.120938:0:22772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ecdef3a7e00/0x418ffb1c3bcc96fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x418ffb1c3bcc96f5 expref: 24 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772562.120947:0:22772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ecdef3a7e00/0x418ffb1c3bcc96fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x418ffb1c3bcc96f5 expref: 24 pid: 22750 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772562.120956:0:22772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf7524380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22772:1877760506331264:0@lo:104: 00000100:00100000:1.0:1790772562.120977:0:22772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772562.121004:0:22772:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc266ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1790772562.121029:0:22739:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506331136 00000100:00100000:1.0:1790772562.121036:0:22739:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506331136 00000100:00100000:1.0:1790772562.121068:0:22739:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506331264 00000100:00100000:1.0:1790772562.121071:0:22739:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506331264 00000100:00100000:1.0:1790772562.121084:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790772562.121092:0:22739:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7524a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+4:22772:x1877760506331136:12345-0@lo:104: 00010000:00010000:1.0:1790772562.121111:0:22739:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9ecdef3a7400/0x418ffb1c3bcc9703 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x418ffb1c3bcc970a expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772562.121160:0:22739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1790772562.121357:0:25002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772562.121364:0:25002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9ecdef3a7400/0x418ffb1c3bcc9703 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x418ffb1c3bcc970a expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772562.121372:0:25002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdef3a7400 already unused, calling callback (ffffffffc11ffc20) 10000000:00010000:2.0:1790772562.121376:0:25002:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9ecdef3a7400/0x418ffb1c3bcc9703 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x418ffb1c3bcc970a expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772562.121385:0:25002:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9ecdef3a7400/0x418ffb1c3bcc9703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x418ffb1c3bcc970a expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772562.121392:0:25002:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9ecdef3a7400/0x418ffb1c3bcc9703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x418ffb1c3bcc970a expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772562.121397:0:25002:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790772562.121426:0:25002:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9ecdef3a7400/0x418ffb1c3bcc9703 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc970a expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772562.121432:0:25002:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790772562.121452:0:25002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9ecdef3a7400/0x418ffb1c3bcc9703 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc970a expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772562.121459:0:25002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9ecdef3a7400/0x418ffb1c3bcc9703 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc970a expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772562.121477:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772562.121479:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772562.121488:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772562.121496:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790772562.121509:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3e91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3645:1877760506331392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790772562.121540:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772562.121645:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+24:25078:x1877760506331008:12345-0@lo:253:mount.lustre.0 Request processed in 5185us (5331us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772562.121655:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790772562.121723:0:22739:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7524a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+4:22772:x1877760506331136:12345-0@lo:104: Request processed in 630us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772562.121730:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790772562.121745:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790772562.121751:0:22739:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7526d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+3:22772:x1877760506331264:12345-0@lo:104: 00010000:00010000:1.0:1790772562.121760:0:22739:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0200/0x418ffb1c3bcc96f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x418ffb1c3bcc96fc expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772562.121795:0:22739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790772562.121801:0:22739:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7526d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+3:22772:x1877760506331264:12345-0@lo:104: Request processed in 51us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772562.121807:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790772562.121836:0:22772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf7527100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22772:1877760506331136:0@lo:104: 00000100:00100000:1.0:1790772562.121845:0:22772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf7524380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22772:1877760506331264:0@lo:104: 00010000:00010000:1.0:1790772562.121863:0:22772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ecdff439200/0x418ffb1c3bcc9868 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772562.121883:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772562.121887:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0200/0x418ffb1c3bcc96f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x418ffb1c3bcc96fc expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772562.121893:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdfbab0200 already unused, calling callback (ffffffffc11ffc20) 10000000:00010000:1.0:1790772562.121896:0:22744:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0200/0x418ffb1c3bcc96f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x418ffb1c3bcc96fc expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772562.121910:0:22744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0200/0x418ffb1c3bcc96f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x418ffb1c3bcc96fc expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772562.121917:0:22744:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0200/0x418ffb1c3bcc96f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x418ffb1c3bcc96fc expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772562.121921:0:22744:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790772562.121940:0:22744:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0200/0x418ffb1c3bcc96f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc96fc expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772562.121946:0:22744:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790772562.121973:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0200/0x418ffb1c3bcc96f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc96fc expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772562.121981:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9ecdfbab0200/0x418ffb1c3bcc96f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc96fc expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772562.121993:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772562.121995:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772562.121997:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772562.122006:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790772562.122015:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf7524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3644:1877760506331520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790772562.122041:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772562.122069:0:22741:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506331392 00000100:00100000:1.0:1790772562.122074:0:22741:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506331392 00010000:00010000:1.0:1790772562.122092:0:22741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ecdef3a7800/0x418ffb1c3bcc970a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x418ffb1c3bcc9703 expref: 24 pid: 22751 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772562.122110:0:22741:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506331520 00000100:00100000:1.0:1790772562.122118:0:22741:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506331520 00010000:00010000:1.0:1790772562.122129:0:22741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ecdef3a7e00/0x418ffb1c3bcc96fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x418ffb1c3bcc96f5 expref: 25 pid: 22750 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772562.122143:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790772562.122149:0:22741:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3e93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+25:3645:x1877760506331392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790772562.122158:0:22741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772562.122162:0:22741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ecdef3a7800/0x418ffb1c3bcc970a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x418ffb1c3bcc9703 expref: 25 pid: 22751 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772562.122306:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf7525500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a371a4ff-c27a-4b58-b24c-92c8783ef87a:25078:1877760506331008:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790772562.122317:0:25078:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790772562.122320:0:25078:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790772562.122322:0:25078:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790772562.122323:0:25078:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790772562.122324:0:25078:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790772562.122325:0:25078:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790772562.122327:0:25078:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790772562.122328:0:25078:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790772562.122330:0:25078:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790772562.122332:0:25078:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790772562.122344:0:25078:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1790772562.125342:0:22741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ecdef3a7800/0x418ffb1c3bcc970a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x418ffb1c3bcc9703 expref: 25 pid: 22751 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772562.125364:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ecdef3a7800/0x418ffb1c3bcc970a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x418ffb1c3bcc9703 expref: 25 pid: 22751 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772562.125385:0:22741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772562.125468:0:22741:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3e93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+24:3645:x1877760506331392:12345-0@lo:103:ldlm_bl.0 Request processed in 3318us (3926us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772562.125477:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790772562.125510:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790772562.125521:0:22741:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7527100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+23:3644:x1877760506331520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790772562.125539:0:22741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772562.125545:0:22741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ecdef3a7e00/0x418ffb1c3bcc96fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x418ffb1c3bcc96f5 expref: 23 pid: 22750 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772562.125554:0:22741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ecdef3a7e00/0x418ffb1c3bcc96fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x418ffb1c3bcc96f5 expref: 23 pid: 22750 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772562.125564:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ecdef3a7e00/0x418ffb1c3bcc96fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x418ffb1c3bcc96f5 expref: 23 pid: 22750 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772562.125590:0:22741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ecdff439200/0x418ffb1c3bcc9868 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772562.125599:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ecdff439200/0x418ffb1c3bcc9868 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790772562.125614:0:22741:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009740906s 00010000:00010000:1.0:1790772562.125618:0:22741:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ecdff439200/0x418ffb1c3bcc9868 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772562.125625:0:22741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ecdff439200/0x418ffb1c3bcc9868 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772562.125631:0:22741:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ecdff439200/0x418ffb1c3bcc9868 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772562.125638:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ecdff439200/0x418ffb1c3bcc9868 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772562.125644:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdff439200 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:1.0:1790772562.125648:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ecdff439200/0x418ffb1c3bcc9868 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772562.125655:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ecdff439200/0x418ffb1c3bcc9868 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772562.125674:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ecdff439200/0x418ffb1c3bcc9868 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772562.125684:0:22741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772562.125734:0:22741:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7527100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+22:3644:x1877760506331520:12345-0@lo:103:ldlm_bl.0 Request processed in 217us (3691us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772562.125741:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1790772562.125844:0:22772:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ecdff439200/0x418ffb1c3bcc9868 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772562.125853:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ecdff439200/0x418ffb1c3bcc9868 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772562.125859:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ecdff439200/0x418ffb1c3bcc9868 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772562.125896:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf7524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3644:1877760506331520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790772562.125998:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3e91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3645:1877760506331392:0@lo:103:ldlm_bl.0 00000001:00000004:1.0:1790772562.133312:0:25078:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1790772562.144802:0:25078:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1790772562.144812:0:25078:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1790772562.144848:0:25078:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790772562.144885:0:25078:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.114@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790772562.144903:0:25078:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1790772562.144927:0:25078:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1790772562.145769:0:25078:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790772562.145987:0:25078:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790772563.094501:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790772563.167936:0:22754:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790772563.167944:0:22754:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ecde1727000 from 14 10000000:01000000:3.0:1790772563.167949:0:22754:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790772563.167992:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9eccc3561a00/0x418ffb1c3bcc986f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772563.168017:0:22754:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9eccc3561a00/0x418ffb1c3bcc986f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772563.168028:0:22754:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9eccc3561a00/0x418ffb1c3bcc986f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772563.168052:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc440ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506331648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790772563.168116:0:22754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772563.168162:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc2bd4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790772563.168193:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506331648 00000100:00100000:0.0:1790772563.168201:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506331648 00000100:00100000:0.0:1790772563.168247:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1790772563.168257:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+22:22754:x1877760506331648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790772563.168270:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772563.168283:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eccc1bd1200/0x418ffb1c3bcc9876 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x418ffb1c3bcc986f expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772563.168305:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eccc1bd1200/0x418ffb1c3bcc9876 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x418ffb1c3bcc986f expref: 23 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772563.168316:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eccc1bd1200/0x418ffb1c3bcc9876 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc986f expref: 23 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772563.168324:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eccc1bd1200, rc 0) 00000100:00100000:0.0:1790772563.168360:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+23:22754:x1877760506331648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772563.168366:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790772563.170917:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc440ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506331648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772563.170944:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9eccc3561a00/0x418ffb1c3bcc986f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9876 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772563.170956:0:22754:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9eccc3561a00/0x418ffb1c3bcc986f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc9876 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772563.171045:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc440ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506331776:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1790772563.171110:0:22754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772563.171151:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc2bd4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790772563.181076:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506331776 00000100:00100000:0.0:1790772563.181090:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506331776 00000100:00100000:0.0:1790772563.181196:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1790772563.181206:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+23:22754:x1877760506331776:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790772563.181233:0:22749:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790772563.181250:0:22749:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790772563.181254:0:22749:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1790772563.181387:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+23:22754:x1877760506331776:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 182us (10276us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772563.181411:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790772563.193753:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc440ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506331776:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1790772563.194112:0:22754:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790772563.194122:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9eccc3561a00/0x418ffb1c3bcc986f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9876 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772563.194134:0:22754:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9eccc3561a00/0x418ffb1c3bcc986f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9876 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772563.194154:0:22754:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790772563.194157:0:22754:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ecdfb45f000 from 14 10000000:01000000:3.0:1790772563.194160:0:22754:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790772563.194219:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9eccc3561600/0x418ffb1c3bcc987d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772563.194229:0:22754:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9eccc3561600/0x418ffb1c3bcc987d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772563.194238:0:22754:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9eccc3561600/0x418ffb1c3bcc987d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772563.194256:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc440ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506331904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790772563.194311:0:22754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772563.194348:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc2bd4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790772563.196220:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506331904 00000100:00100000:2.0:1790772563.196234:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506331904 00000100:00100000:2.0:1790772563.196290:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1790772563.196300:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+23:22754:x1877760506331904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790772563.196317:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772563.196335:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ecdc29ccc00/0x418ffb1c3bcc9884 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x418ffb1c3bcc987d expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772563.196359:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ecdc29ccc00/0x418ffb1c3bcc9884 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x418ffb1c3bcc987d expref: 24 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772563.196369:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ecdc29ccc00/0x418ffb1c3bcc9884 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc987d expref: 24 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772563.196393:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdc29ccc00, rc 0) 00000100:00100000:2.0:1790772563.196467:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+24:22754:x1877760506331904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (2155us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772563.196473:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790772563.200063:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc440ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506331904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772563.200093:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9eccc3561600/0x418ffb1c3bcc987d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9884 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772563.200106:0:22754:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9eccc3561600/0x418ffb1c3bcc987d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc9884 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772563.200189:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc440ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506332032:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1790772563.200248:0:22754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772563.200285:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc2bd4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790772563.200305:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506332032 00000100:00100000:3.0:1790772563.200312:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506332032 00000100:00100000:3.0:1790772563.200358:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1790772563.200365:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+24:22754:x1877760506332032:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1790772563.200384:0:22750:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790772563.200399:0:22750:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790772563.200402:0:22750:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1790772563.200479:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+24:22754:x1877760506332032:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 114us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772563.200487:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1790772563.200524:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc440ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506332032:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1790772563.200574:0:22754:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790772563.200582:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9eccc3561600/0x418ffb1c3bcc987d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9884 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772563.200591:0:22754:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9eccc3561600/0x418ffb1c3bcc987d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9884 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:3.0:1790772563.613399:0:25145:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790772563.613627:0:25145:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790772564.116429:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772564.244456:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790772564.244479:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3e91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506332160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790772564.244543:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772564.244625:0:22762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506332160 00000100:00100000:2.0:1790772564.244633:0:22762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506332160 00000100:00100000:2.0:1790772564.244733:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790772564.244742:0:22762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc440ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506332160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790772564.244773:0:22762:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1790772564.244818:0:22762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc440ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506332160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772564.244837:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790772564.245001:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3e91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506332160:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790772564.245390:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790772564.245399:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1877760506332288:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790772564.245430:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772564.245456:0:22761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506332288 00000100:00100000:2.0:1790772564.245460:0:22761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506332288 00000100:00100000:2.0:1790772564.245482:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790772564.245489:0:22761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1877760506332288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790772564.245510:0:22761:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790772564.245541:0:22761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1877760506332288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772564.245548:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790772564.245574:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1877760506332288:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790772564.246620:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790772564.246632:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdff730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506332416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790772564.246672:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772564.246723:0:24267:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506332416 00000100:00100000:3.0:1790772564.246728:0:24267:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506332416 00000100:00100000:3.0:1790772564.246772:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790772564.246779:0:24267:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc440f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506332416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790772564.246801:0:24267:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1790772564.246957:0:24267:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc440f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506332416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 178us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772564.246965:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1790772564.246982:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790772564.247035:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdff730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506332416:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1790772565.140700:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772565.269642:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790772565.269665:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdff730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1877760506332544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790772565.269736:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772565.269818:0:24267:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506332544 00000100:00100000:0.0:1790772565.269825:0:24267:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506332544 00000100:00100000:0.0:1790772565.269888:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790772565.269898:0:24267:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3e91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877760506332544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790772565.269919:0:24267:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1790772565.269967:0:24267:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3e91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877760506332544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772565.269974:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790772565.270015:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdff730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1877760506332544:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790772565.270196:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790772566.164763:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790772566.613789:0:22792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790772567.189494:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790772567.316290:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790772567.316296:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790772567.316299:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ecdff753800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790772567.316313:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ecdff753800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:2.0:1790772567.316330:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdf62e7800 x1877760506333056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790772567.316360:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790772567.316363:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790772567.316365:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ecdf8089800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790772567.316370:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ecdf8089800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:2.0:1790772567.316378:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ecdf62e6a00 x1877760506333568/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790772567.316425:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3644:1877760506332672:0@lo:400:kworker.0 00000100:00100000:2.0:1790772567.316482:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772567.316522:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1877760506333312:0@lo:400:kworker.0 00000100:00100000:2.0:1790772567.316545:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772567.316563:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdff7e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1877760506333952:0@lo:400:kworker.0 00000100:00100000:2.0:1790772567.316584:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772567.316616:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790772567.316621:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1877760506333184:0@lo:400:kworker.0 00000100:00100000:2.0:1790772567.316642:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772567.316660:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1877760506333824:0@lo:400:kworker.0 00000100:00100000:2.0:1790772567.316697:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772567.316726:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc12aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506332800:0@lo:400:kworker.0 00000100:00100000:2.0:1790772567.316749:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772567.316765:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506333440:0@lo:400:kworker.0 00000100:00100000:2.0:1790772567.316826:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772567.316843:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdff7e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1877760506334080:0@lo:400:kworker.0 00000100:00100000:2.0:1790772567.316866:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772567.316878:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1790772567.316883:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506332928:0@lo:400:kworker.0 00000100:00100000:2.0:1790772567.316904:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772567.316920:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1877760506333696:0@lo:400:kworker.0 00000100:00100000:2.0:1790772567.316953:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772567.316963:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdff7e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1877760506334208:0@lo:400:kworker.0 00000100:00100000:2.0:1790772567.316984:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772567.317009:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506332672 00000100:00100000:2.0:1790772567.317016:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506332672 00000100:00100000:2.0:1790772567.317055:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1790772567.317063:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+24:3644:x1877760506332672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772567.317108:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+24:3644:x1877760506332672:12345-0@lo:400:kworker.0 Request processed in 46us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772567.317115:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1790772567.317152:0:23497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506333312 00000100:00100000:2.0:1790772567.317156:0:23497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506333312 00000100:00100000:2.0:1790772567.317203:0:23497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506332800 00000100:00100000:2.0:1790772567.317206:0:23497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506332800 00000100:00100000:2.0:1790772567.317219:0:23497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790772567.317225:0:23497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff7e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1877760506333312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772567.317259:0:23497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff7e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1877760506333312:12345-0@lo:400:kworker.0 Request processed in 34us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772567.317265:0:23497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790772567.317277:0:23497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790772567.317283:0:23497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff7e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1877760506332800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772567.317315:0:23497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff7e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1877760506332800:12345-0@lo:400:kworker.0 Request processed in 32us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772567.317321:0:23497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790772567.317338:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506333952 00000100:00100000:2.0:1790772567.317341:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506333952 00000100:00100000:2.0:1790772567.317367:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506333184 00000100:00100000:2.0:1790772567.317369:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506333184 00000100:00100000:2.0:1790772567.317378:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506333824 00000100:00100000:2.0:1790772567.317380:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506333824 00000100:00100000:2.0:1790772567.317391:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506334080 00000100:00100000:2.0:1790772567.317394:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506334080 00000100:00100000:2.0:1790772567.317403:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506333696 00000100:00100000:2.0:1790772567.317406:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506333696 00000100:00100000:2.0:1790772567.317414:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506334208 00000100:00100000:2.0:1790772567.317416:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506334208 00000100:00100000:2.0:1790772567.317428:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790772567.317433:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff7e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1877760506333952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772567.317463:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff7e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1877760506333952:12345-0@lo:400:kworker.0 Request processed in 30us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772567.317478:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790772567.317494:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790772567.317500:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff7e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1877760506333184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772567.317528:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff7e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1877760506333184:12345-0@lo:400:kworker.0 Request processed in 29us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772567.317533:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790772567.317543:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790772567.317548:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff7e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1877760506333824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772567.317571:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff7e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1877760506333824:12345-0@lo:400:kworker.0 Request processed in 23us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772567.317576:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790772567.317588:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790772567.317593:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1877760506334080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772567.317618:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1877760506334080:12345-0@lo:400:kworker.0 Request processed in 25us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772567.317622:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790772567.317633:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790772567.317638:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1877760506333696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772567.317663:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1877760506333696:12345-0@lo:400:kworker.0 Request processed in 25us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772567.317669:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790772567.317692:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790772567.317697:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff7e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1877760506334208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772567.317722:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff7e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1877760506334208:12345-0@lo:400:kworker.0 Request processed in 25us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772567.317736:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790772567.317765:0:24263:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506333440 00000100:00100000:2.0:1790772567.317769:0:24263:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506333440 00000100:00100000:2.0:1790772567.317794:0:24263:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506332928 00000100:00100000:2.0:1790772567.317797:0:24263:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506332928 00000100:00100000:2.0:1790772567.317815:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790772567.317820:0:24263:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff7e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506333440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772567.317851:0:24263:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff7e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506333440:12345-0@lo:400:kworker.0 Request processed in 30us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772567.317856:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790772567.317867:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790772567.317872:0:24263:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff7e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1877760506332928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772567.317897:0:24263:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff7e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1877760506332928:12345-0@lo:400:kworker.0 Request processed in 25us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772567.317903:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1790772567.317928:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790772567.317932:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790772567.317934:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790772567.317965:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506332928:0@lo:400:kworker.0 00010000:00080000:2.0:1790772567.317977:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ecdf62e7b80 x1877760506333696/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772567.317986:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1877760506333696:0@lo:400:kworker.0 00010000:00080000:2.0:1790772567.317996:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ecdff7e4700 x1877760506334208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772567.318003:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdff7e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1877760506334208:0@lo:400:kworker.0 00000100:00100000:2.0:1790772567.318024:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506332800:0@lo:400:kworker.0 00000100:00100000:2.0:1790772567.318032:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506333440:0@lo:400:kworker.0 00010000:00080000:2.0:1790772567.318041:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ecdff7e7b80 x1877760506334080/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772567.318048:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdff7e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1877760506334080:0@lo:400:kworker.0 00010000:00080000:2.0:1790772567.318083:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ecdf62e5500 x1877760506333184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772567.318091:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1877760506333184:0@lo:400:kworker.0 00010000:00080000:2.0:1790772567.318101:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ecdf62e6680 x1877760506333824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772567.318109:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1877760506333824:0@lo:400:kworker.0 00000100:00100000:2.0:1790772567.318117:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc12ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3644:1877760506332672:0@lo:400:kworker.0 00000100:00100000:2.0:1790772567.318127:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1877760506333312:0@lo:400:kworker.0 00010000:00080000:2.0:1790772567.318136:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ecdff7e7480 x1877760506333952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772567.318143:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdff7e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1877760506333952:0@lo:400:kworker.0 00000100:00100000:2.0:1790772567.318210:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506333056:0@lo:8:kworker.0 00000100:00100000:2.0:1790772567.318239:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772567.318258:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1877760506333568:0@lo:8:kworker.0 00000100:00100000:2.0:1790772567.318278:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772567.318311:0:24695:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506333056 00000100:00100000:2.0:1790772567.318315:0:24695:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506333056 00000100:00100000:2.0:1790772567.318331:0:24695:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506333568 00000100:00100000:2.0:1790772567.318333:0:24695:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506333568 00000100:00100000:2.0:1790772567.318345:0:24695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790772567.318349:0:24695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff7e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3642:x1877760506333056:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1790772567.318384:0:24695:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 667 last 0 00000020:00000080:2.0:1790772567.318407:0:24695:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x418ffb1c3bcc988b 00002000:00100000:2.0:1790772567.318420:0:24695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9eccc3700800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1790772567.318424:0:24695:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1790772567.318427:0:24695:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790772567.318582:0:24695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790772567.318604:0:24695:0:(import.c:65:import_set_state_nolock()) ffff9eccc3702800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790772567.318642:0:24695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff7e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3642:x1877760506333056:12345-0@lo:8:kworker.0 Request processed in 291us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772567.318648:0:24695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790772567.318660:0:24695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790772567.318665:0:24695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3642:x1877760506333568:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1790772567.324769:0:24695:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 667 last 0 00000020:00000080:2.0:1790772567.324802:0:24695:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x418ffb1c3bcc9892 00002000:00100000:2.0:1790772567.324820:0:24695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9eccc3703000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b03 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1790772567.324825:0:24695:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1790772567.324828:0:24695:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790772567.324892:0:24695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1790772567.324920:0:24695:0:(import.c:65:import_set_state_nolock()) ffff9eccc3701800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790772567.325215:0:24695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3642:x1877760506333568:12345-0@lo:8:kworker.0 Request processed in 6547us (6934us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772567.325234:0:24695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1790772567.325291:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ecdf62e7800 x1877760506333056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790772592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790772567.325306:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1790772567.325316:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1790772567.325320:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1790772567.325322:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ecdff753800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1790772567.325337:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1790772567.325343:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1877760506333056:0@lo:8:kworker.0 00010000:00080000:2.0:1790772567.325357:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ecdf62e6a00 x1877760506333568/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790772592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790772567.325365:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1790772567.325370:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1790772567.325372:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1790772567.325374:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ecdf8089800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1790772567.325383:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1790772567.325386:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1877760506333568:0@lo:8:kworker.0 00000004:00080000:0.0:1790772567.325491:0:22783:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1790772567.325511:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdff730000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22783:1877760506334464:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1790772567.325551:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772567.325574:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecde03513c0 going to sleep for 11 seconds 00000004:00080000:0.0:1790772567.325589:0:23500:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1790772567.325660:0:23500:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 667624494129ns, next at 0ns, rc = 0 00080000:00080000:0.0:1790772567.325667:0:23500:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1790772567.325731:0:24262:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506334464 00000100:00100000:0.0:1790772567.325743:0:24262:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506334464 00000100:00100000:0.0:1790772567.325780:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790772567.325787:0:24262:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff733800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22783:x1877760506334464:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1790772567.326033:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdff730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1877760506334336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790772567.326062:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790772567.326100:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790772567.326148:0:24267:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506334336 00000100:00100000:0.0:1790772567.326153:0:24267:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506334336 00000100:00100000:0.0:1790772567.326246:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790772567.326253:0:24267:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff7e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1877760506334336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790772567.326271:0:24267:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790772567.326309:0:24267:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff7e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1877760506334336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772567.326315:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1790772567.326417:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ecdff730e00 x1877760506334336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772583 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772567.326432:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdff730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1877760506334336:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1790772567.329772:0:22782:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1790772567.329875:0:22782:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 667628709305ns, next at 0ns, rc = 0 00080000:00080000:3.0:1790772567.329884:0:22782:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00002000:00080000:2.0:1790772567.330963:0:24262:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1790772567.330996:0:24262:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:2.0:1790772567.331002:0:24262:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:65) 00000004:00080000:3.0:1790772567.333320:0:23501:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1790772567.333349:0:23501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc440df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23501:1877760506334720:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1790772567.333410:0:23501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772567.333440:0:23501:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdd9a5d180 going to sleep for 11 seconds 00000100:00100000:3.0:1790772567.333587:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790772567.333600:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc440e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506334592:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790772567.333627:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772567.333654:0:24267:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506334592 00000100:00100000:3.0:1790772567.333661:0:24267:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506334592 00000100:00100000:3.0:1790772567.333826:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790772567.333835:0:24267:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc440ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1877760506334592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790772567.333852:0:24267:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1790772567.333893:0:24267:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc440ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1877760506334592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772567.333899:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1790772567.333935:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9eccc440e300 x1877760506334592/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772583 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772567.333965:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc440e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506334592:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790772567.333988:0:24263:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506334720 00000100:00100000:3.0:1790772567.333991:0:24263:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506334720 00000100:00100000:3.0:1790772567.334014:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790772567.334021:0:24263:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc440d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23501:x1877760506334720:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:0.0:1790772567.334289:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1790772567.335910:0:24263:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1790772567.335917:0:24263:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1790772567.335986:0:24263:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc440d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23501:x1877760506334720:12345-0@lo:7:osp-pre-1-1.0 Request processed in 1964us (2574us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772567.335995:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1790772567.336039:0:23501:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9eccc440df80 x1877760506334720/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790772583 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772567.336052:0:23501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc440df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23501:1877760506334720:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1790772567.336063:0:23501:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1790772567.336096:0:23501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc440df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23501:1877760506334848:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1790772567.336125:0:23501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772567.336142:0:23501:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdfaa7a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772567.336371:0:24264:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506334848 00000100:00100000:0.0:1790772567.336377:0:24264:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506334848 00000100:00100000:0.0:1790772567.336412:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790772567.336420:0:24264:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc440e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23501:x1877760506334848:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1790772567.336443:0:24264:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1790772567.336476:0:24264:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc440e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23501:x1877760506334848:12345-0@lo:5:osp-pre-1-1.0 Request processed in 57us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772567.336483:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1790772567.336554:0:23501:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9eccc440df80 x1877760506334848/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790772583 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772567.336564:0:23501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc440df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23501:1877760506334848:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1790772567.336572:0:23501:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1790772567.336596:0:23501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc440df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23501:1877760506334976:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1790772567.336618:0:23501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772567.336642:0:23501:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdfaa7a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790772567.336687:0:24263:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506334976 00000100:00100000:3.0:1790772567.336691:0:24263:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506334976 00000100:00100000:3.0:1790772567.336715:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790772567.336721:0:24263:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc440dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23501:x1877760506334976:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1790772567.336744:0:24263:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000004:00080000:3.0:1790772567.337052:0:22736:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00080000:0.0:1790772567.353085:0:25079:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:0.0:1790772567.353098:0:25079:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1790772567.353102:0:25079:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1790772567.353318:0:24263:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc440dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:23501:x1877760506334976:12345-0@lo:5:osp-pre-1-1.0 Request processed in 16592us (16694us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1790772567.353328:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1790772567.353380:0:23501:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9eccc440df80 x1877760506334976/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790772583 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772567.353402:0:23501:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1790772567.353409:0:23501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc440df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23501:1877760506334976:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1790772567.353424:0:23501:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:0.0:1790772567.353470:0:23501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdff733480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23501:1877760506335104:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1790772567.353502:0:23501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772567.353523:0:23501:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecde0351cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772567.353539:0:22767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506335104 00000100:00100000:0.0:1790772567.353544:0:22767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506335104 00000100:00100000:0.0:1790772567.353582:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790772567.353591:0:22767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23501:x1877760506335104:12345-0@lo:900:osp-pre-1-1.0 00000004:00080000:2.0:1790772567.353994:0:23489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:3.0:1790772567.354540:0:24262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790772567.354549:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be200f9d/0x418ffb1c3bcc9899 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.354565:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=667s v=(0 0) 00010000:00010000:3.0:1790772567.354569:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772567.354576:0:24262:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be200f9d/0x418ffb1c3bcc9899 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.354594:0:24262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be200f9d/0x418ffb1c3bcc9899 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.354604:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be200f9d/0x418ffb1c3bcc9899 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.354613:0:24262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be200f9d/0x418ffb1c3bcc9899 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772567.355100:0:22767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23501:x1877760506335104:12345-0@lo:900:osp-pre-1-1.0 Request processed in 46us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772567.355111:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1790772567.355258:0:24262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:0.0:1790772567.355567:0:23501:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ecdff733480 x1877760506335104/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790772583 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772567.355581:0:23501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdff733480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23501:1877760506335104:0@lo:900:osp-pre-1-1.0 00002000:00010000:3.0:1790772567.356321:0:24262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790772567.356331:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cc3a388/0x418ffb1c3bcc98a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.356354:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=667s v=(0 0) 00010000:00010000:3.0:1790772567.356358:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772567.356365:0:24262:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cc3a388/0x418ffb1c3bcc98a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.356378:0:24262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cc3a388/0x418ffb1c3bcc98a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.356389:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cc3a388/0x418ffb1c3bcc98a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.356398:0:24262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cc3a388/0x418ffb1c3bcc98a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.356624:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790772567.356633:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be200f9d/0x418ffb1c3bcc9899 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.356642:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc3560e00 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:2.0:1790772567.356647:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be200f9d/0x418ffb1c3bcc9899 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.356658:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be200f9d/0x418ffb1c3bcc9899 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.356687:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be200f9d/0x418ffb1c3bcc9899 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.356695:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be200f9d/0x418ffb1c3bcc9899 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.356705:0:24262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790772567.356716:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772567.356717:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772567.356722:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cc3a388/0x418ffb1c3bcc98a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.356730:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc3560800 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:2.0:1790772567.356734:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cc3a388/0x418ffb1c3bcc98a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.356756:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cc3a388/0x418ffb1c3bcc98a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.356769:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cc3a388/0x418ffb1c3bcc98a0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.356777:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cc3a388/0x418ffb1c3bcc98a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.356795:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772567.356797:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772567.356799:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772567.357906:0:24262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790772567.357915:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084982cff/0x418ffb1c3bcc98a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.357929:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=667s v=(0 0) 00010000:00010000:3.0:1790772567.357933:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772567.357939:0:24262:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084982cff/0x418ffb1c3bcc98a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.357951:0:24262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084982cff/0x418ffb1c3bcc98a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.357967:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084982cff/0x418ffb1c3bcc98a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.357975:0:24262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084982cff/0x418ffb1c3bcc98a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.358004:0:24262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790772567.358064:0:25002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772567.358072:0:25002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084982cff/0x418ffb1c3bcc98a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.358081:0:25002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc3561800 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:2.0:1790772567.358085:0:25002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084982cff/0x418ffb1c3bcc98a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.358093:0:25002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084982cff/0x418ffb1c3bcc98a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.358117:0:25002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084982cff/0x418ffb1c3bcc98a7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.358140:0:25002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084982cff/0x418ffb1c3bcc98a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.358155:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772567.358157:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772567.358158:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772567.359043:0:24262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790772567.359052:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ba5267a/0x418ffb1c3bcc98ae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.359065:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=667s v=(0 0) 00010000:00010000:3.0:1790772567.359069:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772567.359074:0:24262:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ba5267a/0x418ffb1c3bcc98ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.359083:0:24262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ba5267a/0x418ffb1c3bcc98ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.359091:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ba5267a/0x418ffb1c3bcc98ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.359098:0:24262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ba5267a/0x418ffb1c3bcc98ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.359132:0:24262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790772567.359213:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772567.359220:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ba5267a/0x418ffb1c3bcc98ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.359230:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc3561c00 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:2.0:1790772567.359234:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ba5267a/0x418ffb1c3bcc98ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.359244:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ba5267a/0x418ffb1c3bcc98ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.359259:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ba5267a/0x418ffb1c3bcc98ae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.359267:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ba5267a/0x418ffb1c3bcc98ae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.359285:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772567.359288:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772567.359290:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772567.359536:0:24262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790772567.359542:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b85cd9a/0x418ffb1c3bcc98b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.359551:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=667s v=(0 0) 00010000:00010000:3.0:1790772567.359554:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772567.359558:0:24262:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b85cd9a/0x418ffb1c3bcc98b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.359566:0:24262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b85cd9a/0x418ffb1c3bcc98b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.359574:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b85cd9a/0x418ffb1c3bcc98b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.359581:0:24262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b85cd9a/0x418ffb1c3bcc98b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.359600:0:24262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790772567.359632:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772567.359638:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b85cd9a/0x418ffb1c3bcc98b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.359647:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc3561200 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:2.0:1790772567.359652:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b85cd9a/0x418ffb1c3bcc98b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.359661:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b85cd9a/0x418ffb1c3bcc98b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.359683:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b85cd9a/0x418ffb1c3bcc98b5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.359690:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b85cd9a/0x418ffb1c3bcc98b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.359707:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772567.359709:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772567.359711:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772567.360345:0:24262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790772567.360353:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c79404d/0x418ffb1c3bcc98bc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.360363:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=667s v=(0 0) 00010000:00010000:3.0:1790772567.360373:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772567.360379:0:24262:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c79404d/0x418ffb1c3bcc98bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.360390:0:24262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c79404d/0x418ffb1c3bcc98bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.360398:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c79404d/0x418ffb1c3bcc98bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.360406:0:24262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c79404d/0x418ffb1c3bcc98bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.360428:0:24262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790772567.360802:0:24262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790772567.360809:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8f69b7e/0x418ffb1c3bcc98c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.360818:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=667s v=(0 0) 00010000:00010000:3.0:1790772567.360821:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772567.360825:0:24262:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8f69b7e/0x418ffb1c3bcc98c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.360834:0:24262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8f69b7e/0x418ffb1c3bcc98c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.360841:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8f69b7e/0x418ffb1c3bcc98c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.360854:0:24262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8f69b7e/0x418ffb1c3bcc98c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.360878:0:24262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1790772567.361195:0:24262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790772567.361201:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d16c7897/0x418ffb1c3bcc98ca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.361211:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=667s v=(0 0) 00010000:00010000:3.0:1790772567.361214:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772567.361218:0:24262:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d16c7897/0x418ffb1c3bcc98ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.361227:0:24262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d16c7897/0x418ffb1c3bcc98ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.361235:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d16c7897/0x418ffb1c3bcc98ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.361242:0:24262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d16c7897/0x418ffb1c3bcc98ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.361258:0:24262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1790772567.361266:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790772567.361272:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c79404d/0x418ffb1c3bcc98bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.361285:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc3560c00 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:3.0:1790772567.361290:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c79404d/0x418ffb1c3bcc98bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.361299:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c79404d/0x418ffb1c3bcc98bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.361313:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c79404d/0x418ffb1c3bcc98bc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.361321:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c79404d/0x418ffb1c3bcc98bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.361338:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790772567.361341:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8f69b7e/0x418ffb1c3bcc98c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.361347:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc3561400 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:3.0:1790772567.361350:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8f69b7e/0x418ffb1c3bcc98c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.361357:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8f69b7e/0x418ffb1c3bcc98c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.361366:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8f69b7e/0x418ffb1c3bcc98c3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.361380:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8f69b7e/0x418ffb1c3bcc98c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.361393:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772567.361396:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d16c7897/0x418ffb1c3bcc98ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.361402:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc3560600 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:3.0:1790772567.361405:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d16c7897/0x418ffb1c3bcc98ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.361413:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d16c7897/0x418ffb1c3bcc98ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.361423:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d16c7897/0x418ffb1c3bcc98ca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.361430:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d16c7897/0x418ffb1c3bcc98ca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.361442:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772567.361443:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772567.361445:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772567.361902:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772567.362522:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790772567.362543:0:24262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790772567.362553:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083ba92af/0x418ffb1c3bcc98d1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.362567:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=667s v=(0 0) 00010000:00010000:2.0:1790772567.362571:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772567.362577:0:24262:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083ba92af/0x418ffb1c3bcc98d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.362599:0:24262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083ba92af/0x418ffb1c3bcc98d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.362610:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083ba92af/0x418ffb1c3bcc98d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.362619:0:24262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083ba92af/0x418ffb1c3bcc98d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.362642:0:24262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790772567.362816:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772567.362823:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083ba92af/0x418ffb1c3bcc98d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.362836:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdc29cdc00 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:3.0:1790772567.362840:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083ba92af/0x418ffb1c3bcc98d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.362848:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083ba92af/0x418ffb1c3bcc98d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.362862:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083ba92af/0x418ffb1c3bcc98d1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.362869:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083ba92af/0x418ffb1c3bcc98d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.362887:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772567.362889:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772567.362891:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772567.363375:0:24262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790772567.363382:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042a70ee6/0x418ffb1c3bcc98d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.363393:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=667s v=(0 0) 00010000:00010000:3.0:1790772567.363397:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772567.363402:0:24262:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042a70ee6/0x418ffb1c3bcc98d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.363413:0:24262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042a70ee6/0x418ffb1c3bcc98d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.363428:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042a70ee6/0x418ffb1c3bcc98d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.363435:0:24262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042a70ee6/0x418ffb1c3bcc98d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.363456:0:24262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790772567.363590:0:25002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772567.363596:0:25002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042a70ee6/0x418ffb1c3bcc98d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.363604:0:25002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc3560000 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:2.0:1790772567.363608:0:25002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042a70ee6/0x418ffb1c3bcc98d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.363616:0:25002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042a70ee6/0x418ffb1c3bcc98d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.363630:0:25002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042a70ee6/0x418ffb1c3bcc98d8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.363636:0:25002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042a70ee6/0x418ffb1c3bcc98d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.363661:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772567.363663:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772567.363665:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772567.363912:0:24262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790772567.363917:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b44e7ebd/0x418ffb1c3bcc98df lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.363926:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=667s v=(0 0) 00010000:00010000:3.0:1790772567.363929:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772567.363933:0:24262:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b44e7ebd/0x418ffb1c3bcc98df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.363941:0:24262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b44e7ebd/0x418ffb1c3bcc98df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.363949:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b44e7ebd/0x418ffb1c3bcc98df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.363956:0:24262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b44e7ebd/0x418ffb1c3bcc98df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.363988:0:24262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790772567.364294:0:24262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790772567.364300:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002434fc6a/0x418ffb1c3bcc98e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.364308:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=667s v=(0 0) 00010000:00010000:3.0:1790772567.364311:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772567.364315:0:24262:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002434fc6a/0x418ffb1c3bcc98e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.364323:0:24262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002434fc6a/0x418ffb1c3bcc98e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.364330:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002434fc6a/0x418ffb1c3bcc98e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.364337:0:24262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002434fc6a/0x418ffb1c3bcc98e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.364351:0:24262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790772567.364358:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790772567.364362:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b44e7ebd/0x418ffb1c3bcc98df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.364369:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc3561000 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:3.0:1790772567.364378:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b44e7ebd/0x418ffb1c3bcc98df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.364386:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b44e7ebd/0x418ffb1c3bcc98df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.364397:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b44e7ebd/0x418ffb1c3bcc98df lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.364403:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b44e7ebd/0x418ffb1c3bcc98df lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.364418:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772567.364421:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002434fc6a/0x418ffb1c3bcc98e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.364427:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc3561e00 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:3.0:1790772567.364430:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002434fc6a/0x418ffb1c3bcc98e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.364438:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002434fc6a/0x418ffb1c3bcc98e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.364447:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002434fc6a/0x418ffb1c3bcc98e6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.364454:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002434fc6a/0x418ffb1c3bcc98e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.364473:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772567.364475:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772567.364477:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772567.364514:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772567.364833:0:24262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790772567.364839:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029b30956/0x418ffb1c3bcc98ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.364847:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=667s v=(0 0) 00010000:00010000:3.0:1790772567.364850:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772567.364854:0:24262:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029b30956/0x418ffb1c3bcc98ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.364862:0:24262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029b30956/0x418ffb1c3bcc98ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.364870:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029b30956/0x418ffb1c3bcc98ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.364876:0:24262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029b30956/0x418ffb1c3bcc98ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.364895:0:24262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790772567.365380:0:24262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790772567.365387:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc98f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.365408:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=667s v=(0 0) 00010000:00010000:3.0:1790772567.365412:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772567.365416:0:24262:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc98f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.365426:0:24262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc98f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.365435:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc98f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.365442:0:24262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc98f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.365456:0:24262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790772567.365464:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790772567.365468:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029b30956/0x418ffb1c3bcc98ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.365476:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc3560200 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:3.0:1790772567.365479:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029b30956/0x418ffb1c3bcc98ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.365488:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029b30956/0x418ffb1c3bcc98ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.365511:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029b30956/0x418ffb1c3bcc98ed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.365519:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029b30956/0x418ffb1c3bcc98ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.365538:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772567.365541:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc98f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.365548:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf4bd9200 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:3.0:1790772567.365552:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc98f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.365560:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc98f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.365569:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc98f4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.365577:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc98f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.365588:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772567.365589:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772567.365597:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772567.365900:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772567.368233:0:24262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790772567.368247:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc79d99d/0x418ffb1c3bcc98fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.368265:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=667s v=(0 0) 00010000:00010000:3.0:1790772567.368270:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772567.368278:0:24262:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc79d99d/0x418ffb1c3bcc98fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.368291:0:24262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc79d99d/0x418ffb1c3bcc98fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.368301:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc79d99d/0x418ffb1c3bcc98fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.368309:0:24262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc79d99d/0x418ffb1c3bcc98fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.368332:0:24262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790772567.368554:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772567.368561:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc79d99d/0x418ffb1c3bcc98fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.368571:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf4bd8600 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:2.0:1790772567.368575:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc79d99d/0x418ffb1c3bcc98fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.368585:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc79d99d/0x418ffb1c3bcc98fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.368602:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc79d99d/0x418ffb1c3bcc98fb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.368609:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc79d99d/0x418ffb1c3bcc98fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.368628:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772567.368630:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772567.368632:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772567.368884:0:24262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790772567.368891:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000498a1cd9/0x418ffb1c3bcc9902 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.368900:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=667s v=(0 0) 00010000:00010000:3.0:1790772567.368903:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772567.368908:0:24262:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000498a1cd9/0x418ffb1c3bcc9902 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.368928:0:24262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000498a1cd9/0x418ffb1c3bcc9902 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.368935:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000498a1cd9/0x418ffb1c3bcc9902 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.368942:0:24262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000498a1cd9/0x418ffb1c3bcc9902 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.368956:0:24262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790772567.368965:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772567.368969:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000498a1cd9/0x418ffb1c3bcc9902 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.368976:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf4bd9800 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:3.0:1790772567.368979:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000498a1cd9/0x418ffb1c3bcc9902 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.368987:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000498a1cd9/0x418ffb1c3bcc9902 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.368997:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000498a1cd9/0x418ffb1c3bcc9902 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.369004:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000498a1cd9/0x418ffb1c3bcc9902 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.369036:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772567.369038:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772567.369040:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772567.369565:0:24262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790772567.369572:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc9909 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.369581:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=667s v=(0 0) 00010000:00010000:3.0:1790772567.369584:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772567.369588:0:24262:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc9909 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.369597:0:24262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc9909 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.369606:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc9909 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.369612:0:24262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc9909 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.369632:0:24262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790772567.369718:0:25002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772567.369731:0:25002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc9909 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.369739:0:25002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf4bd9400 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:2.0:1790772567.369743:0:25002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc9909 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.369751:0:25002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc9909 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.369765:0:25002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc9909 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.369774:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772567.369776:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772567.369777:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772567.369787:0:24262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc9909 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790772567.370188:0:24262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790772567.370199:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041cfdb78/0x418ffb1c3bcc9910 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.370209:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=667s v=(0 0) 00010000:00010000:3.0:1790772567.370213:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772567.370217:0:24262:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041cfdb78/0x418ffb1c3bcc9910 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.370228:0:24262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041cfdb78/0x418ffb1c3bcc9910 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.370237:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041cfdb78/0x418ffb1c3bcc9910 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.370245:0:24262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041cfdb78/0x418ffb1c3bcc9910 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.370267:0:24262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790772567.370292:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772567.370299:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041cfdb78/0x418ffb1c3bcc9910 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.370307:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf4bd9600 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:2.0:1790772567.370310:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041cfdb78/0x418ffb1c3bcc9910 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.370319:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041cfdb78/0x418ffb1c3bcc9910 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.370330:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041cfdb78/0x418ffb1c3bcc9910 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.370344:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041cfdb78/0x418ffb1c3bcc9910 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.370360:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772567.370361:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772567.370363:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772567.370542:0:24262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790772567.370548:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fae2bea1/0x418ffb1c3bcc9917 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.370557:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=667s v=(0 0) 00010000:00010000:3.0:1790772567.370560:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772567.370564:0:24262:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fae2bea1/0x418ffb1c3bcc9917 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.370572:0:24262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fae2bea1/0x418ffb1c3bcc9917 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.370587:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fae2bea1/0x418ffb1c3bcc9917 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.370594:0:24262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fae2bea1/0x418ffb1c3bcc9917 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.370685:0:24262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790772567.373288:0:24262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790772567.373301:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e219a02/0x418ffb1c3bcc991e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.373318:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=667s v=(0 0) 00010000:00010000:2.0:1790772567.373323:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772567.373328:0:24262:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e219a02/0x418ffb1c3bcc991e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.373341:0:24262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e219a02/0x418ffb1c3bcc991e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.373350:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e219a02/0x418ffb1c3bcc991e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.373358:0:24262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e219a02/0x418ffb1c3bcc991e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.375861:0:24262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772567.375861:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790772567.375875:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fae2bea1/0x418ffb1c3bcc9917 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.375883:0:25002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772567.375889:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf4bd8800 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:0.0:1790772567.375895:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fae2bea1/0x418ffb1c3bcc9917 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.375900:0:25002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e219a02/0x418ffb1c3bcc991e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.375910:0:25002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdc29cc800 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:0.0:1790772567.375923:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fae2bea1/0x418ffb1c3bcc9917 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.375927:0:25002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e219a02/0x418ffb1c3bcc991e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.375940:0:25002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e219a02/0x418ffb1c3bcc991e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.375948:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fae2bea1/0x418ffb1c3bcc9917 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.375959:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fae2bea1/0x418ffb1c3bcc9917 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.375964:0:25002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e219a02/0x418ffb1c3bcc991e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.375974:0:25002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e219a02/0x418ffb1c3bcc991e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.375985:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772567.375988:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772567.375989:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772567.376272:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772567.376274:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772567.376276:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790772567.376896:0:24262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790772567.376903:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2298d24/0x418ffb1c3bcc9925 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.376916:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=667s v=(0 0) 00010000:00010000:2.0:1790772567.376920:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772567.376927:0:24262:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2298d24/0x418ffb1c3bcc9925 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.376951:0:24262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2298d24/0x418ffb1c3bcc9925 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.376961:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2298d24/0x418ffb1c3bcc9925 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.376970:0:24262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2298d24/0x418ffb1c3bcc9925 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.376993:0:24262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790772567.377384:0:24262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790772567.377390:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013cb0772/0x418ffb1c3bcc992c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.377398:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=667s v=(0 0) 00010000:00010000:2.0:1790772567.377401:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772567.377406:0:24262:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013cb0772/0x418ffb1c3bcc992c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.377415:0:24262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013cb0772/0x418ffb1c3bcc992c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.377423:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013cb0772/0x418ffb1c3bcc992c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.377442:0:24262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013cb0772/0x418ffb1c3bcc992c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.377454:0:24262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790772567.377832:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790772567.377839:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2298d24/0x418ffb1c3bcc9925 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.377846:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdc29cd800 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:0.0:1790772567.377850:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2298d24/0x418ffb1c3bcc9925 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.377859:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2298d24/0x418ffb1c3bcc9925 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.377873:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2298d24/0x418ffb1c3bcc9925 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.377892:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2298d24/0x418ffb1c3bcc9925 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.377909:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772567.377912:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013cb0772/0x418ffb1c3bcc992c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.377918:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdc29cc000 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:0.0:1790772567.377921:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013cb0772/0x418ffb1c3bcc992c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.377927:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013cb0772/0x418ffb1c3bcc992c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.377937:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013cb0772/0x418ffb1c3bcc992c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.377942:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013cb0772/0x418ffb1c3bcc992c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.377952:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772567.377954:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772567.377955:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772567.377962:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790772567.378058:0:24262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790772567.378064:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3e5180d/0x418ffb1c3bcc9933 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.378073:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=667s v=(0 0) 00010000:00010000:2.0:1790772567.378076:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772567.378080:0:24262:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3e5180d/0x418ffb1c3bcc9933 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.378089:0:24262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3e5180d/0x418ffb1c3bcc9933 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.378097:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3e5180d/0x418ffb1c3bcc9933 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.378104:0:24262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3e5180d/0x418ffb1c3bcc9933 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.378124:0:24262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772567.378432:0:25002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772567.378437:0:25002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3e5180d/0x418ffb1c3bcc9933 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.378450:0:25002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdc29cca00 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:0.0:1790772567.378454:0:25002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3e5180d/0x418ffb1c3bcc9933 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.378462:0:25002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3e5180d/0x418ffb1c3bcc9933 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.378473:0:25002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3e5180d/0x418ffb1c3bcc9933 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.378481:0:25002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3e5180d/0x418ffb1c3bcc9933 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.378496:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772567.378497:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772567.378499:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790772567.378748:0:24262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790772567.378754:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098f70005/0x418ffb1c3bcc993a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.378768:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=667s v=(0 0) 00010000:00010000:2.0:1790772567.378772:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772567.378777:0:24262:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098f70005/0x418ffb1c3bcc993a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.378787:0:24262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098f70005/0x418ffb1c3bcc993a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.378796:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098f70005/0x418ffb1c3bcc993a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.378803:0:24262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098f70005/0x418ffb1c3bcc993a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.378824:0:24262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772567.379135:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772567.379141:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098f70005/0x418ffb1c3bcc993a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.379149:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdc29cc600 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:0.0:1790772567.379153:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098f70005/0x418ffb1c3bcc993a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.379189:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098f70005/0x418ffb1c3bcc993a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.379208:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098f70005/0x418ffb1c3bcc993a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.379215:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098f70005/0x418ffb1c3bcc993a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.379231:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772567.379233:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772567.379235:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790772567.379372:0:24262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790772567.379378:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a898b3c7/0x418ffb1c3bcc9941 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.379388:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=667s v=(0 0) 00010000:00010000:2.0:1790772567.379391:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772567.379396:0:24262:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a898b3c7/0x418ffb1c3bcc9941 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.379405:0:24262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a898b3c7/0x418ffb1c3bcc9941 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.379424:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a898b3c7/0x418ffb1c3bcc9941 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.379431:0:24262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a898b3c7/0x418ffb1c3bcc9941 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.379452:0:24262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772567.379852:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772567.379858:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a898b3c7/0x418ffb1c3bcc9941 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.379866:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdc29cd200 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:0.0:1790772567.379870:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a898b3c7/0x418ffb1c3bcc9941 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.379879:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a898b3c7/0x418ffb1c3bcc9941 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.379891:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a898b3c7/0x418ffb1c3bcc9941 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.379899:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a898b3c7/0x418ffb1c3bcc9941 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.379926:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772567.379927:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772567.379929:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790772567.380006:0:24262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790772567.380012:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b9544ad/0x418ffb1c3bcc9948 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.380021:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=667s v=(0 0) 00010000:00010000:2.0:1790772567.380025:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772567.380029:0:24262:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b9544ad/0x418ffb1c3bcc9948 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.380039:0:24262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b9544ad/0x418ffb1c3bcc9948 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.380046:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b9544ad/0x418ffb1c3bcc9948 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.380054:0:24262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b9544ad/0x418ffb1c3bcc9948 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.380117:0:24262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790772567.380579:0:24262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790772567.380585:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c4570f0/0x418ffb1c3bcc994f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.380595:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=667s v=(0 0) 00010000:00010000:2.0:1790772567.380598:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772567.380602:0:24262:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c4570f0/0x418ffb1c3bcc994f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.380611:0:24262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c4570f0/0x418ffb1c3bcc994f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.380618:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c4570f0/0x418ffb1c3bcc994f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.380625:0:24262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c4570f0/0x418ffb1c3bcc994f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.380871:0:25002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790772567.380879:0:25002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b9544ad/0x418ffb1c3bcc9948 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.380887:0:25002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdc29cce00 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:0.0:1790772567.380891:0:25002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b9544ad/0x418ffb1c3bcc9948 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.380899:0:25002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b9544ad/0x418ffb1c3bcc9948 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.380913:0:25002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b9544ad/0x418ffb1c3bcc9948 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.380920:0:25002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b9544ad/0x418ffb1c3bcc9948 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.380938:0:25002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772567.380941:0:25002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c4570f0/0x418ffb1c3bcc994f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.380948:0:25002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdc29cc200 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:0.0:1790772567.380957:0:25002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c4570f0/0x418ffb1c3bcc994f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.380965:0:25002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c4570f0/0x418ffb1c3bcc994f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.380974:0:25002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c4570f0/0x418ffb1c3bcc994f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.380982:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772567.380983:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772567.380985:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772567.381106:0:24262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1790772567.381112:0:24262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c4570f0/0x418ffb1c3bcc994f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.381612:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790772567.381829:0:24262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790772567.381836:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042a70ee6/0x418ffb1c3bcc9956 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.381853:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=667s v=(0 0) 00010000:00010000:2.0:1790772567.381857:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772567.381863:0:24262:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042a70ee6/0x418ffb1c3bcc9956 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.381875:0:24262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042a70ee6/0x418ffb1c3bcc9956 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.381884:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042a70ee6/0x418ffb1c3bcc9956 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.381892:0:24262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042a70ee6/0x418ffb1c3bcc9956 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.381914:0:24262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772567.382356:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772567.382363:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042a70ee6/0x418ffb1c3bcc9956 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.382371:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc3560000 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:0.0:1790772567.382375:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042a70ee6/0x418ffb1c3bcc9956 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.382384:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042a70ee6/0x418ffb1c3bcc9956 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.382398:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042a70ee6/0x418ffb1c3bcc9956 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.382406:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042a70ee6/0x418ffb1c3bcc9956 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.382503:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772567.382506:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772567.382508:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790772567.382818:0:24262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790772567.382825:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b85cd9a/0x418ffb1c3bcc995d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.382834:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=667s v=(0 0) 00010000:00010000:2.0:1790772567.382837:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772567.382842:0:24262:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b85cd9a/0x418ffb1c3bcc995d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.382852:0:24262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b85cd9a/0x418ffb1c3bcc995d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.382871:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b85cd9a/0x418ffb1c3bcc995d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.382879:0:24262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b85cd9a/0x418ffb1c3bcc995d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.382934:0:24262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790772567.386755:0:24262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790772567.386768:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc9964 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.386785:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=667s v=(0 0) 00010000:00010000:3.0:1790772567.386789:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772567.386796:0:24262:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc9964 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.386809:0:24262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc9964 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.386818:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc9964 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.386827:0:24262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc9964 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.386957:0:25002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790772567.386965:0:25002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b85cd9a/0x418ffb1c3bcc995d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.386973:0:25002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc3561200 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:0.0:1790772567.386977:0:25002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b85cd9a/0x418ffb1c3bcc995d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.386986:0:25002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b85cd9a/0x418ffb1c3bcc995d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.387002:0:25002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b85cd9a/0x418ffb1c3bcc995d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.387008:0:25002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b85cd9a/0x418ffb1c3bcc995d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.387025:0:25002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772567.387028:0:25002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc9964 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.387034:0:25002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf4bd9400 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:0.0:1790772567.387045:0:25002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc9964 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.387053:0:25002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc9964 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.387063:0:25002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc9964 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.387070:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772567.387071:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772567.387073:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772567.387418:0:24262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790772567.387434:0:24262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0a9daff/0x418ffb1c3bcc9964 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.387662:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772567.388043:0:24262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790772567.388049:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000498a1cd9/0x418ffb1c3bcc996b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.388060:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=667s v=(0 0) 00010000:00010000:3.0:1790772567.388065:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772567.388070:0:24262:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000498a1cd9/0x418ffb1c3bcc996b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.388080:0:24262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000498a1cd9/0x418ffb1c3bcc996b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.388089:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000498a1cd9/0x418ffb1c3bcc996b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.388096:0:24262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000498a1cd9/0x418ffb1c3bcc996b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.388116:0:24262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772567.388245:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772567.388251:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000498a1cd9/0x418ffb1c3bcc996b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.388259:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf4bd9800 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:0.0:1790772567.388262:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000498a1cd9/0x418ffb1c3bcc996b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.388271:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000498a1cd9/0x418ffb1c3bcc996b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.388285:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000498a1cd9/0x418ffb1c3bcc996b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.388293:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000498a1cd9/0x418ffb1c3bcc996b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.388317:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772567.388318:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772567.388320:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772567.388776:0:24262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790772567.388783:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc9972 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.388799:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=667s v=(0 0) 00010000:00010000:3.0:1790772567.388802:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772567.388807:0:24262:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc9972 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.388816:0:24262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc9972 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.388824:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc9972 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.388830:0:24262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc9972 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772567.388848:0:24262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1790772567.389088:0:24262:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:3.0:1790772567.389201:0:24262:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff733800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22783:x1877760506334464:12345-0@lo:5:osp-pre-1-0.0 Request processed in 63411us (63646us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772567.389211:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790772567.389267:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdff730000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22783:1877760506334464:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1790772567.389282:0:22783:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1790772567.389321:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc440c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22783:1877760506335232:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1790772567.389353:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772567.389375:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdfbba9780 going to sleep for 11 seconds 00000100:00100000:3.0:1790772567.389401:0:24264:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506335232 00000100:00100000:3.0:1790772567.389407:0:24264:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506335232 00010000:00010000:0.0:1790772567.389520:0:25002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772567.389527:0:25002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc9972 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.389535:0:25002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf4bd9200 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:0.0:1790772567.389539:0:25002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc9972 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.389547:0:25002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc9972 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.389560:0:25002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc9972 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.389566:0:25002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1a54a4b/0x418ffb1c3bcc9972 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.389582:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772567.389584:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772567.389585:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772567.389835:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790772567.389844:0:24264:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc440e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22783:x1877760506335232:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1790772567.389879:0:24264:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:3.0:1790772567.393985:0:24264:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc440e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22783:x1877760506335232:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4137us (4627us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1790772567.393997:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790772567.396773:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc440c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22783:1877760506335232:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1790772567.396793:0:22783:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:0.0:1790772568.214642:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772569.236377:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772569.364464:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdff7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506335360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790772569.364573:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772569.364733:0:23497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506335360 00000100:00100000:2.0:1790772569.364743:0:23497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506335360 00000100:00100000:2.0:1790772569.364798:0:23497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790772569.364808:0:23497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc440ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1877760506335360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790772569.364843:0:23497:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790772569.364925:0:23497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc440ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1877760506335360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772569.364933:0:23497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790772569.365028:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdff7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506335360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790772569.370511:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790772569.370535:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdff7e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506335488:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790772569.370606:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772569.370828:0:22762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506335488 00000100:00100000:2.0:1790772569.370837:0:22762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506335488 00000100:00100000:2.0:1790772569.370888:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790772569.370897:0:22762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc440ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506335488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790772569.370930:0:22762:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1790772569.370988:0:22762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc440ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506335488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772569.370995:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790772569.371104:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdff7e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506335488:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790772569.373029:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf7524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506335616:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790772569.373102:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772569.373408:0:24267:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506335616 00000100:00100000:1.0:1790772569.373421:0:24267:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506335616 00000100:00100000:1.0:1790772569.373479:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790772569.373489:0:24267:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc440df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506335616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790772569.373515:0:24267:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1790772569.373559:0:24267:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc440df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506335616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772569.373567:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1790772569.374027:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790772569.374089:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf7524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506335616:0@lo:13:osp-pre-0-1.0 00000001:02000400:0.0:1790772570.026244:0:25434:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg614-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790772570.271100:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772570.394958:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790772570.394979:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf7524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1877760506335744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790772570.395050:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772570.395094:0:24267:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506335744 00000100:00100000:1.0:1790772570.395102:0:24267:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506335744 00000100:00100000:1.0:1790772570.395181:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790772570.395191:0:24267:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1877760506335744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790772570.395214:0:24267:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1790772570.395257:0:24267:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1877760506335744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772570.395263:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1790772570.395283:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790772570.395316:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf7524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1877760506335744:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1790772570.517928:0:23514:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:1.0:1790772571.157506:0:25487:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790772571.158230:0:25487:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790772571.284380:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1790772572.112088:0:25537:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790772572.112363:0:25537:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790772572.324769:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772572.436593:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdff7e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506335872:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790772572.436669:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772572.436748:0:24267:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506335872 00000100:00100000:2.0:1790772572.436755:0:24267:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506335872 00000100:00100000:2.0:1790772572.436850:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790772572.436860:0:24267:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff7e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506335872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790772572.436888:0:24267:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790772572.436932:0:24267:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff7e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506335872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772572.436939:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1790772572.436961:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790772572.437002:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdff7e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506335872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790772572.437519:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf7524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3643:1877760506336128:0@lo:400:kworker.0 00000100:00100000:1.0:1790772572.437588:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772572.437612:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf7525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877760506336640:0@lo:400:kworker.0 00000100:00100000:1.0:1790772572.437637:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772572.437664:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3544380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1877760506337152:0@lo:400:kworker.0 00000100:00100000:1.0:1790772572.437684:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772572.437718:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1790772572.437724:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf7526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1877760506336256:0@lo:400:kworker.0 00000100:00100000:1.0:1790772572.437787:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772572.437803:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506336768:0@lo:400:kworker.0 00000100:00100000:1.0:1790772572.437823:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772572.437836:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3544a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1877760506337280:0@lo:400:kworker.0 00000100:00100000:1.0:1790772572.437871:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772572.437974:0:22761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506336256 00000100:00100000:3.0:1790772572.437979:0:22761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506336256 00000100:00100000:3.0:1790772572.438032:0:22761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506336768 00000100:00100000:3.0:1790772572.438035:0:22761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506336768 00000100:00100000:3.0:1790772572.438048:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790772572.438067:0:22761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3544700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1877760506336256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772572.438123:0:22761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3544700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1877760506336256:12345-0@lo:400:kworker.0 Request processed in 56us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772572.438129:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790772572.438142:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790772572.438149:0:22761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506336768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772572.438198:0:22761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506336768:12345-0@lo:400:kworker.0 Request processed in 49us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772572.438204:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790772572.438231:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf7526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1877760506336256:0@lo:400:kworker.0 00000100:00100000:3.0:1790772572.438257:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506336768:0@lo:400:kworker.0 00000100:00100000:2.0:1790772572.439420:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506336128 00000100:00100000:2.0:1790772572.439429:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506336128 00000100:00100000:2.0:1790772572.439478:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1790772572.439486:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+24:3643:x1877760506336128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772572.439556:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+24:3643:x1877760506336128:12345-0@lo:400:kworker.0 Request processed in 71us (1968us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772572.439562:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1790772572.439595:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506336640 00000100:00100000:2.0:1790772572.439598:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506336640 00000100:00100000:2.0:1790772572.439616:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506337152 00000100:00100000:2.0:1790772572.439618:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506337152 00000100:00100000:2.0:1790772572.439638:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506337280 00000100:00100000:2.0:1790772572.439641:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506337280 00000100:00100000:2.0:1790772572.439666:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790772572.439672:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877760506336640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772572.439704:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877760506336640:12345-0@lo:400:kworker.0 Request processed in 32us (2066us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772572.439718:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790772572.439732:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790772572.439737:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1877760506337152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772572.439768:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1877760506337152:12345-0@lo:400:kworker.0 Request processed in 31us (2082us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772572.439773:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790772572.439785:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790772572.439790:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877760506337280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772572.439818:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877760506337280:12345-0@lo:400:kworker.0 Request processed in 27us (1945us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772572.439823:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790772572.441577:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc440d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1877760506336000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790772572.441633:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772572.441688:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf7524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1877760506336512:0@lo:400:kworker.0 00000100:00100000:2.0:1790772572.441713:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772572.441730:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3545f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1877760506337024:0@lo:400:kworker.0 00000100:00100000:2.0:1790772572.441754:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772572.441770:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3547b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1877760506337536:0@lo:400:kworker.0 00000100:00100000:2.0:1790772572.441788:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772572.441809:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1790772572.441815:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf7527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1877760506336384:0@lo:400:kworker.0 00000100:00100000:2.0:1790772572.441835:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772572.441851:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3544e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1877760506336896:0@lo:400:kworker.0 00000100:00100000:2.0:1790772572.441869:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772572.441894:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1877760506337408:0@lo:400:kworker.0 00000100:00100000:2.0:1790772572.441915:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772572.441942:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506337024 00000100:00100000:2.0:1790772572.441948:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506337024 00000100:00100000:2.0:1790772572.441976:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506337536 00000100:00100000:2.0:1790772572.441979:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506337536 00000100:00100000:2.0:1790772572.441993:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506337408 00000100:00100000:2.0:1790772572.441995:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506337408 00000100:00100000:2.0:1790772572.442010:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790772572.442017:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff7e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1877760506337024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772572.442063:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff7e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1877760506337024:12345-0@lo:400:kworker.0 Request processed in 45us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772572.442069:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790772572.442086:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790772572.442093:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff7e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1877760506337536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772572.442119:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff7e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1877760506337536:12345-0@lo:400:kworker.0 Request processed in 27us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772572.442125:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790772572.442135:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790772572.442141:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf62e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1877760506337408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772572.442199:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf62e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1877760506337408:12345-0@lo:400:kworker.0 Request processed in 58us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772572.442206:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1790772572.442225:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790772572.442230:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772572.442244:0:24267:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506336000 00000100:00100000:2.0:1790772572.442248:0:24267:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506336000 00000100:00100000:2.0:1790772572.442275:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790772572.442287:0:24267:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff7e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1877760506336000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790772572.442303:0:24267:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790772572.442332:0:24267:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff7e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1877760506336000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772572.442338:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1790772572.442354:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1790772572.442444:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9eccc3546680 x1877760506337408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772572.442458:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1877760506337408:0@lo:400:kworker.0 00000100:00100000:2.0:1790772572.442474:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc440d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1877760506336000:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1790772572.442484:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9eccc3545f80 x1877760506337024/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772572.442492:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3545f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1877760506337024:0@lo:400:kworker.0 00010000:00080000:2.0:1790772572.442501:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9eccc3547b80 x1877760506337536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772572.442509:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3547b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1877760506337536:0@lo:400:kworker.0 00000100:00100000:1.0:1790772572.443320:0:24262:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506336512 00000100:00100000:1.0:1790772572.443327:0:24262:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506336512 00000100:00100000:1.0:1790772572.443361:0:24262:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506336384 00000100:00100000:1.0:1790772572.443364:0:24262:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506336384 00000100:00100000:1.0:1790772572.443383:0:24262:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506336896 00000100:00100000:1.0:1790772572.443386:0:24262:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506336896 00000100:00100000:1.0:1790772572.443399:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790772572.443406:0:24262:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1877760506336512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772572.443460:0:24262:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1877760506336512:12345-0@lo:400:kworker.0 Request processed in 54us (1745us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772572.443466:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790772572.443479:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790772572.443485:0:24262:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc12ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1877760506336384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772572.443512:0:24262:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc12ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1877760506336384:12345-0@lo:400:kworker.0 Request processed in 28us (1676us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772572.443518:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790772572.443528:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790772572.443534:0:24262:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc12aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1877760506336896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772572.443560:0:24262:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc12aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1877760506336896:12345-0@lo:400:kworker.0 Request processed in 26us (1690us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772572.443566:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1790772572.443579:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790772572.443612:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf7527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1877760506336384:0@lo:400:kworker.0 00000100:00100000:1.0:1790772572.443623:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3544e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1877760506336896:0@lo:400:kworker.0 00000100:00100000:1.0:1790772572.443633:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf7524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1877760506336512:0@lo:400:kworker.0 00010000:00080000:0.0:1790772572.444289:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9eccc3544a80 x1877760506337280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772572.444299:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3544a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1877760506337280:0@lo:400:kworker.0 00000100:00100000:0.0:1790772572.444310:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf7524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3643:1877760506336128:0@lo:400:kworker.0 00010000:00080000:0.0:1790772572.444321:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ecdf7525500 x1877760506336640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772572.444328:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf7525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877760506336640:0@lo:400:kworker.0 00010000:00080000:0.0:1790772572.444339:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9eccc3544380 x1877760506337152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772572.444346:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3544380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1877760506337152:0@lo:400:kworker.0 00000001:00080000:1.0:1790772572.445967:0:25079:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000100:00100000:3.0:1790772572.493477:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772572.493598:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481051136 00000100:00100000:2.0:1790772572.493607:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481051136 00000100:00100000:2.0:1790772572.493669:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 117 00000100:00100000:2.0:1790772572.493677:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2389:x1877760481051136:12345-192.168.206.14@tcp:250:mount.lustre.0 00010000:00080000:2.0:1790772572.493705:0:22750:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from ddb76036-7f3a-437f-b993-ff4cd941bf15@192.168.206.14@tcp t0 exp 0000000000000000 cur 672 last 0 00000020:00000080:2.0:1790772572.493738:0:22750:0:(genops.c:1384:class_connect()) connect: client ddb76036-7f3a-437f-b993-ff4cd941bf15, cookie 0x418ffb1c3bcc9979 00000100:00080000:2.0:1790772572.493873:0:22750:0:(import.c:65:import_set_state_nolock()) ffff9eccc3704000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790772572.493961:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddb76036-7f3a-437f-b993-ff4cd941bf15+5:2389:x1877760481051136:12345-192.168.206.14@tcp:250:mount.lustre.0 Request processed in 283us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772572.493969:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 117 00000100:00100000:2.0:1790772572.500605:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772572.500695:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481051264 00000100:00100000:3.0:1790772572.500705:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481051264 00000100:00100000:3.0:1790772572.500756:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 118 00000100:00100000:3.0:1790772572.500765:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddb76036-7f3a-437f-b993-ff4cd941bf15+5:18019:x1877760481051264:12345-192.168.206.14@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790772572.500781:0:22749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772572.500797:0:22749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ecdf4bd8000/0x418ffb1c3bcc9980 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x42c6e08168753a04 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772572.500824:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ecdf4bd8000/0x418ffb1c3bcc9980 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753a04 expref: 6 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772572.500835:0:22749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ecdf4bd8000/0x418ffb1c3bcc9980 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753a04 expref: 6 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772572.500845:0:22749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdf4bd8000, rc 0) 00000100:00100000:3.0:1790772572.500918:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddb76036-7f3a-437f-b993-ff4cd941bf15+6:18019:x1877760481051264:12345-192.168.206.14@tcp:101:mount.lustre.0 Request processed in 153us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772572.500925:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 118 00000100:00100000:1.0:1790772572.507732:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1790772572.507888:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481051392 00000100:00100000:0.0:1790772572.507897:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481051392 00000100:00100000:0.0:1790772572.507951:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 119 00000100:00100000:0.0:1790772572.507960:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddb76036-7f3a-437f-b993-ff4cd941bf15+6:18019:x1877760481051392:12345-192.168.206.14@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790772572.508090:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddb76036-7f3a-437f-b993-ff4cd941bf15+6:18019:x1877760481051392:12345-192.168.206.14@tcp:501:mount.lustre.0 Request processed in 129us (367us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790772572.508098:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 119 00000100:00100000:0.0:1790772572.510737:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772572.510827:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481051520 00000100:00100000:2.0:1790772572.510835:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481051520 00000100:00100000:2.0:1790772572.510886:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 120 00000100:00100000:2.0:1790772572.510895:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddb76036-7f3a-437f-b993-ff4cd941bf15+6:18019:x1877760481051520:12345-192.168.206.14@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790772572.510910:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772572.510926:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eccc3560000/0x418ffb1c3bcc9987 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x42c6e08168753a0b expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772572.510952:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eccc3560000/0x418ffb1c3bcc9987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753a0b expref: 7 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772572.510963:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eccc3560000/0x418ffb1c3bcc9987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753a0b expref: 7 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772572.510972:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eccc3560000, rc 0) 00000100:00100000:2.0:1790772572.511028:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddb76036-7f3a-437f-b993-ff4cd941bf15+7:18019:x1877760481051520:12345-192.168.206.14@tcp:101:mount.lustre.0 Request processed in 133us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772572.511036:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 120 00000100:00100000:2.0:1790772572.518742:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772572.518825:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481051648 00000100:00100000:3.0:1790772572.518834:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481051648 00000100:00100000:3.0:1790772572.518889:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 121 00000100:00100000:3.0:1790772572.518900:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddb76036-7f3a-437f-b993-ff4cd941bf15+7:18019:x1877760481051648:12345-192.168.206.14@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790772572.519065:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddb76036-7f3a-437f-b993-ff4cd941bf15+8:18019:x1877760481051648:12345-192.168.206.14@tcp:501:mount.lustre.0 Request processed in 166us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772572.519074:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 121 00000100:00100000:1.0:1790772572.523587:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772572.523693:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481051776 00000100:00100000:2.0:1790772572.523702:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481051776 00000100:00100000:2.0:1790772572.523757:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 122 00000100:00100000:2.0:1790772572.523766:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddb76036-7f3a-437f-b993-ff4cd941bf15+8:18019:x1877760481051776:12345-192.168.206.14@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790772572.523926:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddb76036-7f3a-437f-b993-ff4cd941bf15+8:18019:x1877760481051776:12345-192.168.206.14@tcp:503:mount.lustre.0 Request processed in 160us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772572.523934:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 122 00000100:00100000:1.0:1790772572.527018:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1790772572.527119:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481051904 00000100:00100000:0.0:1790772572.527128:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481051904 00000100:00100000:0.0:1790772572.527226:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 123 00000100:00100000:0.0:1790772572.527236:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddb76036-7f3a-437f-b993-ff4cd941bf15+8:18038:x1877760481051904:12345-192.168.206.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790772572.527393:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddb76036-7f3a-437f-b993-ff4cd941bf15+8:18038:x1877760481051904:12345-192.168.206.14@tcp:502:llog_process_th.0 Request processed in 158us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772572.527402:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 123 00000100:00100000:0.0:1790772572.560116:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772572.560258:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481052032 00000100:00100000:3.0:1790772572.560268:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481052032 00000100:00100000:3.0:1790772572.560320:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 124 00000100:00100000:3.0:1790772572.560331:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddb76036-7f3a-437f-b993-ff4cd941bf15+8:18038:x1877760481052032:12345-192.168.206.14@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790772572.560488:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddb76036-7f3a-437f-b993-ff4cd941bf15+8:18038:x1877760481052032:12345-192.168.206.14@tcp:502:llog_process_th.0 Request processed in 158us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772572.560496:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 124 00000100:00100000:1.0:1790772572.565340:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772572.565417:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481052160 00000100:00100000:2.0:1790772572.565427:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481052160 00000100:00100000:3.0:1790772572.565969:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 125 00000100:00100000:3.0:1790772572.565983:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddb76036-7f3a-437f-b993-ff4cd941bf15+8:18038:x1877760481052160:12345-192.168.206.14@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790772572.566324:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddb76036-7f3a-437f-b993-ff4cd941bf15+8:18038:x1877760481052160:12345-192.168.206.14@tcp:502:llog_process_th.0 Request processed in 344us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772572.566334:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 125 00000100:00100000:1.0:1790772572.573446:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1790772572.576442:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481052288 00000100:00100000:0.0:1790772572.576455:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481052288 00000100:00100000:0.0:1790772572.576675:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 126 00000100:00100000:0.0:1790772572.576684:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddb76036-7f3a-437f-b993-ff4cd941bf15+8:18019:x1877760481052288:12345-192.168.206.14@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790772572.576700:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772572.576717:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eccc1bd0200/0x418ffb1c3bcc998e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42c6e08168753a3c expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772572.576744:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eccc1bd0200/0x418ffb1c3bcc998e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753a3c expref: 9 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772572.576755:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eccc1bd0200/0x418ffb1c3bcc998e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753a3c expref: 9 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772572.576763:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eccc1bd0200, rc 0) 00000100:00100000:0.0:1790772572.577641:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddb76036-7f3a-437f-b993-ff4cd941bf15+9:18019:x1877760481052288:12345-192.168.206.14@tcp:101:mount.lustre.0 Request processed in 953us (4199us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772572.577658:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 126 00000100:00100000:3.0:1790772572.581756:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772572.582418:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481052416 00000100:00100000:2.0:1790772572.582427:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481052416 00000100:00100000:2.0:1790772572.582476:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 127 00000100:00100000:2.0:1790772572.582484:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddb76036-7f3a-437f-b993-ff4cd941bf15+9:18019:x1877760481052416:12345-192.168.206.14@tcp:256:mount.lustre.0 20000000:01000000:2.0:1790772572.582506:0:22750:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1790772572.582562:0:22750:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1790772572.582566:0:22750:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1790772572.582570:0:22750:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1790772572.582573:0:22750:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1790772572.582575:0:22750:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1790772572.587398:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddb76036-7f3a-437f-b993-ff4cd941bf15+9:18019:x1877760481052416:12345-192.168.206.14@tcp:256:mount.lustre.0 Request processed in 4905us (5640us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772572.587413:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 127 00000100:00100000:0.0:1790772572.595012:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772572.595367:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481052544 00000100:00100000:2.0:1790772572.595376:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481052544 00000100:00100000:2.0:1790772572.595432:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 128 00000100:00100000:2.0:1790772572.595441:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf118bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddb76036-7f3a-437f-b993-ff4cd941bf15+9:18019:x1877760481052544:12345-192.168.206.14@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790772572.595456:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772572.595828:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eccc3560200/0x418ffb1c3bcc9995 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x42c6e08168753a43 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772572.595858:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eccc3560200/0x418ffb1c3bcc9995 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753a43 expref: 10 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772572.595884:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eccc3560200/0x418ffb1c3bcc9995 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753a43 expref: 10 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772572.595894:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eccc3560200, rc 0) 00000100:00100000:2.0:1790772572.595956:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf118bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddb76036-7f3a-437f-b993-ff4cd941bf15+10:18019:x1877760481052544:12345-192.168.206.14@tcp:101:mount.lustre.0 Request processed in 516us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772572.595964:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 128 00000100:00100000:2.0:1790772572.598971:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772572.599252:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481052672 00000100:00100000:3.0:1790772572.599260:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481052672 00000100:00100000:3.0:1790772572.599361:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 129 00000100:00100000:3.0:1790772572.599371:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1189450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddb76036-7f3a-437f-b993-ff4cd941bf15+10:18019:x1877760481052672:12345-192.168.206.14@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790772572.599537:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1189450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddb76036-7f3a-437f-b993-ff4cd941bf15+10:18019:x1877760481052672:12345-192.168.206.14@tcp:501:mount.lustre.0 Request processed in 166us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772572.599546:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 129 00000100:00100000:0.0:1790772572.602297:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772572.602387:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481052800 00000100:00100000:2.0:1790772572.602396:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481052800 00000100:00100000:2.0:1790772572.602546:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 130 00000100:00100000:2.0:1790772572.602556:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1189c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddb76036-7f3a-437f-b993-ff4cd941bf15+10:18019:x1877760481052800:12345-192.168.206.14@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790772572.602703:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1189c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddb76036-7f3a-437f-b993-ff4cd941bf15+10:18019:x1877760481052800:12345-192.168.206.14@tcp:503:mount.lustre.0 Request processed in 148us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772572.602711:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 130 00000100:00100000:0.0:1790772572.606783:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772572.606864:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481052928 00000100:00100000:3.0:1790772572.606873:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481052928 00000100:00100000:3.0:1790772572.606926:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 131 00000100:00100000:3.0:1790772572.606936:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1188c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddb76036-7f3a-437f-b993-ff4cd941bf15+10:18039:x1877760481052928:12345-192.168.206.14@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790772572.607100:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1188c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddb76036-7f3a-437f-b993-ff4cd941bf15+10:18039:x1877760481052928:12345-192.168.206.14@tcp:502:llog_process_th.0 Request processed in 165us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772572.607109:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 131 00000100:00100000:3.0:1790772572.615364:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772572.615601:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481053056 00000100:00100000:2.0:1790772572.615611:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481053056 00000100:00100000:2.0:1790772572.615673:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 132 00000100:00100000:2.0:1790772572.615683:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf118ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddb76036-7f3a-437f-b993-ff4cd941bf15+10:18039:x1877760481053056:12345-192.168.206.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790772572.615837:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf118ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddb76036-7f3a-437f-b993-ff4cd941bf15+10:18039:x1877760481053056:12345-192.168.206.14@tcp:502:llog_process_th.0 Request processed in 154us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772572.615845:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 132 00000100:00100000:0.0:1790772572.632682:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772572.632907:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481053184 00000100:00100000:2.0:1790772572.632916:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481053184 00000100:00100000:2.0:1790772572.632960:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 7 00000100:00100000:2.0:1790772572.632978:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2389:x1877760481053184:12345-192.168.206.14@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790772572.633004:0:22758:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 4f9f6919-1501-400a-bf51-76bbebf8064d@192.168.206.14@tcp t0 exp 0000000000000000 cur 672 last 0 00000020:00000080:2.0:1790772572.633067:0:22758:0:(genops.c:1384:class_connect()) connect: client 4f9f6919-1501-400a-bf51-76bbebf8064d, cookie 0x418ffb1c3bcc999c 00000004:00100000:2.0:1790772572.633092:0:22758:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1790772572.633555:0:22758:0:(import.c:65:import_set_state_nolock()) ffff9eccc304d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790772572.633626:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+6:2389:x1877760481053184:12345-192.168.206.14@tcp:38:mount.lustre.0 Request processed in 647us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772572.633634:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 7 00000100:00100000:0.0:1790772572.639051:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772572.640979:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481053440 00000100:00100000:2.0:1790772572.640994:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481053440 00000100:00100000:2.0:1790772572.641052:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 8 00000100:00100000:2.0:1790772572.641060:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2389:x1877760481053440:12345-192.168.206.14@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790772572.641099:0:22757:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 4f9f6919-1501-400a-bf51-76bbebf8064d@192.168.206.14@tcp t0 exp 0000000000000000 cur 672 last 0 00000020:00000080:2.0:1790772572.641244:0:22757:0:(genops.c:1384:class_connect()) connect: client 4f9f6919-1501-400a-bf51-76bbebf8064d, cookie 0x418ffb1c3bcc99a3 00000004:00100000:2.0:1790772572.641400:0:22757:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1790772572.641636:0:22757:0:(import.c:65:import_set_state_nolock()) ffff9eccc3707000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790772572.641726:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+6:2389:x1877760481053440:12345-192.168.206.14@tcp:38:mount.lustre.0 Request processed in 665us (2683us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772572.641735:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 8 00000100:00100000:3.0:1790772572.648759:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772572.648801:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772572.648836:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1790772572.648995:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481053696 00000100:00100000:0.0:1790772572.649004:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481053696 00000100:00100000:0.0:1790772572.649070:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481053568 00000100:00100000:0.0:1790772572.649073:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481053568 00000100:00100000:0.0:1790772572.649099:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481053312 00000100:00100000:0.0:1790772572.649102:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481053312 00000100:00100000:0.0:1790772572.649116:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 9 00000100:00100000:0.0:1790772572.649125:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc440d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+7:18019:x1877760481053696:12345-192.168.206.14@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790772572.649197:0:22758:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1790772572.650023:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc440d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+7:18019:x1877760481053696:12345-192.168.206.14@tcp:41:mount.lustre.0 Request processed in 896us (1269us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772572.650032:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 9 00000100:00100000:0.0:1790772572.650065:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 10 00000100:00100000:0.0:1790772572.650074:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeec53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+6:0:x1877760481053568:12345-192.168.206.14@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790772572.650094:0:22758:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790772572.650144:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeec53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+6:0:x1877760481053568:12345-192.168.206.14@tcp:41:mount.lustre.0 Request processed in 71us (1342us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772572.650150:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 10 00000100:00100000:0.0:1790772572.650193:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 11 00000100:00100000:0.0:1790772572.650202:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+6:0:x1877760481053312:12345-192.168.206.14@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790772572.650213:0:22758:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1790772572.650237:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+6:0:x1877760481053312:12345-192.168.206.14@tcp:41:mount.lustre.0 Request processed in 37us (1400us total) trans 0 rc 0/0 00000100:00080000:3.0:1790772572.650479:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790772572.650484:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772572.652772:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 11 00000100:00100000:0.0:1790772572.657407:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772572.657552:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481053824 00000100:00100000:1.0:1790772572.657561:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481053824 00000100:00100000:1.0:1790772572.657626:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 12 00000100:00100000:1.0:1790772572.657635:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+6:18019:x1877760481053824:12345-192.168.206.14@tcp:40:mount.lustre.0 00000100:00100000:1.0:1790772572.657764:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+6:18019:x1877760481053824:12345-192.168.206.14@tcp:40:mount.lustre.0 Request processed in 129us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772572.657772:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 12 00000100:00100000:3.0:1790772572.666506:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772572.666548:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772572.666598:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772572.666636:0:24263:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481053952 00000100:00100000:3.0:1790772572.666655:0:24263:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481053952 00000100:00100000:3.0:1790772572.666693:0:24263:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481054080 00000100:00100000:3.0:1790772572.666696:0:24263:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481054080 00000100:00100000:0.0:1790772572.666709:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 20 00000100:00100000:3.0:1790772572.666719:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 21 00000100:00100000:0.0:1790772572.666721:0:24262:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2389:x1877760481053952:12345-192.168.206.14@tcp:8:mount.lustre.0 00000100:00100000:3.0:1790772572.666729:0:24263:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2389:x1877760481054080:12345-192.168.206.14@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790772572.666755:0:24262:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 4f9f6919-1501-400a-bf51-76bbebf8064d@192.168.206.14@tcp t0 exp 0000000000000000 cur 672 last 0 00010000:00080000:3.0:1790772572.666761:0:24263:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 4f9f6919-1501-400a-bf51-76bbebf8064d@192.168.206.14@tcp t0 exp 0000000000000000 cur 672 last 0 00000020:00000080:3.0:1790772572.666787:0:24263:0:(genops.c:1384:class_connect()) connect: client 4f9f6919-1501-400a-bf51-76bbebf8064d, cookie 0x418ffb1c3bcc99b1 00000020:00000080:0.0:1790772572.666794:0:24262:0:(genops.c:1384:class_connect()) connect: client 4f9f6919-1501-400a-bf51-76bbebf8064d, cookie 0x418ffb1c3bcc99aa 00002000:00100000:3.0:1790772572.666798:0:24263:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4f9f6919-1501-400a-bf51-76bbebf8064d/ffff9eccc308d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790772572.666803:0:24262:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4f9f6919-1501-400a-bf51-76bbebf8064d/ffff9eccc304f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790772572.666810:0:24263:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00100000:0.0:1790772572.666819:0:24262:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790772572.667006:0:24263:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790772572.667034:0:24263:0:(import.c:65:import_set_state_nolock()) ffff9eccc308e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790772572.667093:0:24263:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+6:2389:x1877760481054080:12345-192.168.206.14@tcp:8:mount.lustre.0 Request processed in 365us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772572.667102:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 21 00000100:00100000:2.0:1790772572.667246:0:22767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481054208 00000100:00100000:2.0:1790772572.667251:0:22767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481054208 00000100:00100000:2.0:1790772572.667285:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 3 00000100:00100000:2.0:1790772572.667292:0:22767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4f9f6919-1501-400a-bf51-76bbebf8064d+6:18019:x1877760481054208:12345-192.168.206.14@tcp:900:mount.lustre.0 00000100:00100000:2.0:1790772572.667329:0:22767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4f9f6919-1501-400a-bf51-76bbebf8064d+6:18019:x1877760481054208:12345-192.168.206.14@tcp:900:mount.lustre.0 Request processed in 37us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772572.667335:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 3 00002000:00080000:0.0:1790772572.667492:0:24262:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790772572.667510:0:24262:0:(import.c:65:import_set_state_nolock()) ffff9eccc304e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790772572.668459:0:24262:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+6:2389:x1877760481053952:12345-192.168.206.14@tcp:8:mount.lustre.0 Request processed in 1736us (1957us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772572.668470:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 20 00000100:00100000:2.0:1790772572.678385:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1790772572.678583:0:22759:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481054336 00000100:00100000:0.0:1790772572.678593:0:22759:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481054336 00000100:00100000:0.0:1790772572.678734:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 0 00000100:00100000:0.0:1790772572.678744:0:22759:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf62e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+6:18019:x1877760481054336:12345-192.168.206.14@tcp:33:mount.lustre.0 00000004:00080000:0.0:1790772572.686951:0:22759:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 8048us 00000004:00200000:2.0:1790772572.714384:0:22759:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1790772572.714546:0:22759:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf62e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+6:18019:x1877760481054336:12345-192.168.206.14@tcp:33:mount.lustre.0 Request processed in 35798us (36164us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772572.714582:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 0 00000100:00100000:2.0:1790772572.971925:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1790772572.972007:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481054464 00000100:00100000:0.0:1790772572.972015:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481054464 00000100:00100000:0.0:1790772572.972094:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 13 00000100:00100000:0.0:1790772572.972104:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf62e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+6:18062:x1877760481054464:12345-192.168.206.14@tcp:101:mkdir.0 00010000:00010000:0.0:1790772572.972124:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772572.972187:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc1bd0e00/0x418ffb1c3bcc99b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42c6e08168753a74 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772572.972257:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013400/0x418ffb1c3bcc99bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772572.972271:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013400/0x418ffb1c3bcc99bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772572.972286:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013400/0x418ffb1c3bcc99bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772572.972330:0:22758:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790772572.972335:0:22758:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790772572.972369:0:22758:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013400/0x418ffb1c3bcc99bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772572.972396:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc1bd0e00/0x418ffb1c3bcc99b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753a74 expref: 8 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772572.972412:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013400/0x418ffb1c3bcc99bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753a74 expref: 7 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772572.972420:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eccc3658000) 00010000:00010000:0.0:1790772572.972423:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790772572.972426:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdf5013400, rc 0) 00000100:00100000:0.0:1790772572.972487:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf62e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+7:18062:x1877760481054464:12345-192.168.206.14@tcp:101:mkdir.0 Request processed in 385us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772572.972494:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 13 00010000:00010000:0.0:1790772573.332404:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772574.356482:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772574.484662:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3544e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1877760506337664:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790772574.484743:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772574.484910:0:22761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506337664 00000100:00100000:1.0:1790772574.484919:0:22761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506337664 00000100:00100000:1.0:1790772574.484971:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790772574.484982:0:22761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1877760506337664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790772574.485013:0:22761:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790772574.485077:0:22761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1877760506337664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772574.485084:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790772574.485130:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3544e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1877760506337664:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790772574.485808:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1877760506337792:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790772574.485844:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772574.486708:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdff730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506337920:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790772574.486745:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772574.487250:0:24267:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506337920 00000100:00100000:2.0:1790772574.487257:0:24267:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506337920 00000100:00100000:2.0:1790772574.487317:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790772574.487326:0:24267:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfaa85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506337920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790772574.487351:0:24267:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1790772574.487398:0:24267:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfaa85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506337920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772574.487404:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1790772574.487686:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790772574.487733:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdff730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506337920:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790772574.488373:0:23497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506337792 00000100:00100000:1.0:1790772574.488379:0:23497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506337792 00000100:00100000:1.0:1790772574.488424:0:23497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790772574.488432:0:23497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1877760506337792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790772574.488469:0:23497:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1790772574.488532:0:23497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1877760506337792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (2686us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772574.488538:0:23497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790772574.488643:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1877760506337792:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790772575.383214:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772575.453674:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772575.453766:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481054592 00000100:00100000:2.0:1790772575.453776:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481054592 00000100:00100000:2.0:1790772575.453847:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 14 00000100:00100000:2.0:1790772575.453857:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfaa87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+7:18114:x1877760481054592:12345-192.168.206.14@tcp:41:lfs.0 00000004:00000024:2.0:1790772575.453894:0:22756:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1790772575.454010:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfaa87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+7:18114:x1877760481054592:12345-192.168.206.14@tcp:41:lfs.0 Request processed in 154us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772575.454016:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 14 00000100:00080000:3.0:1790772575.454445:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772575.457033:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772575.457190:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481054720 00000100:00100000:1.0:1790772575.457202:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481054720 00000100:00100000:1.0:1790772575.457286:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 15 00000100:00100000:1.0:1790772575.457299:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf62e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+6:18114:x1877760481054720:12345-192.168.206.14@tcp:41:lfs.0 00000004:00000024:1.0:1790772575.457349:0:22757:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790772575.457497:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf62e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+6:18114:x1877760481054720:12345-192.168.206.14@tcp:41:lfs.0 Request processed in 200us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772575.457505:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 15 00000100:00080000:3.0:1790772575.457832:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790772575.474753:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772575.474868:0:24267:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481054848 00000100:00100000:2.0:1790772575.474878:0:24267:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481054848 00000100:00100000:2.0:1790772575.474954:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 12 00000100:00100000:2.0:1790772575.474964:0:24267:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4f9f6919-1501-400a-bf51-76bbebf8064d+6:18114:x1877760481054848:12345-192.168.206.14@tcp:13:lfs.0 00002000:00000024:2.0:1790772575.474990:0:24267:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1790772575.475076:0:24267:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4f9f6919-1501-400a-bf51-76bbebf8064d+6:18114:x1877760481054848:12345-192.168.206.14@tcp:13:lfs.0 Request processed in 113us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772575.475096:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 12 00000100:00080000:3.0:1790772575.475191:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790772575.478531:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772575.478738:0:24267:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481054976 00000100:00100000:2.0:1790772575.478748:0:24267:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481054976 00000100:00100000:2.0:1790772575.478816:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 13 00000100:00100000:2.0:1790772575.478826:0:24267:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4f9f6919-1501-400a-bf51-76bbebf8064d+6:18114:x1877760481054976:12345-192.168.206.14@tcp:13:lfs.0 00002000:00000024:2.0:1790772575.478856:0:24267:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790772575.478935:0:24267:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4f9f6919-1501-400a-bf51-76bbebf8064d+6:18114:x1877760481054976:12345-192.168.206.14@tcp:13:lfs.0 Request processed in 110us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772575.478942:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 13 00000100:00080000:3.0:1790772575.482322:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790772575.511716:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3546300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1877760506338048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790772575.511800:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772575.512088:0:24267:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506338048 00000100:00100000:0.0:1790772575.512096:0:24267:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506338048 00000100:00100000:0.0:1790772575.512184:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790772575.512194:0:24267:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf62e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1877760506338048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790772575.512214:0:24267:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1790772575.512274:0:24267:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf62e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1877760506338048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772575.512280:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790772575.512571:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3546300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1877760506338048:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790772575.512685:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790772575.753828:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772575.753946:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481055104 00000100:00100000:3.0:1790772575.753956:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481055104 00000100:00100000:3.0:1790772575.754017:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 133 00000100:00100000:3.0:1790772575.754027:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf118b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddb76036-7f3a-437f-b993-ff4cd941bf15+10:18146:x1877760481055104:12345-192.168.206.14@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790772575.754044:0:22749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772575.754074:0:22749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ecdf4bd9400/0x418ffb1c3bcc99c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x42c6e08168753a7b expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772575.754102:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ecdf4bd9400/0x418ffb1c3bcc99c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753a7b expref: 11 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772575.754114:0:22749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ecdf4bd9400/0x418ffb1c3bcc99c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753a7b expref: 11 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772575.754124:0:22749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdf4bd9400, rc 0) 00000100:00100000:3.0:1790772575.754213:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf118b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddb76036-7f3a-437f-b993-ff4cd941bf15+11:18146:x1877760481055104:12345-192.168.206.14@tcp:101:mount.lustre.0 Request processed in 187us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772575.754221:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 133 00000100:00100000:1.0:1790772575.763232:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772575.763334:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481055232 00000100:00100000:3.0:1790772575.763347:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481055232 00000100:00100000:3.0:1790772575.763420:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 134 00000100:00100000:3.0:1790772575.763433:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcba8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddb76036-7f3a-437f-b993-ff4cd941bf15+11:18146:x1877760481055232:12345-192.168.206.14@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790772575.763647:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcba8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddb76036-7f3a-437f-b993-ff4cd941bf15+11:18146:x1877760481055232:12345-192.168.206.14@tcp:501:mount.lustre.0 Request processed in 216us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772575.763656:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 134 00000100:00100000:0.0:1790772575.773218:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772575.773617:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481055360 00000100:00100000:2.0:1790772575.773627:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481055360 00000100:00100000:2.0:1790772575.773762:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 135 00000100:00100000:2.0:1790772575.773773:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcbaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddb76036-7f3a-437f-b993-ff4cd941bf15+11:18146:x1877760481055360:12345-192.168.206.14@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790772575.773909:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcbaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddb76036-7f3a-437f-b993-ff4cd941bf15+11:18146:x1877760481055360:12345-192.168.206.14@tcp:503:mount.lustre.0 Request processed in 137us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772575.773917:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 135 00000100:00100000:2.0:1790772575.818521:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772575.818656:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481055488 00000100:00100000:1.0:1790772575.818849:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481055488 00000100:00100000:1.0:1790772575.818924:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 136 00000100:00100000:1.0:1790772575.818935:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcbab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddb76036-7f3a-437f-b993-ff4cd941bf15+11:18151:x1877760481055488:12345-192.168.206.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790772575.820404:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcbab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddb76036-7f3a-437f-b993-ff4cd941bf15+11:18151:x1877760481055488:12345-192.168.206.14@tcp:502:llog_process_th.0 Request processed in 1459us (1886us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772575.820420:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 136 00000100:00100000:1.0:1790772575.859536:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772575.860104:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481055616 00000100:00100000:3.0:1790772575.860124:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481055616 00000100:00100000:3.0:1790772575.860225:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 137 00000100:00100000:3.0:1790772575.860237:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcbaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddb76036-7f3a-437f-b993-ff4cd941bf15+11:18151:x1877760481055616:12345-192.168.206.14@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790772575.860436:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcbaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddb76036-7f3a-437f-b993-ff4cd941bf15+11:18151:x1877760481055616:12345-192.168.206.14@tcp:502:llog_process_th.0 Request processed in 200us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772575.860445:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 137 00000100:00100000:0.0:1790772575.871250:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772575.871438:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481055744 00000100:00100000:1.0:1790772575.871467:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481055744 00000100:00100000:1.0:1790772575.871541:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 138 00000100:00100000:1.0:1790772575.871552:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcbab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddb76036-7f3a-437f-b993-ff4cd941bf15+11:18151:x1877760481055744:12345-192.168.206.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790772575.871774:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcbab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddb76036-7f3a-437f-b993-ff4cd941bf15+11:18151:x1877760481055744:12345-192.168.206.14@tcp:502:llog_process_th.0 Request processed in 222us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772575.871783:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 138 00000100:00100000:1.0:1790772575.877339:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772575.877442:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481055872 00000100:00100000:2.0:1790772575.877454:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481055872 00000100:00100000:2.0:1790772575.877516:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 139 00000100:00100000:2.0:1790772575.877526:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcba8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddb76036-7f3a-437f-b993-ff4cd941bf15+11:18146:x1877760481055872:12345-192.168.206.14@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790772575.877566:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772575.877588:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eccc3560c00/0x418ffb1c3bcc99cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x42c6e08168753aac expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772575.877621:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eccc3560c00/0x418ffb1c3bcc99cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753aac expref: 12 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772575.877644:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eccc3560c00/0x418ffb1c3bcc99cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753aac expref: 12 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772575.877654:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eccc3560c00, rc 0) 00000100:00100000:2.0:1790772575.877731:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcba8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddb76036-7f3a-437f-b993-ff4cd941bf15+12:18146:x1877760481055872:12345-192.168.206.14@tcp:101:mount.lustre.0 Request processed in 207us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772575.877738:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 139 00000100:00100000:2.0:1790772575.883697:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772575.883838:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481056000 00000100:00100000:3.0:1790772575.883850:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481056000 00000100:00100000:3.0:1790772575.883909:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 140 00000100:00100000:3.0:1790772575.883918:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcba8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddb76036-7f3a-437f-b993-ff4cd941bf15+12:18146:x1877760481056000:12345-192.168.206.14@tcp:256:mount.lustre.0 20000000:01000000:3.0:1790772575.883951:0:22750:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1790772575.883980:0:22750:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1790772575.883983:0:22750:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1790772575.883987:0:22750:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1790772575.883990:0:22750:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1790772575.883992:0:22750:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1790772575.891731:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcba8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddb76036-7f3a-437f-b993-ff4cd941bf15+12:18146:x1877760481056000:12345-192.168.206.14@tcp:256:mount.lustre.0 Request processed in 7797us (8031us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772575.891750:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 140 00000100:00100000:1.0:1790772575.896150:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772575.896276:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481056128 00000100:00100000:3.0:1790772575.896287:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481056128 00000100:00100000:3.0:1790772575.896351:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 141 00000100:00100000:3.0:1790772575.896362:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcba9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddb76036-7f3a-437f-b993-ff4cd941bf15+12:18146:x1877760481056128:12345-192.168.206.14@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790772575.896382:0:22749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772575.896403:0:22749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ecdf4bd8e00/0x418ffb1c3bcc99d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x42c6e08168753ab3 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772575.896434:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ecdf4bd8e00/0x418ffb1c3bcc99d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753ab3 expref: 13 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772575.896447:0:22749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ecdf4bd8e00/0x418ffb1c3bcc99d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753ab3 expref: 13 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772575.896456:0:22749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdf4bd8e00, rc 0) 00000100:00100000:3.0:1790772575.897782:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcba9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddb76036-7f3a-437f-b993-ff4cd941bf15+13:18146:x1877760481056128:12345-192.168.206.14@tcp:101:mount.lustre.0 Request processed in 1410us (1635us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772575.897793:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 141 00000100:00100000:2.0:1790772575.902120:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772575.902268:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481056256 00000100:00100000:3.0:1790772575.902281:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481056256 00000100:00100000:3.0:1790772575.902348:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 142 00000100:00100000:3.0:1790772575.902359:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcba9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddb76036-7f3a-437f-b993-ff4cd941bf15+13:18146:x1877760481056256:12345-192.168.206.14@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790772575.902584:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcba9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddb76036-7f3a-437f-b993-ff4cd941bf15+13:18146:x1877760481056256:12345-192.168.206.14@tcp:501:mount.lustre.0 Request processed in 227us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772575.902592:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 142 00000100:00100000:0.0:1790772575.907702:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772575.908086:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481056384 00000100:00100000:3.0:1790772575.908098:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481056384 00000100:00100000:2.0:1790772575.908426:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 143 00000100:00100000:2.0:1790772575.908441:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcbaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddb76036-7f3a-437f-b993-ff4cd941bf15+13:18146:x1877760481056384:12345-192.168.206.14@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790772575.908646:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcbaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddb76036-7f3a-437f-b993-ff4cd941bf15+13:18146:x1877760481056384:12345-192.168.206.14@tcp:503:mount.lustre.0 Request processed in 209us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772575.908655:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 143 00000100:00100000:1.0:1790772575.916360:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772575.916724:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481056512 00000100:00100000:2.0:1790772575.916738:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481056512 00000100:00100000:2.0:1790772575.916804:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 144 00000100:00100000:2.0:1790772575.916815:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcbab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddb76036-7f3a-437f-b993-ff4cd941bf15+13:18159:x1877760481056512:12345-192.168.206.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790772575.917014:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcbab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddb76036-7f3a-437f-b993-ff4cd941bf15+13:18159:x1877760481056512:12345-192.168.206.14@tcp:502:llog_process_th.0 Request processed in 201us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772575.917031:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 144 00000100:00100000:1.0:1790772575.919257:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772575.919393:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481056640 00000100:00100000:3.0:1790772575.919405:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481056640 00000100:00100000:3.0:1790772575.919475:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 145 00000100:00100000:3.0:1790772575.919486:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcba8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddb76036-7f3a-437f-b993-ff4cd941bf15+13:18159:x1877760481056640:12345-192.168.206.14@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790772575.919671:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcba8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddb76036-7f3a-437f-b993-ff4cd941bf15+13:18159:x1877760481056640:12345-192.168.206.14@tcp:502:llog_process_th.0 Request processed in 187us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772575.919679:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 145 00000100:00100000:0.0:1790772575.933960:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1790772575.934014:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772575.934765:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481056768 00000100:00100000:2.0:1790772575.934779:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481056768 00000100:00100000:2.0:1790772575.934831:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481057024 00000100:00100000:2.0:1790772575.934835:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481057024 00000100:00100000:2.0:1790772575.934854:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 16 00000100:00100000:2.0:1790772575.934864:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2389:x1877760481056768:12345-192.168.206.14@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790772575.934902:0:22758:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from fc2e9335-a1da-404e-b3d3-c74e78c9d38a@192.168.206.14@tcp t0 exp 0000000000000000 cur 676 last 0 00000020:00000080:2.0:1790772575.934965:0:22758:0:(genops.c:1384:class_connect()) connect: client fc2e9335-a1da-404e-b3d3-c74e78c9d38a, cookie 0x418ffb1c3bcc99db 00000004:00100000:2.0:1790772575.934998:0:22758:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1790772575.935127:0:22758:0:(import.c:65:import_set_state_nolock()) ffff9ecdf7572800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790772575.935921:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+6:2389:x1877760481056768:12345-192.168.206.14@tcp:38:mount.lustre.0 Request processed in 1045us (1961us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772575.935932:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 16 00000100:00100000:2.0:1790772575.935969:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 17 00000100:00100000:2.0:1790772575.935975:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2389:x1877760481057024:12345-192.168.206.14@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790772575.935999:0:22758:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from fc2e9335-a1da-404e-b3d3-c74e78c9d38a@192.168.206.14@tcp t0 exp 0000000000000000 cur 676 last 0 00000020:00000080:2.0:1790772575.936033:0:22758:0:(genops.c:1384:class_connect()) connect: client fc2e9335-a1da-404e-b3d3-c74e78c9d38a, cookie 0x418ffb1c3bcc99e2 00000004:00100000:2.0:1790772575.936054:0:22758:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1790772575.936248:0:22758:0:(import.c:65:import_set_state_nolock()) ffff9ecdf7576800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790772575.936290:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+6:2389:x1877760481057024:12345-192.168.206.14@tcp:38:mount.lustre.0 Request processed in 314us (2275us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772575.936298:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 17 00000100:00100000:1.0:1790772575.959406:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772575.959575:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481057280 00000100:00100000:2.0:1790772575.959589:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481057280 00000100:00100000:2.0:1790772575.959711:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 18 00000100:00100000:2.0:1790772575.959722:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3545180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+6:18146:x1877760481057280:12345-192.168.206.14@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790772575.959776:0:22757:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1790772575.959874:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3545180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+6:18146:x1877760481057280:12345-192.168.206.14@tcp:41:mount.lustre.0 Request processed in 154us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772575.959882:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 18 00000100:00080000:1.0:1790772575.960461:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772575.960654:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772575.960806:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1790772575.960945:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481057152 00000100:00100000:0.0:1790772575.960952:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481057152 00000100:00100000:0.0:1790772575.961005:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481056896 00000100:00100000:0.0:1790772575.961019:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481056896 00000100:00100000:0.0:1790772575.961037:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 19 00000100:00100000:0.0:1790772575.961045:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfaa84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+6:0:x1877760481057152:12345-192.168.206.14@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790772575.961078:0:22756:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790772575.961132:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfaa84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+6:0:x1877760481057152:12345-192.168.206.14@tcp:41:mount.lustre.0 Request processed in 88us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772575.961155:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 19 00000100:00100000:0.0:1790772575.961206:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 20 00000100:00100000:0.0:1790772575.961213:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfaa84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+6:0:x1877760481056896:12345-192.168.206.14@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790772575.961227:0:22756:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1790772575.961253:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfaa84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+6:0:x1877760481056896:12345-192.168.206.14@tcp:41:mount.lustre.0 Request processed in 39us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772575.961259:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 20 00000100:00080000:3.0:1790772575.963825:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790772575.966710:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772575.966887:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481057408 00000100:00100000:2.0:1790772575.966900:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481057408 00000100:00100000:2.0:1790772575.966986:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 21 00000100:00100000:2.0:1790772575.966997:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+6:18146:x1877760481057408:12345-192.168.206.14@tcp:40:mount.lustre.0 00000100:00100000:2.0:1790772575.967119:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+6:18146:x1877760481057408:12345-192.168.206.14@tcp:40:mount.lustre.0 Request processed in 123us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772575.967126:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 21 00000100:00100000:1.0:1790772575.986443:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772575.986492:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772575.986527:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772575.986785:0:24263:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481057536 00000100:00100000:3.0:1790772575.986798:0:24263:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481057536 00000100:00100000:3.0:1790772575.986851:0:24263:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481057664 00000100:00100000:3.0:1790772575.986855:0:24263:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481057664 00000100:00100000:3.0:1790772575.986874:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 22 00000100:00100000:3.0:1790772575.986920:0:24263:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2389:x1877760481057536:12345-192.168.206.14@tcp:8:mount.lustre.0 00010000:00080000:3.0:1790772575.986965:0:24263:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from fc2e9335-a1da-404e-b3d3-c74e78c9d38a@192.168.206.14@tcp t0 exp 0000000000000000 cur 676 last 0 00000020:00000080:3.0:1790772575.987003:0:24263:0:(genops.c:1384:class_connect()) connect: client fc2e9335-a1da-404e-b3d3-c74e78c9d38a, cookie 0x418ffb1c3bcc99e9 00002000:00100000:3.0:1790772575.991720:0:24263:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fc2e9335-a1da-404e-b3d3-c74e78c9d38a/ffff9eccc308b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790772575.991752:0:24263:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790772575.991855:0:24263:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790772575.991925:0:24263:0:(import.c:65:import_set_state_nolock()) ffff9eccc3088000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790772575.992044:0:24263:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+6:2389:x1877760481057536:12345-192.168.206.14@tcp:8:mount.lustre.0 Request processed in 5132us (5548us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772575.992057:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 22 00000100:00100000:3.0:1790772575.992098:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 23 00000100:00100000:3.0:1790772575.992106:0:24263:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2389:x1877760481057664:12345-192.168.206.14@tcp:8:mount.lustre.0 00000100:00100000:2.0:1790772575.993419:0:22767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481057792 00000100:00100000:2.0:1790772575.993435:0:22767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481057792 00000100:00100000:2.0:1790772575.993510:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 4 00000100:00100000:2.0:1790772575.993522:0:22767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3545500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+6:18146:x1877760481057792:12345-192.168.206.14@tcp:900:mount.lustre.0 00000100:00100000:2.0:1790772575.993607:0:22767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3545500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+6:18146:x1877760481057792:12345-192.168.206.14@tcp:900:mount.lustre.0 Request processed in 88us (7177us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772575.993615:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 4 00010000:00080000:0.0:1790772575.998940:0:24263:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from fc2e9335-a1da-404e-b3d3-c74e78c9d38a@192.168.206.14@tcp t0 exp 0000000000000000 cur 676 last 0 00000020:00000080:0.0:1790772575.998990:0:24263:0:(genops.c:1384:class_connect()) connect: client fc2e9335-a1da-404e-b3d3-c74e78c9d38a, cookie 0x418ffb1c3bcc99f0 00002000:00100000:0.0:1790772575.999004:0:24263:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fc2e9335-a1da-404e-b3d3-c74e78c9d38a/ffff9eccc3755000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790772575.999019:0:24263:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790772575.999123:0:24263:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790772575.999218:0:24263:0:(import.c:65:import_set_state_nolock()) ffff9eccc3754000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790772575.999306:0:24263:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+6:2389:x1877760481057664:12345-192.168.206.14@tcp:8:mount.lustre.0 Request processed in 7199us (12778us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772575.999319:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 23 00000100:00100000:1.0:1790772576.037046:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772576.037152:0:22760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481057920 00000100:00100000:2.0:1790772576.039266:0:22760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481057920 00000100:00100000:2.0:1790772576.039335:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 1 00000100:00100000:2.0:1790772576.039346:0:22760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+6:18146:x1877760481057920:12345-192.168.206.14@tcp:33:mount.lustre.0 00000004:00200000:2.0:1790772576.039419:0:22760:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1790772576.039512:0:22760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+6:18146:x1877760481057920:12345-192.168.206.14@tcp:33:mount.lustre.0 Request processed in 168us (2481us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772576.039519:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 1 00000100:00100000:1.0:1790772576.231138:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772576.231350:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481058048 00000100:00100000:2.0:1790772576.231360:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481058048 00000100:00100000:2.0:1790772576.231424:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 22 00000100:00100000:2.0:1790772576.231434:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+6:18182:x1877760481058048:12345-192.168.206.14@tcp:101:mkdir.0 00010000:00010000:2.0:1790772576.231453:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772576.231475:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560600/0x418ffb1c3bcc99f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42c6e08168753ae4 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772576.231536:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc99fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772576.231549:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc99fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772576.231565:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc99fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772576.231614:0:22757:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790772576.231618:0:22757:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790772576.231648:0:22757:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc99fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772576.231673:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560600/0x418ffb1c3bcc99f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753ae4 expref: 8 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772576.231691:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc99fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753ae4 expref: 7 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772576.231718:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eccc3658000) 00010000:00010000:2.0:1790772576.231721:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790772576.231724:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eccc3561000, rc 0) 00000100:00100000:2.0:1790772576.231786:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+7:18182:x1877760481058048:12345-192.168.206.14@tcp:101:mkdir.0 Request processed in 354us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772576.231794:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 22 00010000:00010000:0.0:1790772576.404362:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790772576.854578:0:22792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790772577.428367:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772577.559275:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdff730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1877760506338304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790772577.559341:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772577.559413:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790772577.559420:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1877760506338176:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790772577.559441:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772577.559483:0:24266:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506338304 00000100:00100000:0.0:1790772577.559490:0:24266:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506338304 00000100:00100000:0.0:1790772577.559532:0:24266:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506338176 00000100:00100000:0.0:1790772577.559535:0:24266:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506338176 00000100:00100000:0.0:1790772577.559550:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790772577.559557:0:24266:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877760506338304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790772577.559583:0:24266:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790772577.559633:0:24266:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877760506338304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772577.559640:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790772577.559655:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790772577.559661:0:24266:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877760506338176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790772577.559669:0:24266:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790772577.559690:0:24266:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877760506338176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 30us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772577.559696:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1790772577.559710:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790772577.559740:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1877760506338176:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790772577.559748:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1790772577.559761:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdff730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1877760506338304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790772577.563304:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdfaa86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3645:1877760506338432:0@lo:400:kworker.0 00000100:00100000:2.0:1790772577.563383:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772577.563422:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdfaa86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506338944:0@lo:400:kworker.0 00000100:00100000:2.0:1790772577.563445:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772577.563461:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdfaa85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1877760506339456:0@lo:400:kworker.0 00000100:00100000:2.0:1790772577.563481:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772577.563513:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1790772577.563519:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdfaa87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506338560:0@lo:400:kworker.0 00000100:00100000:2.0:1790772577.563536:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772577.563548:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdfaa86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506339072:0@lo:400:kworker.0 00000100:00100000:2.0:1790772577.563568:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772577.563582:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdfaa85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1877760506339584:0@lo:400:kworker.0 00000100:00100000:2.0:1790772577.563597:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772577.563635:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506338432 00000100:00100000:2.0:1790772577.563642:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506338432 00000100:00100000:2.0:1790772577.563683:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1790772577.563691:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcbabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+24:3645:x1877760506338432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772577.563742:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcbabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+24:3645:x1877760506338432:12345-0@lo:400:kworker.0 Request processed in 51us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772577.563749:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1790772577.563777:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506339456 00000100:00100000:2.0:1790772577.563780:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506339456 00000100:00100000:2.0:1790772577.563804:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506339584 00000100:00100000:2.0:1790772577.563806:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506339584 00000100:00100000:2.0:1790772577.563818:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790772577.563823:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf62e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1877760506339456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772577.563851:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf62e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1877760506339456:12345-0@lo:400:kworker.0 Request processed in 28us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772577.563857:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790772577.563867:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790772577.563872:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc8843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1877760506339584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772577.563893:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc8843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1877760506339584:12345-0@lo:400:kworker.0 Request processed in 21us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772577.563899:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790772577.563932:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdfaa85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1877760506339584:0@lo:400:kworker.0 00000100:00100000:2.0:1790772577.563940:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdfaa86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3645:1877760506338432:0@lo:400:kworker.0 00010000:00080000:2.0:1790772577.563950:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ecdfaa85180 x1877760506339456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772577.563960:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdfaa85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1877760506339456:0@lo:400:kworker.0 00000100:00100000:0.0:1790772577.564603:0:22762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506338944 00000100:00100000:0.0:1790772577.564609:0:22762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506338944 00000100:00100000:0.0:1790772577.564654:0:22762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506338560 00000100:00100000:0.0:1790772577.564657:0:22762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506338560 00000100:00100000:0.0:1790772577.564669:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790772577.564675:0:22762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf62e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506338944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772577.564726:0:22762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf62e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506338944:12345-0@lo:400:kworker.0 Request processed in 51us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772577.564740:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790772577.564753:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790772577.564757:0:22762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf62e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1877760506338560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772577.564784:0:22762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf62e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1877760506338560:12345-0@lo:400:kworker.0 Request processed in 26us (1246us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772577.564789:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790772577.564808:0:24695:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506339072 00000100:00100000:0.0:1790772577.564811:0:24695:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506339072 00000100:00100000:0.0:1790772577.564835:0:24695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790772577.564840:0:24695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc8843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506339072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772577.564867:0:24695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc8843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506339072:12345-0@lo:400:kworker.0 Request processed in 27us (1298us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772577.564872:0:24695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1790772577.564901:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790772577.564905:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790772577.564907:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790772577.564917:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdfaa87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1877760506338816:0@lo:400:kworker.0 00000100:00100000:0.0:1790772577.564942:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772577.564961:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdfaa84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1877760506339328:0@lo:400:kworker.0 00000100:00100000:0.0:1790772577.564978:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772577.564993:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1790772577.564998:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdfaa84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1877760506338688:0@lo:400:kworker.0 00000100:00100000:0.0:1790772577.565016:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772577.565031:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdfaa84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877760506339200:0@lo:400:kworker.0 00000100:00100000:0.0:1790772577.565060:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772577.565082:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdfaa86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1877760506339712:0@lo:400:kworker.0 00000100:00100000:0.0:1790772577.565446:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772577.565470:0:24264:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506338688 00000100:00100000:0.0:1790772577.565474:0:24264:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506338688 00000100:00100000:0.0:1790772577.565513:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790772577.565519:0:24264:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1877760506338688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772577.565553:0:24264:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1877760506338688:12345-0@lo:400:kworker.0 Request processed in 34us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772577.565558:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790772577.565575:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506338816 00000100:00100000:0.0:1790772577.565578:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506338816 00000100:00100000:0.0:1790772577.565590:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506339328 00000100:00100000:0.0:1790772577.565593:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506339328 00000100:00100000:0.0:1790772577.565601:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506339200 00000100:00100000:0.0:1790772577.565604:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506339200 00000100:00100000:0.0:1790772577.565612:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506339712 00000100:00100000:0.0:1790772577.565614:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506339712 00000100:00100000:0.0:1790772577.565638:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790772577.565644:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1877760506338816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772577.565671:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1877760506338816:12345-0@lo:400:kworker.0 Request processed in 27us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772577.565677:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790772577.565687:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790772577.565693:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1877760506339328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772577.565714:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1877760506339328:12345-0@lo:400:kworker.0 Request processed in 22us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772577.565719:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790772577.565728:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790772577.565739:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877760506339200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772577.565763:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877760506339200:12345-0@lo:400:kworker.0 Request processed in 24us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772577.565769:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790772577.565778:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790772577.565783:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc440c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1877760506339712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772577.565805:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc440c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1877760506339712:12345-0@lo:400:kworker.0 Request processed in 22us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772577.565810:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1790772577.565824:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790772577.565826:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790772577.565828:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790772577.565853:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdfaa87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506338560:0@lo:400:kworker.0 00000100:00100000:0.0:1790772577.565863:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdfaa86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506339072:0@lo:400:kworker.0 00000100:00100000:0.0:1790772577.565872:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdfaa86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506338944:0@lo:400:kworker.0 00000100:00100000:0.0:1790772577.565898:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdfaa84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1877760506338688:0@lo:400:kworker.0 00000100:00100000:0.0:1790772577.565906:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdfaa84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877760506339200:0@lo:400:kworker.0 00010000:00080000:0.0:1790772577.565916:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ecdfaa86a00 x1877760506339712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772577.565926:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdfaa86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1877760506339712:0@lo:400:kworker.0 00000100:00100000:0.0:1790772577.565933:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdfaa87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1877760506338816:0@lo:400:kworker.0 00000100:00100000:0.0:1790772577.565941:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdfaa84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1877760506339328:0@lo:400:kworker.0 00010000:00010000:1.0:1790772578.452857:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790772578.582719:0:25079:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fc2e9335-a1da-404e-b3d3-c74e78c9d38a 00000001:00100000:1.0:1790772578.582731:0:25079:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4f9f6919-1501-400a-bf51-76bbebf8064d 00000001:00100000:2.0:1790772578.584597:0:23489:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of fc2e9335-a1da-404e-b3d3-c74e78c9d38a 00000001:00100000:2.0:1790772578.584607:0:23489:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 4f9f6919-1501-400a-bf51-76bbebf8064d 00000001:00100000:0.0:1790772578.585063:0:22736:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fc2e9335-a1da-404e-b3d3-c74e78c9d38a 00000001:00100000:0.0:1790772578.585070:0:22736:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4f9f6919-1501-400a-bf51-76bbebf8064d 00000001:00100000:1.0:1790772578.585820:0:24259:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fc2e9335-a1da-404e-b3d3-c74e78c9d38a 00000001:00100000:1.0:1790772578.585832:0:24259:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4f9f6919-1501-400a-bf51-76bbebf8064d 00010000:00010000:2.0:1790772579.478562:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790772579.563347:0:25635:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1790772579.604385:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdfaa85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1877760506339840:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790772579.604485:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772579.604561:0:24266:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506339840 00000100:00100000:3.0:1790772579.604569:0:24266:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506339840 00000100:00100000:3.0:1790772579.604659:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790772579.604674:0:24266:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfaa85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877760506339840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790772579.604726:0:24266:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1790772579.604789:0:24266:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfaa85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877760506339840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 119us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772579.604798:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1790772579.604827:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790772579.604873:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdfaa85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1877760506339840:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790772579.606794:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc8842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506339968:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790772579.606885:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772579.606997:0:22762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506339968 00000100:00100000:2.0:1790772579.607007:0:22762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506339968 00000100:00100000:2.0:1790772579.607071:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790772579.607083:0:22762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfaa85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1877760506339968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790772579.607138:0:22762:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790772579.607219:0:22762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfaa85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1877760506339968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 139us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772579.607227:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790772579.607386:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc8842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506339968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790772579.613399:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc8840000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1877760506340096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790772579.613500:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772579.614262:0:23497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506340096 00000100:00100000:2.0:1790772579.614276:0:23497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506340096 00000100:00100000:2.0:1790772579.614340:0:23497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790772579.614352:0:23497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1877760506340096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790772579.614403:0:23497:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1790772579.614482:0:23497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1877760506340096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772579.614490:0:23497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790772579.614606:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc8840000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1877760506340096:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1790772580.500704:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772580.628459:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790772580.628497:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3544380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1877760506340224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790772580.628588:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772580.628672:0:24266:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506340224 00000100:00100000:1.0:1790772580.628683:0:24266:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506340224 00000100:00100000:1.0:1790772580.628773:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790772580.628783:0:24266:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877760506340224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790772580.628812:0:24266:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1790772580.628867:0:24266:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877760506340224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772580.628875:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1790772580.628900:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790772580.628945:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3544380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1877760506340224:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1790772580.758113:0:23514:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790772581.231141:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772581.231228:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772581.231266:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772581.231288:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772581.231327:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1790772581.232752:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481058304 00000100:00100000:0.0:1790772581.232772:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481058304 00000100:00100000:0.0:1790772581.232851:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481058816 00000100:00100000:0.0:1790772581.232855:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481058816 00000100:00100000:0.0:1790772581.232881:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 49 00000100:00100000:0.0:1790772581.232891:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3544380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+6:2392:x1877760481058304:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:0.0:1790772581.233008:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3544380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+6:2392:x1877760481058304:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 117us (1883us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772581.233017:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 49 00000100:00100000:0.0:1790772581.233035:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 50 00000100:00100000:0.0:1790772581.233042:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+6:2392:x1877760481058816:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:0.0:1790772581.233069:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+6:2392:x1877760481058816:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 27us (1803us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772581.233075:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 50 00000100:00080000:0.0:1790772581.233102:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772581.235568:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772581.235684:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772581.251901:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481058176 00000100:00100000:2.0:1790772581.251923:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481058176 00000100:00100000:2.0:1790772581.252015:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 147 00000100:00100000:2.0:1790772581.252027:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcbaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddb76036-7f3a-437f-b993-ff4cd941bf15+13:2392:x1877760481058176:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:2.0:1790772581.252135:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcbaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddb76036-7f3a-437f-b993-ff4cd941bf15+13:2392:x1877760481058176:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 110us (20806us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772581.252144:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 147 00000100:00100000:2.0:1790772581.252375:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772581.252535:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772581.253763:0:24695:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481058560 00000100:00100000:3.0:1790772581.253775:0:24695:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481058560 00000100:00100000:3.0:1790772581.255849:0:24695:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481059072 00000100:00100000:3.0:1790772581.255865:0:24695:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481059072 00000100:00100000:3.0:1790772581.255884:0:24695:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481058688 00000100:00100000:3.0:1790772581.255887:0:24695:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481058688 00000100:00100000:3.0:1790772581.255909:0:24695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 11 00000100:00100000:3.0:1790772581.255920:0:24695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f9f6919-1501-400a-bf51-76bbebf8064d+5:2392:x1877760481058560:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1790772581.257351:0:24695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f9f6919-1501-400a-bf51-76bbebf8064d+5:2392:x1877760481058560:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 1420us (26123us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772581.257367:0:24695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 11 00000100:00100000:3.0:1790772581.257409:0:24695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 12 00000100:00100000:3.0:1790772581.257423:0:24695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3546680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+5:2392:x1877760481059072:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1790772581.257484:0:24695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3546680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+5:2392:x1877760481059072:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 68us (26195us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772581.257491:0:24695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 12 00000100:00100000:3.0:1790772581.257504:0:24695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 13 00000100:00100000:3.0:1790772581.257510:0:24695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf6041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f9f6919-1501-400a-bf51-76bbebf8064d+5:2392:x1877760481058688:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1790772581.257554:0:24695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf6041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f9f6919-1501-400a-bf51-76bbebf8064d+5:2392:x1877760481058688:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 44us (21869us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772581.257561:0:24695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 13 00000100:00100000:1.0:1790772581.265281:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481058432 00000100:00100000:1.0:1790772581.265297:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481058432 00000100:00100000:1.0:1790772581.265372:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481058944 00000100:00100000:1.0:1790772581.265376:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481058944 00000100:00100000:1.0:1790772581.265402:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 51 00000100:00100000:1.0:1790772581.265413:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf6041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+5:2392:x1877760481058432:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1790772581.265514:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf6041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+5:2392:x1877760481058432:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 103us (29961us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772581.265539:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 51 00000100:00100000:1.0:1790772581.265574:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 52 00000100:00100000:1.0:1790772581.265581:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc8840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+5:2392:x1877760481058944:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1790772581.265622:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc8840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+5:2392:x1877760481058944:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 41us (13248us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772581.265628:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 52 00000100:00080000:0.0:1790772581.271982:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790772581.271994:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790772581.271998:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790772581.273291:0:24695:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481059200 00000100:00100000:3.0:1790772581.273310:0:24695:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481059200 00000100:00100000:3.0:1790772581.273408:0:24695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 14 00000100:00100000:3.0:1790772581.273420:0:24695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc8842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+5:2392:x1877760481059200:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1790772581.273526:0:24695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc8842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+5:2392:x1877760481059200:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 107us (20989us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772581.273534:0:24695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 14 00000100:00080000:1.0:1790772581.273809:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1790772581.524420:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772582.551953:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772582.677922:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790772582.677952:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1877760506340352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790772582.678057:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772582.678645:0:24266:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506340352 00000100:00100000:1.0:1790772582.678658:0:24266:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506340352 00000100:00100000:1.0:1790772582.678733:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790772582.678746:0:24266:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf80e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1877760506340352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790772582.678787:0:24266:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1790772582.678870:0:24266:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf80e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1877760506340352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772582.678879:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790772582.678906:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790772582.678918:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf6040380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1877760506340480:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790772582.678951:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790772582.678978:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790772582.678990:0:24267:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506340480 00000100:00100000:1.0:1790772582.678993:0:24267:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506340480 00000100:00100000:1.0:1790772582.679016:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790772582.679021:0:24267:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf6043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1877760506340480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790772582.679032:0:24267:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1790772582.679061:0:24267:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf6043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1877760506340480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772582.679094:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1790772582.679108:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790772582.679145:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf6040380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1877760506340480:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790772582.679205:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1877760506340352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790772582.683089:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1877760506340992:0@lo:400:kworker.0 00000100:00100000:2.0:1790772582.683218:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772582.683261:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1877760506341504:0@lo:400:kworker.0 00000100:00100000:2.0:1790772582.683295:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772582.683323:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1790772582.683330:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3645:1877760506340608:0@lo:400:kworker.0 00000100:00100000:2.0:1790772582.683360:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772582.683390:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506341120:0@lo:400:kworker.0 00000100:00100000:2.0:1790772582.683417:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772582.683438:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf75b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1877760506341632:0@lo:400:kworker.0 00000100:00100000:2.0:1790772582.683461:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772582.683507:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506340608 00000100:00100000:2.0:1790772582.683516:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506340608 00000100:00100000:2.0:1790772582.683573:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790772582.683583:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcba9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+24:3645:x1877760506340608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772582.683656:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcba9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+24:3645:x1877760506340608:12345-0@lo:400:kworker.0 Request processed in 75us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772582.683664:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790772582.683706:0:22761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506341120 00000100:00100000:2.0:1790772582.683710:0:22761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506341120 00000100:00100000:2.0:1790772582.683737:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790772582.683744:0:22761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc8841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506341120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772582.683781:0:22761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc8841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506341120:12345-0@lo:400:kworker.0 Request processed in 38us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772582.683787:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790772582.683831:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3645:1877760506340608:0@lo:400:kworker.0 00000100:00100000:2.0:1790772582.683857:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506341120:0@lo:400:kworker.0 00000100:00100000:1.0:1790772582.684349:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506340992 00000100:00100000:1.0:1790772582.684357:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506340992 00000100:00100000:1.0:1790772582.684388:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506341504 00000100:00100000:1.0:1790772582.684391:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506341504 00000100:00100000:1.0:1790772582.684422:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506341632 00000100:00100000:1.0:1790772582.684425:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506341632 00000100:00100000:1.0:1790772582.684443:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790772582.684450:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc8840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1877760506340992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772582.684529:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc8840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1877760506340992:12345-0@lo:400:kworker.0 Request processed in 79us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772582.684536:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790772582.684551:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790772582.684559:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc8841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1877760506341504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772582.684589:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc8841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1877760506341504:12345-0@lo:400:kworker.0 Request processed in 32us (1292us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772582.684608:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790772582.684620:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790772582.684626:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc8842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1877760506341632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772582.684654:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc8842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1877760506341632:12345-0@lo:400:kworker.0 Request processed in 30us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772582.684661:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790772582.684704:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1877760506340864:0@lo:400:kworker.0 00000100:00100000:1.0:1790772582.684741:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772582.684763:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877760506341376:0@lo:400:kworker.0 00000100:00100000:1.0:1790772582.684784:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772582.684799:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf75b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1877760506341888:0@lo:400:kworker.0 00000100:00100000:1.0:1790772582.684825:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772582.684840:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1790772582.684846:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1877760506340736:0@lo:400:kworker.0 00000100:00100000:1.0:1790772582.684868:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772582.684883:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1877760506341248:0@lo:400:kworker.0 00000100:00100000:1.0:1790772582.684903:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772582.684920:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf75b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1877760506341760:0@lo:400:kworker.0 00000100:00100000:1.0:1790772582.684940:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772582.686012:0:22762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506340736 00000100:00100000:1.0:1790772582.686027:0:22762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506340736 00000100:00100000:3.0:1790772582.686188:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790772582.686202:0:22761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf6041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877760506340736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772582.686294:0:22761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf6041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877760506340736:12345-0@lo:400:kworker.0 Request processed in 96us (1424us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772582.686301:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1790772582.687006:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ecdf75b2680 x1877760506341632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772582.687024:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf75b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1877760506341632:0@lo:400:kworker.0 00000100:00100000:3.0:1790772582.687041:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1877760506340992:0@lo:400:kworker.0 00000100:00100000:3.0:1790772582.687053:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1877760506341504:0@lo:400:kworker.0 00000100:00080000:2.0:1790772582.687086:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790772582.687093:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772582.699399:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506341376 00000100:00100000:0.0:1790772582.699420:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506341376 00000100:00100000:0.0:1790772582.699508:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506341888 00000100:00100000:0.0:1790772582.699512:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506341888 00000100:00100000:0.0:1790772582.699548:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506341760 00000100:00100000:0.0:1790772582.699551:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506341760 00000100:00100000:0.0:1790772582.699573:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790772582.699586:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf6040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877760506341376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772582.699719:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf6040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877760506341376:12345-0@lo:400:kworker.0 Request processed in 136us (14933us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772582.699728:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790772582.699749:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790772582.699755:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf6043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1877760506341888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772582.699788:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf6043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1877760506341888:12345-0@lo:400:kworker.0 Request processed in 33us (14962us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772582.699795:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790772582.699806:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790772582.699812:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf6041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1877760506341760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772582.699841:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf6041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1877760506341760:12345-0@lo:400:kworker.0 Request processed in 29us (14900us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772582.699846:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790772582.699882:0:24263:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506340864 00000100:00100000:0.0:1790772582.699886:0:24263:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506340864 00000100:00100000:0.0:1790772582.699920:0:24263:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506341248 00000100:00100000:0.0:1790772582.699924:0:24263:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506341248 00000100:00100000:0.0:1790772582.699946:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790772582.699952:0:24263:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf6040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1877760506340864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772582.703184:0:24263:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf6040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1877760506340864:12345-0@lo:400:kworker.0 Request processed in 3203us (18414us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772582.703224:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790772582.703267:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790772582.703280:0:24263:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf6040e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1877760506341248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772582.703342:0:24263:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf6040e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1877760506341248:12345-0@lo:400:kworker.0 Request processed in 68us (18438us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772582.703348:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1790772582.703406:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790772582.703413:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790772582.703416:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790772582.708231:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1877760506340736:0@lo:400:kworker.0 00000100:00100000:0.0:1790772582.708257:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1877760506341248:0@lo:400:kworker.0 00000100:00100000:0.0:1790772582.708295:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf75b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1877760506341760:0@lo:400:kworker.0 00000100:00100000:0.0:1790772582.708311:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1877760506340864:0@lo:400:kworker.0 00000100:00100000:0.0:1790772582.708323:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877760506341376:0@lo:400:kworker.0 00010000:00080000:0.0:1790772582.708340:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ecdf75b0700 x1877760506341888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772582.708352:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf75b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1877760506341888:0@lo:400:kworker.0 00010000:00010000:0.0:1790772583.584496:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790772584.320063:0:25782:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd0af695c0 20000000:00000080:2.0:1790772584.320079:0:25782:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ecdf07acc00 uarg=0000000000000000 20000000:01000000:2.0:1790772584.320120:0:25782:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790772584.320124:0:25782:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790772584.320129:0:25782:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1790772584.321061:0:25783:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1790772584.321297:0:25782:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1790772584.335694:0:25782:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790772584.335722:0:25782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eccc3561c00/0x418ffb1c3bcc9a05 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772584.335740:0:25782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ecdfbab0e00/0x418ffb1c3bcc9662 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc965b expref: 23 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772584.335748:0:25782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ecdef3a7200/0x418ffb1c3bcc9670 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9669 expref: 23 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772584.335755:0:25782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ecdef3a6000/0x418ffb1c3bcc96af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc96a8 expref: 23 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772584.335761:0:25782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eccc3560a00/0x418ffb1c3bcc9829 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9822 expref: 23 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772584.335770:0:25782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eccc3560200/0x418ffb1c3bcc9995 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753a43 expref: 12 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772584.335777:0:25782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ecdf4bd8e00/0x418ffb1c3bcc99d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753ab3 expref: 12 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772584.335802:0:25782:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eccc3561c00/0x418ffb1c3bcc9a05 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772584.335845:0:25782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ecdf4bd8e00/0x418ffb1c3bcc99d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753ab3 expref: 12 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772584.335860:0:25782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ecdf4bd8e00/0x418ffb1c3bcc99d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753ab3 expref: 12 pid: 22749 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772584.335874:0:25782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc8842680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25782:1877760506342016:192.168.206.14@tcp:104: 00010000:00010000:2.0:1790772584.336097:0:25782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eccc3560200/0x418ffb1c3bcc9995 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753a43 expref: 12 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772584.336106:0:25782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eccc3560200/0x418ffb1c3bcc9995 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753a43 expref: 12 pid: 22751 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772584.336115:0:25782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc8841180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25782:1877760506342144:192.168.206.14@tcp:104: 00010000:00010000:2.0:1790772584.336148:0:25782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eccc3560a00/0x418ffb1c3bcc9829 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x418ffb1c3bcc9822 expref: 23 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772584.336156:0:25782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eccc3560a00/0x418ffb1c3bcc9829 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x418ffb1c3bcc9822 expref: 23 pid: 22749 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772584.336207:0:25782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc8840e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25782:1877760506342272:0@lo:104: 00000100:00100000:2.0:1790772584.336245:0:25782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790772584.336279:0:25782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ecdef3a6000/0x418ffb1c3bcc96af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x418ffb1c3bcc96a8 expref: 23 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772584.336297:0:25782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ecdef3a6000/0x418ffb1c3bcc96af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x418ffb1c3bcc96a8 expref: 23 pid: 22750 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772584.336305:0:25782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc8841500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25782:1877760506342400:0@lo:104: 00000100:00100000:2.0:1790772584.336327:0:25782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790772584.336348:0:25782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ecdef3a7200/0x418ffb1c3bcc9670 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x418ffb1c3bcc9669 expref: 23 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772584.336356:0:25782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ecdef3a7200/0x418ffb1c3bcc9670 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x418ffb1c3bcc9669 expref: 23 pid: 22750 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772584.336363:0:25782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc8843b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25782:1877760506342528:0@lo:104: 00000100:00100000:2.0:1790772584.336382:0:25782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790772584.336398:0:25782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ecdfbab0e00/0x418ffb1c3bcc9662 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x418ffb1c3bcc965b expref: 23 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772584.336405:0:25782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ecdfbab0e00/0x418ffb1c3bcc9662 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x418ffb1c3bcc965b expref: 23 pid: 22749 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772584.336411:0:25782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc8840000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25782:1877760506342656:0@lo:104: 00000100:00100000:2.0:1790772584.336428:0:25782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772584.336438:0:25782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdeedeb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790772584.336884:0:22740:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506342272 00000100:00100000:3.0:1790772584.336893:0:22740:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506342272 00000100:00100000:3.0:1790772584.336929:0:22740:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506342400 00000100:00100000:3.0:1790772584.336932:0:22740:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506342400 00000100:00100000:3.0:1790772584.336942:0:22740:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506342528 00000100:00100000:3.0:1790772584.336944:0:22740:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506342528 00000100:00100000:3.0:1790772584.336952:0:22740:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506342656 00000100:00100000:3.0:1790772584.336955:0:22740:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506342656 00000100:00100000:3.0:1790772584.336968:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790772584.336983:0:22740:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc8841880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+6:25782:x1877760506342272:12345-0@lo:104: 00010000:00010000:3.0:1790772584.336995:0:22740:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9ecdff439400/0x418ffb1c3bcc9822 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x418ffb1c3bcc9829 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772584.337126:0:22740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790772584.337133:0:22740:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc8841880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+6:25782:x1877760506342272:12345-0@lo:104: Request processed in 152us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772584.337140:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790772584.337182:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790772584.337190:0:22740:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc8840700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+5:25782:x1877760506342400:12345-0@lo:104: 00010000:00010000:3.0:1790772584.337198:0:22740:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd0a00/0x418ffb1c3bcc96a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x418ffb1c3bcc96af expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772584.337227:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772584.337233:0:22740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1790772584.337237:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9ecdff439400/0x418ffb1c3bcc9822 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x418ffb1c3bcc9829 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772584.337238:0:22740:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc8840700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+5:25782:x1877760506342400:12345-0@lo:104: Request processed in 50us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772584.337243:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1790772584.337244:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdff439400 already unused, calling callback (ffffffffc11ffc20) 10000000:00010000:0.0:1790772584.337254:0:22744:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9ecdff439400/0x418ffb1c3bcc9822 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x418ffb1c3bcc9829 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772584.337256:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790772584.337261:0:22740:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc8843480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+4:25782:x1877760506342528:12345-0@lo:104: 00010000:00010000:0.0:1790772584.337263:0:22744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9ecdff439400/0x418ffb1c3bcc9822 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x418ffb1c3bcc9829 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772584.337268:0:22740:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1e00/0x418ffb1c3bcc9669 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x418ffb1c3bcc9670 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790772584.337271:0:22744:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9ecdff439400/0x418ffb1c3bcc9822 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x418ffb1c3bcc9829 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772584.337277:0:22744:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790772584.337298:0:22740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790772584.337302:0:22740:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc8843480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+4:25782:x1877760506342528:12345-0@lo:104: Request processed in 42us (920us total) trans 0 rc 0/0 00010000:00010000:0.0:1790772584.337305:0:22744:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9ecdff439400/0x418ffb1c3bcc9822 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc9829 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772584.337308:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1790772584.337311:0:22744:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1790772584.337319:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1790772584.337329:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9ecdff439400/0x418ffb1c3bcc9822 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc9829 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772584.337331:0:22740:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc8842d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+3:25782:x1877760506342656:12345-0@lo:104: 00010000:00010000:0.0:1790772584.337336:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9ecdff439400/0x418ffb1c3bcc9822 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc9829 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772584.337339:0:22740:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc965b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x418ffb1c3bcc9662 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772584.337349:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790772584.337351:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd0a00/0x418ffb1c3bcc96a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x418ffb1c3bcc96af expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772584.337357:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc1bd0a00 already unused, calling callback (ffffffffc11ffc20) 10000000:00010000:0.0:1790772584.337360:0:22744:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd0a00/0x418ffb1c3bcc96a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x418ffb1c3bcc96af expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772584.337364:0:22740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1790772584.337367:0:22744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd0a00/0x418ffb1c3bcc96a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x418ffb1c3bcc96af expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772584.337368:0:22740:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc8842d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+3:25782:x1877760506342656:12345-0@lo:104: Request processed in 38us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772584.337374:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 10000000:00010000:0.0:1790772584.337382:0:22744:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd0a00/0x418ffb1c3bcc96a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x418ffb1c3bcc96af expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772584.337388:0:25002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:01000000:0.0:1790772584.337388:0:22744:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790772584.337392:0:25002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1e00/0x418ffb1c3bcc9669 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x418ffb1c3bcc9670 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772584.337398:0:25002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc1bd1e00 already unused, calling callback (ffffffffc11ffc20) 00010000:00010000:0.0:1790772584.337401:0:22744:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd0a00/0x418ffb1c3bcc96a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc96af expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790772584.337402:0:25002:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1e00/0x418ffb1c3bcc9669 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x418ffb1c3bcc9670 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772584.337407:0:22744:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790772584.337409:0:25002:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1e00/0x418ffb1c3bcc9669 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x418ffb1c3bcc9670 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772584.337413:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd0a00/0x418ffb1c3bcc96a8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc96af expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790772584.337415:0:25002:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1e00/0x418ffb1c3bcc9669 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x418ffb1c3bcc9670 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772584.337420:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd0a00/0x418ffb1c3bcc96a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc96af expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772584.337421:0:25002:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790772584.337432:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772584.337433:0:25002:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1e00/0x418ffb1c3bcc9669 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc9670 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772584.337435:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc965b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x418ffb1c3bcc9662 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772584.337440:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf4bd9e00 already unused, calling callback (ffffffffc11ffc20) 10000000:00010000:0.0:1790772584.337443:0:22744:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc965b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x418ffb1c3bcc9662 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772584.337450:0:22744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc965b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x418ffb1c3bcc9662 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790772584.337456:0:22744:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc965b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x418ffb1c3bcc9662 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772584.337461:0:22744:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790772584.337480:0:22744:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc965b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc9662 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772584.337486:0:22744:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790772584.337501:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc965b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc9662 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772584.337507:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc965b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc9662 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772584.337514:0:25002:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790772584.337516:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772584.337518:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772584.337520:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772584.337521:0:25002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1e00/0x418ffb1c3bcc9669 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc9670 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772584.337537:0:25002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9eccc1bd1e00/0x418ffb1c3bcc9669 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x418ffb1c3bcc9670 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772584.337550:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772584.337552:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772584.337554:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772584.337560:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772584.337572:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf75b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3645:1877760506342784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790772584.337614:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772584.337648:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790772584.337653:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf75b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3645:1877760506342912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790772584.337673:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772584.337673:0:25782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc8840e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25782:1877760506342272:0@lo:104: 00000100:00100000:2.0:1790772584.337682:0:25782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc8841500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25782:1877760506342400:0@lo:104: 00000100:00100000:2.0:1790772584.337689:0:25782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc8843b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25782:1877760506342528:0@lo:104: 00000100:00100000:2.0:1790772584.337696:0:25782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc8840000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25782:1877760506342656:0@lo:104: 00000100:00100000:3.0:1790772584.337698:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf75b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3643:1877760506343168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790772584.337717:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772584.337732:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdfaa87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3644:1877760506343040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790772584.337747:0:22742:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506342784 00000100:00100000:3.0:1790772584.337751:0:22742:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506342784 00000100:00100000:0.0:1790772584.337758:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790772584.337769:0:22742:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eccc3560a00/0x418ffb1c3bcc9829 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x418ffb1c3bcc9822 expref: 24 pid: 22749 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772584.337782:0:22742:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506342912 00000100:00100000:3.0:1790772584.337785:0:22742:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506342912 00010000:00010000:3.0:1790772584.337794:0:22742:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ecdef3a6000/0x418ffb1c3bcc96af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x418ffb1c3bcc96a8 expref: 25 pid: 22750 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772584.337804:0:22742:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506343168 00000100:00100000:3.0:1790772584.337807:0:22742:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506343168 00010000:00010000:3.0:1790772584.337816:0:22742:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ecdfbab0e00/0x418ffb1c3bcc9662 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x418ffb1c3bcc965b expref: 26 pid: 22749 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772584.337838:0:22742:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506343040 00000100:00100000:3.0:1790772584.337841:0:22742:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506343040 00000100:00100000:2.0:1790772584.337895:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790772584.337908:0:22741:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfaa84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+27:3645:x1877760506342784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790772584.337918:0:22741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772584.337923:0:22741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eccc3560a00/0x418ffb1c3bcc9829 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x418ffb1c3bcc9822 expref: 27 pid: 22749 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772584.337930:0:22742:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ecdef3a7200/0x418ffb1c3bcc9670 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x418ffb1c3bcc9669 expref: 27 pid: 22750 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772584.337932:0:22741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eccc3560a00/0x418ffb1c3bcc9829 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x418ffb1c3bcc9822 expref: 27 pid: 22749 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772584.337943:0:22742:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1790772584.337945:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eccc3560a00/0x418ffb1c3bcc9829 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x418ffb1c3bcc9822 expref: 27 pid: 22749 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772584.337949:0:22742:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1790772584.337957:0:22741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772584.337969:0:22743:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1790772584.337978:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790772584.337984:0:22743:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfaa87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+26:3645:x1877760506342912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790772584.337991:0:22743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772584.337996:0:22743:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ecdef3a6000/0x418ffb1c3bcc96af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x418ffb1c3bcc96a8 expref: 26 pid: 22750 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772584.338004:0:22743:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ecdef3a6000/0x418ffb1c3bcc96af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x418ffb1c3bcc96a8 expref: 26 pid: 22750 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772584.338014:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ecdef3a6000/0x418ffb1c3bcc96af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x418ffb1c3bcc96a8 expref: 26 pid: 22750 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772584.338023:0:22743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772584.340266:0:22741:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfaa84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+25:3645:x1877760506342784:12345-0@lo:103:ldlm_bl.0 Request processed in 2352us (2644us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772584.340279:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790772584.340308:0:22741:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1790772584.340319:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790772584.340322:0:22743:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfaa87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+24:3645:x1877760506342912:12345-0@lo:103:ldlm_bl.0 Request processed in 2337us (2647us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772584.340328:0:22741:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfaa86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+24:3643:x1877760506343168:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790772584.340329:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790772584.340342:0:22743:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1790772584.340343:0:22741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790772584.340347:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1790772584.340351:0:22741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ecdfbab0e00/0x418ffb1c3bcc9662 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x418ffb1c3bcc965b expref: 23 pid: 22749 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772584.340352:0:22743:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf75b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+23:3644:x1877760506343040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790772584.340360:0:22743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772584.340363:0:22741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ecdfbab0e00/0x418ffb1c3bcc9662 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x418ffb1c3bcc965b expref: 23 pid: 22749 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772584.340374:0:22743:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ecdef3a7200/0x418ffb1c3bcc9670 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x418ffb1c3bcc9669 expref: 23 pid: 22750 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772584.340377:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ecdfbab0e00/0x418ffb1c3bcc9662 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x418ffb1c3bcc965b expref: 23 pid: 22749 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772584.340383:0:22743:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ecdef3a7200/0x418ffb1c3bcc9670 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x418ffb1c3bcc9669 expref: 23 pid: 22750 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772584.340390:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ecdef3a7200/0x418ffb1c3bcc9670 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x418ffb1c3bcc9669 expref: 22 pid: 22750 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772584.340392:0:22741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790772584.340402:0:22743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772584.340497:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf75b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3645:1877760506342912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790772584.340508:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf75b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3645:1877760506342784:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790772584.340662:0:22741:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfaa86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:3643:x1877760506343168:12345-0@lo:103:ldlm_bl.0 Request processed in 335us (2943us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772584.340669:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790772584.343846:0:22743:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf75b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+20:3644:x1877760506343040:12345-0@lo:103:ldlm_bl.0 Request processed in 3486us (6079us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772584.343861:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790772584.343915:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdfaa87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3644:1877760506343040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790772584.343947:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf75b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3643:1877760506343168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790772584.344426:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772584.344438:0:25782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc8842680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25782:1877760506342016:192.168.206.14@tcp:104: 00000100:00100000:2.0:1790772584.344717:0:25782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc8841180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25782:1877760506342144:192.168.206.14@tcp:104: 00000100:00100000:1.0:1790772584.344720:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00010000:00010000:2.0:1790772584.344748:0:25782:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eccc3561c00/0x418ffb1c3bcc9a05 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772584.349307:0:22741:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481059328 00000100:00100000:3.0:1790772584.349321:0:22741:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481059328 00010000:00010000:3.0:1790772584.349369:0:22741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ecdf4bd8e00/0x418ffb1c3bcc99d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753ab3 expref: 13 pid: 22749 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772584.349408:0:22741:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481059456 00000100:00100000:3.0:1790772584.349412:0:22741:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481059456 00010000:00010000:3.0:1790772584.349428:0:22741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eccc3560200/0x418ffb1c3bcc9995 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753a43 expref: 14 pid: 22751 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772584.349538:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 13 00000100:00100000:3.0:1790772584.349548:0:22741:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfb40d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddb76036-7f3a-437f-b993-ff4cd941bf15+14:2393:x1877760481059328:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772584.349582:0:22741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772584.349599:0:22741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ecdf4bd8e00/0x418ffb1c3bcc99d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753ab3 expref: 14 pid: 22749 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772584.349619:0:22741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ecdf4bd8e00/0x418ffb1c3bcc99d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753ab3 expref: 14 pid: 22749 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772584.349636:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ecdf4bd8e00/0x418ffb1c3bcc99d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753ab3 expref: 14 pid: 22749 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772584.349650:0:22741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772584.349707:0:22741:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfb40d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddb76036-7f3a-437f-b993-ff4cd941bf15+13:2393:x1877760481059328:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 161us (5284us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772584.349715:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 13 00000100:00100000:3.0:1790772584.349780:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 14 00000100:00100000:3.0:1790772584.349788:0:22741:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf6041c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddb76036-7f3a-437f-b993-ff4cd941bf15+12:2393:x1877760481059456:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772584.349796:0:22741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772584.349801:0:22741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eccc3560200/0x418ffb1c3bcc9995 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753a43 expref: 12 pid: 22751 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772584.349810:0:22741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eccc3560200/0x418ffb1c3bcc9995 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753a43 expref: 12 pid: 22751 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772584.349820:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eccc3560200/0x418ffb1c3bcc9995 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753a43 expref: 12 pid: 22751 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772584.349833:0:22741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eccc3561c00/0x418ffb1c3bcc9a05 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772584.349841:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eccc3561c00/0x418ffb1c3bcc9a05 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772584.349868:0:22741:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eccc3561c00/0x418ffb1c3bcc9a05 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772584.349875:0:22741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eccc3561c00/0x418ffb1c3bcc9a05 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772584.349882:0:22741:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eccc3561c00/0x418ffb1c3bcc9a05 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772584.349889:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eccc3561c00/0x418ffb1c3bcc9a05 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772584.349895:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc3561c00 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:3.0:1790772584.349899:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eccc3561c00/0x418ffb1c3bcc9a05 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772584.349908:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eccc3561c00/0x418ffb1c3bcc9a05 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772584.349922:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eccc3561c00/0x418ffb1c3bcc9a05 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772584.349932:0:22741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772584.349954:0:22741:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf6041c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddb76036-7f3a-437f-b993-ff4cd941bf15+11:2393:x1877760481059456:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 166us (5233us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772584.349961:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 14 00010000:00010000:2.0:1790772584.350649:0:25782:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eccc3561c00/0x418ffb1c3bcc9a05 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772584.350659:0:25782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eccc3561c00/0x418ffb1c3bcc9a05 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772584.350665:0:25782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eccc3561c00/0x418ffb1c3bcc9a05 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772584.598821:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772584.724452:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790772584.724478:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc8841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1877760506343296:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790772584.724543:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772584.724914:0:23497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506343296 00000100:00100000:2.0:1790772584.724921:0:23497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506343296 00000100:00100000:2.0:1790772584.724972:0:23497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790772584.724980:0:23497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf6042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1877760506343296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790772584.725011:0:23497:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1790772584.725072:0:23497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf6042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1877760506343296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772584.725079:0:23497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790772584.725222:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc8841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1877760506343296:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790772584.725701:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790772584.725711:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf75b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506343424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790772584.725743:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772584.725864:0:24267:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506343424 00000100:00100000:1.0:1790772584.725868:0:24267:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506343424 00000100:00100000:1.0:1790772584.725907:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790772584.725913:0:24267:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf75b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506343424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790772584.725944:0:24267:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1790772584.725982:0:24267:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf75b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506343424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772584.725988:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1790772584.726005:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790772584.726030:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf75b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506343424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790772584.726081:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf6040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1877760506343552:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790772584.726111:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772584.726214:0:22762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506343552 00000100:00100000:1.0:1790772584.726218:0:22762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506343552 00000100:00100000:1.0:1790772584.726242:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790772584.726248:0:22762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf75b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1877760506343552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790772584.726267:0:22762:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790772584.726300:0:22762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf75b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1877760506343552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772584.726305:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790772584.726329:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf6040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1877760506343552:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1790772585.620574:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772585.750530:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790772585.750557:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf6040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1877760506343680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790772585.750638:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772585.751346:0:24267:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506343680 00000100:00100000:1.0:1790772585.751355:0:24267:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506343680 00000100:00100000:1.0:1790772585.751429:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790772585.751438:0:24267:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc8842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1877760506343680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790772585.751459:0:24267:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00080000:0.0:1790772585.751604:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790772585.752153:0:24267:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc8842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1877760506343680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 714us (1513us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772585.752163:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790772585.763455:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf6040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1877760506343680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790772586.024485:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1790772586.024682:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481059584 00000100:00100000:0.0:1790772586.024692:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481059584 00000100:00100000:0.0:1790772586.024770:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 23 00000100:00100000:0.0:1790772586.024780:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfaa84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+6:18651:x1877760481059584:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790772586.024809:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772586.024827:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013600/0x418ffb1c3bcc9a0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42c6e08168753aeb expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.024901:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9a13 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.024916:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9a13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.024930:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9a13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.024944:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013800/0x418ffb1c3bcc9a1a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.024951:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013800/0x418ffb1c3bcc9a1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.024958:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013800/0x418ffb1c3bcc9a1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.025023:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012a00/0x418ffb1c3bcc9a21 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.025030:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012a00/0x418ffb1c3bcc9a21 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.025038:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012a00/0x418ffb1c3bcc9a21 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772586.025064:0:22756:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790772586.025072:0:22756:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790772586.025109:0:22756:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012a00/0x418ffb1c3bcc9a21 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.025121:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9a13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.025127:0:22756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9a13 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.025135:0:22756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9a13 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.025140:0:22756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf5012800 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:0.0:1790772586.025145:0:22756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9a13 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.025153:0:22756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9a13 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.025202:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eccc3658000) 00010000:00010000:0.0:1790772586.025206:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772586.025211:0:22756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9a13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.025218:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9a13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.025230:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013800/0x418ffb1c3bcc9a1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.025235:0:22756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013800/0x418ffb1c3bcc9a1a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.025250:0:22756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013800/0x418ffb1c3bcc9a1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.025256:0:22756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf5013800 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:0.0:1790772586.025259:0:22756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013800/0x418ffb1c3bcc9a1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.025265:0:22756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013800/0x418ffb1c3bcc9a1a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.025274:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9eccc3658500) 00010000:00010000:0.0:1790772586.025277:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772586.025279:0:22756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013800/0x418ffb1c3bcc9a1a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.025285:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013800/0x418ffb1c3bcc9a1a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.025314:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013600/0x418ffb1c3bcc9a0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753aeb expref: 8 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.025326:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012a00/0x418ffb1c3bcc9a21 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753aeb expref: 7 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.025333:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9eccc3658d00) 00010000:00010000:0.0:1790772586.025335:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790772586.025338:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdf5012a00, rc 0) 00000100:00100000:0.0:1790772586.025393:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfaa84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+7:18651:x1877760481059584:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 616us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772586.025407:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 23 00000100:00080000:1.0:1790772586.025601:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772586.039095:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1790772586.039207:0:22768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481059712 00000100:00100000:0.0:1790772586.039215:0:22768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481059712 00000100:00100000:0.0:1790772586.039273:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 5 00000100:00100000:0.0:1790772586.039283:0:22768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf6042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4f9f6919-1501-400a-bf51-76bbebf8064d+7:18651:x1877760481059712:12345-192.168.206.14@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1790772586.039834:0:22768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf6042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4f9f6919-1501-400a-bf51-76bbebf8064d+7:18651:x1877760481059712:12345-192.168.206.14@tcp:900:lhsmtool_posix.0 Request processed in 550us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772586.039842:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 5 00000100:00100000:3.0:1790772586.060959:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1790772586.061197:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481059968 00000100:00100000:0.0:1790772586.061206:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481059968 00000100:00100000:0.0:1790772586.061248:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 24 00000100:00100000:0.0:1790772586.061257:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfaa87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+7:18651:x1877760481059968:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790772586.061278:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772586.061295:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013600/0x418ffb1c3bcc9a28 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42c6e08168753af2 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.062087:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013800/0x418ffb1c3bcc9a2f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.062102:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013800/0x418ffb1c3bcc9a2f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.062114:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013800/0x418ffb1c3bcc9a2f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.062128:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9a36 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.062154:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9a36 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.062161:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9a36 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.064112:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012e00/0x418ffb1c3bcc9a3d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.064127:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012e00/0x418ffb1c3bcc9a3d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.064138:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012e00/0x418ffb1c3bcc9a3d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772586.064149:0:22757:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1790772586.064331:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013800/0x418ffb1c3bcc9a2f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.064340:0:22757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013800/0x418ffb1c3bcc9a2f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.064348:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013800/0x418ffb1c3bcc9a2f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.064353:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf5013800 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:0.0:1790772586.064357:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013800/0x418ffb1c3bcc9a2f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.064365:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013800/0x418ffb1c3bcc9a2f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.066290:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9eccc3658d00) 00010000:00010000:0.0:1790772586.066312:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772586.066323:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013800/0x418ffb1c3bcc9a2f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.066333:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013800/0x418ffb1c3bcc9a2f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.066359:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9a36 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.066367:0:22757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9a36 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.066373:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9a36 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.066377:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf5012800 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:0.0:1790772586.066380:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9a36 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.066726:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9a36 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.066742:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9eccc3658500) 00010000:00010000:0.0:1790772586.066745:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772586.066748:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9a36 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.066755:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9a36 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772586.071734:0:22754:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790772586.071756:0:22754:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ecdfaa9d000 from 13 10000000:01000000:1.0:1790772586.071760:0:22754:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790772586.071802:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdff438600/0x418ffb1c3bcc9a4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.071812:0:22754:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9ecdff438600/0x418ffb1c3bcc9a4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.071824:0:22754:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9ecdff438600/0x418ffb1c3bcc9a4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772586.071849:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf6042300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506343808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790772586.071914:0:22754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772586.071949:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc3ccaf00 going to sleep for 11 seconds 00000040:00080000:0.0:1790772586.072844:0:22792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790772586.073988:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013600/0x418ffb1c3bcc9a28 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753af2 expref: 10 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.074011:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012e00/0x418ffb1c3bcc9a3d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753af2 expref: 9 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.074020:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eccc3658100) 00010000:00010000:1.0:1790772586.074024:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772586.074027:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdf5012e00, rc 0) 00000100:00100000:1.0:1790772586.074100:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfaa87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+9:18651:x1877760481059968:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 12844us (13148us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1790772586.074109:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 24 00000100:00100000:3.0:1790772586.074247:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506343808 00000100:00100000:3.0:1790772586.074255:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506343808 00000100:00100000:3.0:1790772586.074296:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1790772586.074315:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfcba9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+20:22754:x1877760506343808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772586.074328:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772586.074352:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ecdf4bd9000/0x418ffb1c3bcc9a52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x418ffb1c3bcc9a4b expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.074372:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ecdf4bd9000/0x418ffb1c3bcc9a52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9a4b expref: 21 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.074382:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ecdf4bd9000/0x418ffb1c3bcc9a52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9a4b expref: 21 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.074396:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdf4bd9000, rc 0) 00000100:00100000:3.0:1790772586.074440:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfcba9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:22754:x1877760506343808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (2526us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772586.074446:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1790772586.074511:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf6042300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506343808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772586.074527:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9ecdff438600/0x418ffb1c3bcc9a4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9a52 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.074537:0:22754:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9ecdff438600/0x418ffb1c3bcc9a4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc9a52 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772586.074610:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdfaa86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506343936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772586.074638:0:22754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772586.074680:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdda0dba80 going to sleep for 11 seconds 00000100:00100000:3.0:1790772586.074692:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506343936 00000100:00100000:3.0:1790772586.074696:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506343936 00000100:00100000:3.0:1790772586.074719:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1790772586.074725:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:22754:x1877760506343936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772586.074820:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:22754:x1877760506343936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772586.074826:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1790772586.074854:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdfaa86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506343936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772586.074882:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdfaa86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506344064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772586.074919:0:22754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772586.074931:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdda0dba80 going to sleep for 11 seconds 00000100:00100000:3.0:1790772586.074941:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506344064 00000100:00100000:3.0:1790772586.074944:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506344064 00000100:00100000:3.0:1790772586.074960:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1790772586.074965:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:22754:x1877760506344064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772586.075033:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:22754:x1877760506344064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772586.075039:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1790772586.075084:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdfaa86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506344064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790772586.075865:0:25797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1790772586.075919:0:22754:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1790772586.075937:0:22754:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790772586.075946:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdff438600/0x418ffb1c3bcc9a4b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9a52 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.075968:0:22754:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9ecdff438600/0x418ffb1c3bcc9a4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9a52 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772586.075977:0:22754:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790772586.075980:0:22754:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ecdfbb15000 from 13 10000000:01000000:3.0:1790772586.075983:0:22754:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790772586.076003:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8e00/0x418ffb1c3bcc9a59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.076011:0:22754:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8e00/0x418ffb1c3bcc9a59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.076020:0:22754:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8e00/0x418ffb1c3bcc9a59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772586.076035:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdfaa86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506344192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790772586.076067:0:22754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772586.076081:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdda0dba80 going to sleep for 11 seconds 00000100:00100000:3.0:1790772586.076096:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506344192 00000100:00100000:3.0:1790772586.076099:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506344192 00000100:00100000:3.0:1790772586.076126:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1790772586.076132:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+21:22754:x1877760506344192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772586.076141:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772586.076152:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ecdf4bd9c00/0x418ffb1c3bcc9a60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x418ffb1c3bcc9a59 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.076189:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ecdf4bd9c00/0x418ffb1c3bcc9a60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9a59 expref: 22 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.076210:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ecdf4bd9c00/0x418ffb1c3bcc9a60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9a59 expref: 22 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.076218:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdf4bd9c00, rc 0) 00000100:00100000:3.0:1790772586.076247:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+22:22754:x1877760506344192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772586.076253:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1790772586.076288:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdfaa86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506344192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772586.076301:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8e00/0x418ffb1c3bcc9a59 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9a60 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.076308:0:22754:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8e00/0x418ffb1c3bcc9a59 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc9a60 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772586.076350:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdfaa86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506344320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772586.076414:0:22754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772586.076428:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc810e840 going to sleep for 11 seconds 00000100:00100000:3.0:1790772586.076439:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506344320 00000100:00100000:3.0:1790772586.076442:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506344320 00000100:00100000:3.0:1790772586.076463:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790772586.076469:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+22:22754:x1877760506344320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772586.076548:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+22:22754:x1877760506344320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 79us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772586.076555:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790772586.076594:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdfaa86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506344320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772586.076624:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdfaa86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506344448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772586.076653:0:22754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772586.076664:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc810e840 going to sleep for 11 seconds 00000100:00100000:3.0:1790772586.076674:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506344448 00000100:00100000:3.0:1790772586.076676:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506344448 00000100:00100000:3.0:1790772586.076692:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790772586.076697:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+22:22754:x1877760506344448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772586.076754:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+22:22754:x1877760506344448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 56us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772586.076760:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790772586.076790:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdfaa86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506344448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790772586.087119:0:25798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1790772586.087475:0:22754:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1790772586.087497:0:22754:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790772586.087508:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8e00/0x418ffb1c3bcc9a59 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9a60 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.087530:0:22754:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9ecdf4bd8e00/0x418ffb1c3bcc9a59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9a60 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772586.087541:0:22754:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790772586.087543:0:22754:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ecde1727000 from 13 10000000:01000000:1.0:1790772586.087546:0:22754:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790772586.087589:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdff439400/0x418ffb1c3bcc9a67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.087597:0:22754:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9ecdff439400/0x418ffb1c3bcc9a67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.087607:0:22754:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9ecdff439400/0x418ffb1c3bcc9a67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772586.087628:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf6042a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506344576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790772586.087684:0:22754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772586.087723:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc3ccacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772586.087941:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506344576 00000100:00100000:2.0:1790772586.087948:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506344576 00000100:00100000:2.0:1790772586.087992:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1790772586.088000:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+22:22754:x1877760506344576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790772586.088012:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772586.088023:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eccc3560a00/0x418ffb1c3bcc9a6e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x418ffb1c3bcc9a67 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.088043:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eccc3560a00/0x418ffb1c3bcc9a6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9a67 expref: 23 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.088053:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eccc3560a00/0x418ffb1c3bcc9a6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9a67 expref: 23 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.088652:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eccc3560a00, rc 0) 00000100:00100000:2.0:1790772586.088706:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+23:22754:x1877760506344576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 706us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772586.088714:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1790772586.088841:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf6042a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506344576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790772586.088856:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9ecdff439400/0x418ffb1c3bcc9a67 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9a6e expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.088866:0:22754:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9ecdff439400/0x418ffb1c3bcc9a67 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc9a6e expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772586.088933:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf75b0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506344704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772586.088959:0:22754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772586.088988:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc69b7780 going to sleep for 11 seconds 00000100:00100000:1.0:1790772586.089436:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506344704 00000100:00100000:1.0:1790772586.089442:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506344704 00000100:00100000:1.0:1790772586.089485:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1790772586.089492:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+23:22754:x1877760506344704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790772586.089605:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+23:22754:x1877760506344704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772586.089612:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1790772586.090013:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf75b0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506344704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772586.090044:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf75b0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506344832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790772586.090126:0:22754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772586.090153:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc69b7780 going to sleep for 11 seconds 00000100:00100000:1.0:1790772586.090429:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506344832 00000100:00100000:1.0:1790772586.090434:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506344832 00000100:00100000:1.0:1790772586.090461:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1790772586.090483:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+23:22754:x1877760506344832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790772586.090561:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+23:22754:x1877760506344832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772586.090568:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1790772586.090691:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf75b0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506344832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790772586.094035:0:25799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000100:00100000:2.0:1790772586.094660:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000020:01000000:1.0:1790772586.094736:0:22754:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1790772586.094762:0:22754:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790772586.094774:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdff439400/0x418ffb1c3bcc9a67 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9a6e expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.094785:0:22754:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9ecdff439400/0x418ffb1c3bcc9a67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9a6e expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772586.094796:0:22754:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790772586.094799:0:22754:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ecdfb45f000 from 13 10000000:01000000:1.0:1790772586.094802:0:22754:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790772586.094835:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdff439800/0x418ffb1c3bcc9a75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.094844:0:22754:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9ecdff439800/0x418ffb1c3bcc9a75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.094855:0:22754:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9ecdff439800/0x418ffb1c3bcc9a75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772586.094890:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf6040a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506344960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790772586.094937:0:22754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772586.094978:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc3ccaa80 going to sleep for 11 seconds 00000100:00100000:2.0:1790772586.095358:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506344960 00000100:00100000:2.0:1790772586.095366:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506344960 00000100:00100000:2.0:1790772586.095418:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1790772586.095427:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+23:22754:x1877760506344960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790772586.095440:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772586.095453:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eccc3561800/0x418ffb1c3bcc9a7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x418ffb1c3bcc9a75 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.095652:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eccc3561800/0x418ffb1c3bcc9a7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9a75 expref: 24 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.095675:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eccc3561800/0x418ffb1c3bcc9a7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x418ffb1c3bcc9a75 expref: 24 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.095684:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eccc3561800, rc 0) 00000100:00100000:2.0:1790772586.095737:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+24:22754:x1877760506344960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 312us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772586.095744:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1790772586.095847:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf6040a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506344960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772586.095916:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9ecdff439800/0x418ffb1c3bcc9a75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9a7c expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.095931:0:22754:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9ecdff439800/0x418ffb1c3bcc9a75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x418ffb1c3bcc9a7c expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772586.096076:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdfaa86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506345088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772586.096288:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481060096 00000100:00100000:0.0:1790772586.096295:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481060096 00000100:00100000:0.0:1790772586.096701:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 25 00000100:00100000:0.0:1790772586.096711:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc8840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+9:18651:x1877760481060096:12345-192.168.206.14@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1790772586.096729:0:22754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772586.096814:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc8840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+9:18651:x1877760481060096:12345-192.168.206.14@tcp:59:lhsmtool_posix.0 Request processed in 102us (2156us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772586.096823:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 25 00000100:00100000:3.0:1790772586.096860:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc84a9540 going to sleep for 11 seconds 00000100:00100000:2.0:1790772586.098556:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506345088 00000100:00100000:2.0:1790772586.098587:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506345088 00000100:00100000:3.0:1790772586.101097:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1790772586.101112:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+24:22754:x1877760506345088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772586.101382:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+24:22754:x1877760506345088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 272us (4803us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772586.101413:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1790772586.101504:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdfaa86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506345088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772586.101597:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdfaa86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506345216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772586.101664:0:22754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772586.101697:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdc84a9540 going to sleep for 11 seconds 00000100:00100000:3.0:1790772586.102356:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506345216 00000100:00100000:3.0:1790772586.102366:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506345216 00000100:00100000:3.0:1790772586.102410:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1790772586.102418:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+24:22754:x1877760506345216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772586.103409:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a371a4ff-c27a-4b58-b24c-92c8783ef87a+24:22754:x1877760506345216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 987us (1741us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772586.103421:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1790772586.103556:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdfaa86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a371a4ff-c27a-4b58-b24c-92c8783ef87a:22754:1877760506345216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772586.106497:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772586.106626:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481060224 00000100:00100000:1.0:1790772586.106637:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481060224 00000100:00100000:1.0:1790772586.106742:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 26 00000100:00100000:1.0:1790772586.106754:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfaa87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+5:18651:x1877760481060224:12345-192.168.206.14@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1790772586.107520:0:22757:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 698us 00000100:00080000:3.0:1790772586.110435:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:2.0:1790772586.113913:0:25800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1790772586.114227:0:22754:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1790772586.114266:0:22754:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790772586.114282:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9ecdff439800/0x418ffb1c3bcc9a75 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9a7c expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.114297:0:22754:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9ecdff439800/0x418ffb1c3bcc9a75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x418ffb1c3bcc9a7c expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772586.131673:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772586.131722:0:22756:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1790772586.131734:0:22756:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1790772586.131870:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481060352 00000100:00100000:3.0:1790772586.131882:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481060352 00000100:00100000:3.0:1790772586.132097:0:25802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 27 00000100:00100000:3.0:1790772586.132109:0:25802:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfaa84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f9f6919-1501-400a-bf51-76bbebf8064d+9:18657:x1877760481060352:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:3.0:1790772586.132135:0:25802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772586.132159:0:25802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd8200/0x418ffb1c3bcc9a83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42c6e08168753af9 expref: -99 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.132258:0:25802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc9a8a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.132277:0:25802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc9a8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.132292:0:25802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc9a8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.132707:0:25802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9200/0x418ffb1c3bcc9a91 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.132736:0:25802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9200/0x418ffb1c3bcc9a91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.132749:0:25802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9200/0x418ffb1c3bcc9a91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.132875:0:25802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc9a8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.132883:0:25802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc9a8a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.132890:0:25802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc9a8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.132912:0:25802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf4bd9e00 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:3.0:1790772586.132917:0:25802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc9a8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.132924:0:25802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc9a8a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.132935:0:25802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eccc3658000) 00010000:00010000:3.0:1790772586.132939:0:25802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772586.132943:0:25802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc9a8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.132950:0:25802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc9a8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.132964:0:25802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9200/0x418ffb1c3bcc9a91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.132971:0:25802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9200/0x418ffb1c3bcc9a91 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.133050:0:25802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9200/0x418ffb1c3bcc9a91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.133057:0:25802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf4bd9200 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:3.0:1790772586.133061:0:25802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9200/0x418ffb1c3bcc9a91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.133068:0:25802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9200/0x418ffb1c3bcc9a91 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.133087:0:25802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9ecde3aa4c00) 00010000:00010000:3.0:1790772586.133089:0:25802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772586.133092:0:25802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9200/0x418ffb1c3bcc9a91 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.133098:0:25802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9200/0x418ffb1c3bcc9a91 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.133140:0:25802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd8200/0x418ffb1c3bcc9a83 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753af9 expref: 10 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.133150:0:25802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eccc3658000) 00010000:00010000:3.0:1790772586.133152:0:25802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772586.133155:0:25802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd8200/0x418ffb1c3bcc9a83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753af9 expref: 10 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.133192:0:25802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdf4bd8200, rc 0) 00000100:00100000:3.0:1790772586.133264:0:25802:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfaa84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f9f6919-1501-400a-bf51-76bbebf8064d+9:18657:x1877760481060352:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 1156us (1605us total) trans 0 rc 301/301 00000100:00100000:3.0:1790772586.133273:0:25802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 27 00000100:00100000:2.0:1790772586.157054:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfaa87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+5:18651:x1877760481060224:12345-192.168.206.14@tcp:59:lhsmtool_posix.0 Request processed in 50294us (50559us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772586.157068:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 26 00000100:00100000:3.0:1790772586.158384:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772586.161985:0:22765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481060480 00000100:00100000:1.0:1790772586.162017:0:22765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481060480 00000100:00100000:1.0:1790772586.162106:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 0 00000100:00100000:1.0:1790772586.162120:0:22765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfaa84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4f9f6919-1501-400a-bf51-76bbebf8064d+9:18657:x1877760481060480:12345-192.168.206.14@tcp:700:lfs.0 00000100:00100000:1.0:1790772586.162264:0:22765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfaa84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4f9f6919-1501-400a-bf51-76bbebf8064d+9:18657:x1877760481060480:12345-192.168.206.14@tcp:700:lfs.0 Request processed in 148us (3883us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772586.162272:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 0 00000100:00100000:1.0:1790772586.190746:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772586.190788:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772586.190856:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481060864 00000100:00100000:3.0:1790772586.190866:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481060864 00000100:00100000:3.0:1790772586.190928:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 28 00000100:00100000:3.0:1790772586.190937:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf6043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+9:18657:x1877760481060864:12345-192.168.206.14@tcp:36:lfs.0 00010000:00010000:3.0:1790772586.191000:0:22756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772586.191024:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013400/0x418ffb1c3bcc99bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753a74 expref: 9 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.191053:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eccc3658000) 00010000:00010000:3.0:1790772586.191058:0:22756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790772586.191107:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd8200/0x418ffb1c3bcc9a98 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.191130:0:22756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc99fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753ae4 expref: 5 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.191140:0:22756:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd8200/0x418ffb1c3bcc9a98 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.191199:0:22756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc99fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753ae4 expref: 5 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.191214:0:22756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc99fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753ae4 expref: 5 pid: 22757 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772586.191229:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdfaa86680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22756:1877760506345344:192.168.206.14@tcp:104: 00000100:00100000:3.0:1790772586.191297:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdd9b80240 going to sleep for 11 seconds 00000100:00100000:2.0:1790772586.195273:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481060608 00000100:00100000:2.0:1790772586.195287:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481060608 00000100:00100000:2.0:1790772586.195353:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 161 00000100:00100000:2.0:1790772586.195362:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddb76036-7f3a-437f-b993-ff4cd941bf15+11:18033:x1877760481060608:12345-192.168.206.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790772586.195378:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772586.195395:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eccc3560800/0x418ffb1c3bcc9a9f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x42c6e08168753b00 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.195421:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eccc3560800/0x418ffb1c3bcc9a9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b00 expref: 12 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.195432:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eccc3560800/0x418ffb1c3bcc9a9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b00 expref: 12 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.195451:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eccc3560800, rc 0) 00000100:00100000:2.0:1790772586.195511:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddb76036-7f3a-437f-b993-ff4cd941bf15+12:18033:x1877760481060608:12345-192.168.206.14@tcp:101:ll_cfg_requeue.0 Request processed in 150us (4774us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772586.195518:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 161 00000100:00100000:3.0:1790772586.197187:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdfaa86680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22756:1877760506345344:192.168.206.14@tcp:104: 00010000:00010000:3.0:1790772586.197212:0:22756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd8200/0x418ffb1c3bcc9a98 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772586.198671:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772586.198896:0:22743:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481060992 00000100:00100000:3.0:1790772586.198911:0:22743:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481060992 00010000:00010000:3.0:1790772586.198987:0:22743:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc99fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753ae4 expref: 6 pid: 22757 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772586.199075:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 15 00000100:00100000:3.0:1790772586.199086:0:22743:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf6043800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+6:2393:x1877760481060992:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772586.199106:0:22743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772586.199115:0:22743:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc99fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753ae4 expref: 6 pid: 22757 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1790772586.199124:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790772586.199132:0:22743:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc99fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753ae4 expref: 6 pid: 22757 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.199159:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc99fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753ae4 expref: 6 pid: 22757 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.199215:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eccc3658000) 00010000:00010000:3.0:1790772586.199221:0:22743:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd8200/0x418ffb1c3bcc9a98 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.199233:0:22743:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd8200/0x418ffb1c3bcc9a98 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.199241:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd8200/0x418ffb1c3bcc9a98 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.199277:0:22743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772586.199352:0:22743:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf6043800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+5:2393:x1877760481060992:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 267us (684us total) trans 0 rc 0/0 00010000:00010000:0.0:1790772586.199357:0:22756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd8200/0x418ffb1c3bcc9a98 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772586.199363:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 15 00010000:00010000:0.0:1790772586.199380:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd8200/0x418ffb1c3bcc9a98 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.199409:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9aa6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.199422:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9aa6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.199433:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9aa6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.203452:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013600/0x418ffb1c3bcc9aad lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.203480:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013600/0x418ffb1c3bcc9aad lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.203490:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013600/0x418ffb1c3bcc9aad lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790772586.203506:0:22756:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c6715513 reply state 00000000dea4065b transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013600/0x418ffb1c3bcc9aad lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.203517:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013600/0x418ffb1c3bcc9aad lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.203524:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9eccc3658e00) 00010000:00010000:0.0:1790772586.203527:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790772586.203530:0:22756:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790772586.203541:0:22756:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1790772586.203549:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd8200/0x418ffb1c3bcc9a98 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.203555:0:22756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd8200/0x418ffb1c3bcc9a98 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.203563:0:22756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd8200/0x418ffb1c3bcc9a98 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.203568:0:22756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf4bd8200 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:0.0:1790772586.203572:0:22756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd8200/0x418ffb1c3bcc9a98 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.203589:0:22756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd8200/0x418ffb1c3bcc9a98 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.203600:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eccc3658000) 00010000:00010000:0.0:1790772586.203602:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772586.203606:0:22756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd8200/0x418ffb1c3bcc9a98 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.203612:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd8200/0x418ffb1c3bcc9a98 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790772586.203631:0:22756:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c6715513 reply state 00000000dea4065b transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9aa6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.203639:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9aa6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.203645:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9eccc3658500) 00010000:00010000:0.0:1790772586.203647:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790772586.203654:0:22756:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1790772586.203732:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf6043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+10:18657:x1877760481060864:12345-192.168.206.14@tcp:36:lfs.0 Request processed in 12792us (12939us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1790772586.203740:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 28 00000100:00100000:1.0:1790772586.204790:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772586.205262:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481061120 00000100:00100000:3.0:1790772586.205283:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481061120 00000100:00100000:3.0:1790772586.205331:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 162 00000100:00100000:3.0:1790772586.205352:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddb76036-7f3a-437f-b993-ff4cd941bf15+12:18033:x1877760481061120:12345-192.168.206.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772586.205481:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddb76036-7f3a-437f-b993-ff4cd941bf15+12:18033:x1877760481061120:12345-192.168.206.14@tcp:501:ll_cfg_requeue.0 Request processed in 130us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772586.205490:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 162 00000100:00100000:1.0:1790772586.212531:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772586.212651:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481061248 00000100:00100000:3.0:1790772586.212660:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481061248 00000100:00100000:3.0:1790772586.212714:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 163 00000100:00100000:3.0:1790772586.212722:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddb76036-7f3a-437f-b993-ff4cd941bf15+12:18033:x1877760481061248:12345-192.168.206.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772586.212844:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddb76036-7f3a-437f-b993-ff4cd941bf15+12:18033:x1877760481061248:12345-192.168.206.14@tcp:503:ll_cfg_requeue.0 Request processed in 123us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772586.212851:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 163 00000100:00100000:1.0:1790772586.231776:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772586.254334:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481061376 00000100:00100000:3.0:1790772586.255856:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481061376 00000100:00100000:2.0:1790772586.256390:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 164 00000100:00100000:2.0:1790772586.256400:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddb76036-7f3a-437f-b993-ff4cd941bf15+12:18033:x1877760481061376:12345-192.168.206.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790772586.256415:0:22749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772586.256431:0:22749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eccc3560e00/0x418ffb1c3bcc9ab4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x42c6e08168753b07 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.256458:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eccc3560e00/0x418ffb1c3bcc9ab4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b07 expref: 13 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.256477:0:22749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eccc3560e00/0x418ffb1c3bcc9ab4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b07 expref: 13 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.256487:0:22749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eccc3560e00, rc 0) 00000100:00100000:2.0:1790772586.256547:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddb76036-7f3a-437f-b993-ff4cd941bf15+13:18033:x1877760481061376:12345-192.168.206.14@tcp:101:ll_cfg_requeue.0 Request processed in 148us (24780us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772586.256554:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 164 00000100:00100000:1.0:1790772586.261411:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772586.261805:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481061504 00000100:00100000:2.0:1790772586.261814:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481061504 00000100:00100000:2.0:1790772586.261865:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 165 00000100:00100000:2.0:1790772586.261881:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf120e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddb76036-7f3a-437f-b993-ff4cd941bf15+13:18033:x1877760481061504:12345-192.168.206.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790772586.262019:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf120e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddb76036-7f3a-437f-b993-ff4cd941bf15+13:18033:x1877760481061504:12345-192.168.206.14@tcp:501:ll_cfg_requeue.0 Request processed in 139us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772586.262037:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 165 00000100:00100000:1.0:1790772586.265811:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772586.265889:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481061632 00000100:00100000:3.0:1790772586.265898:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481061632 00000100:00100000:3.0:1790772586.266243:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 166 00000100:00100000:3.0:1790772586.266253:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddb76036-7f3a-437f-b993-ff4cd941bf15+13:18033:x1877760481061632:12345-192.168.206.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772586.266394:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddb76036-7f3a-437f-b993-ff4cd941bf15+13:18033:x1877760481061632:12345-192.168.206.14@tcp:503:ll_cfg_requeue.0 Request processed in 142us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772586.266402:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 166 00000100:00100000:1.0:1790772586.352375:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772586.352412:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772586.352440:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772586.352478:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772586.352503:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772586.352520:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772586.352564:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772586.352601:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772586.352619:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772586.352644:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481062016 00000100:00100000:1.0:1790772586.352653:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481062016 00000100:00100000:1.0:1790772586.352696:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481062528 00000100:00100000:1.0:1790772586.352699:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481062528 00000100:00100000:1.0:1790772586.352723:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481061888 00000100:00100000:1.0:1790772586.352726:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481061888 00000100:00100000:1.0:1790772586.352737:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481062400 00000100:00100000:1.0:1790772586.352740:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481062400 00000100:00100000:1.0:1790772586.352755:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 59 00000100:00100000:1.0:1790772586.352764:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf6040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+5:2391:x1877760481062016:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1790772586.352828:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf6040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+5:2391:x1877760481062016:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 65us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772586.352836:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 59 00000100:00100000:1.0:1790772586.352852:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 60 00000100:00100000:1.0:1790772586.352858:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf6042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+5:2391:x1877760481062528:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1790772586.352882:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf6042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+5:2391:x1877760481062528:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 25us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772586.352888:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 60 00000100:00100000:1.0:1790772586.352899:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 61 00000100:00100000:1.0:1790772586.352904:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf6040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+10:2391:x1877760481061888:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1790772586.352926:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf6040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+10:2391:x1877760481061888:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 22us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772586.352931:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 61 00000100:00100000:1.0:1790772586.352940:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 62 00000100:00100000:1.0:1790772586.352951:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf758d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+5:2391:x1877760481062400:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1790772586.352971:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf758d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+5:2391:x1877760481062400:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 21us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772586.352976:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 62 00000100:00100000:1.0:1790772586.352992:0:24262:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481062272 00000100:00100000:1.0:1790772586.352995:0:24262:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481062272 00000100:00100000:1.0:1790772586.353011:0:24262:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481062784 00000100:00100000:1.0:1790772586.353013:0:24262:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481062784 00000100:00100000:1.0:1790772586.353021:0:24262:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481062144 00000100:00100000:1.0:1790772586.353023:0:24262:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481062144 00000100:00100000:1.0:1790772586.353031:0:24262:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481062656 00000100:00100000:1.0:1790772586.353033:0:24262:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481062656 00000100:00100000:1.0:1790772586.353043:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 17 00000100:00100000:1.0:1790772586.353048:0:24262:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf6042a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+5:2391:x1877760481062272:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1790772586.353069:0:24262:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf6042a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+5:2391:x1877760481062272:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 21us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772586.353075:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 17 00000100:00100000:1.0:1790772586.353084:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 18 00000100:00100000:1.0:1790772586.353088:0:24262:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc6f28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+5:2391:x1877760481062784:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1790772586.353104:0:24262:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc6f28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+5:2391:x1877760481062784:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 16us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772586.353110:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 18 00000100:00100000:0.0:1790772586.353406:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 19 00000100:00100000:0.0:1790772586.353416:0:24264:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf758c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+5:2391:x1877760481062144:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:0.0:1790772586.353442:0:24264:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf758c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+5:2391:x1877760481062144:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 29us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772586.353448:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 19 00000100:00100000:2.0:1790772586.353661:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 20 00000100:00100000:2.0:1790772586.353670:0:24263:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf758f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+5:2391:x1877760481062656:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:2.0:1790772586.353695:0:24263:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf758f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+5:2391:x1877760481062656:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 28us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772586.353701:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 20 00000100:00100000:3.0:1790772586.353952:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481061760 00000100:00100000:3.0:1790772586.353957:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481061760 00000100:00100000:3.0:1790772586.353986:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 167 00000100:00100000:3.0:1790772586.353992:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddb76036-7f3a-437f-b993-ff4cd941bf15+13:2391:x1877760481061760:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1790772586.354031:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddb76036-7f3a-437f-b993-ff4cd941bf15+13:2391:x1877760481061760:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 39us (1664us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772586.354038:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 167 00000100:00080000:3.0:1790772586.354077:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790772586.354082:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790772586.354085:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790772586.411309:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772586.411408:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481062912 00000100:00100000:2.0:1790772586.411416:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481062912 00000100:00100000:2.0:1790772586.411479:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 29 00000100:00100000:2.0:1790772586.411489:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf758e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+10:18667:x1877760481062912:12345-192.168.206.14@tcp:101:lctl.0 00010000:00010000:2.0:1790772586.411508:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772586.411532:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9abb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42c6e08168753b0e expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.411601:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561c00/0x418ffb1c3bcc9ac2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.411615:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561c00/0x418ffb1c3bcc9ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.411625:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561c00/0x418ffb1c3bcc9ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772586.411664:0:22757:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790772586.411667:0:22757:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790772586.411700:0:22757:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561c00/0x418ffb1c3bcc9ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.411738:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9abb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b0e expref: 12 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.411755:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561c00/0x418ffb1c3bcc9ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b0e expref: 11 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.411763:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eccc23b2d00) 00010000:00010000:2.0:1790772586.411766:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790772586.411769:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eccc3561c00, rc 0) 00000100:00100000:2.0:1790772586.411829:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf758e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+11:18667:x1877760481062912:12345-192.168.206.14@tcp:101:lctl.0 Request processed in 342us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772586.411836:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 29 00000100:00100000:3.0:1790772586.466140:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1790772586.466427:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481063040 00000100:00100000:0.0:1790772586.466440:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481063040 00000100:00100000:0.0:1790772586.466517:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 30 00000100:00100000:0.0:1790772586.466528:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfaa86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+5:18668:x1877760481063040:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:0.0:1790772586.466556:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772586.466592:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013000/0x418ffb1c3bcc9ac9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42c6e08168753b15 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.466675:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012400/0x418ffb1c3bcc9ad0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.466694:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012400/0x418ffb1c3bcc9ad0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.466708:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012400/0x418ffb1c3bcc9ad0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772586.466765:0:22758:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790772586.466770:0:22758:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790772586.466796:0:22758:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012400/0x418ffb1c3bcc9ad0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.466856:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013000/0x418ffb1c3bcc9ac9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b15 expref: 7 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.466877:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012400/0x418ffb1c3bcc9ad0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b15 expref: 6 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.466885:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eccc23b2d00) 00010000:00010000:0.0:1790772586.466888:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790772586.466892:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdf5012400, rc 0) 00000100:00100000:0.0:1790772586.466970:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfaa86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+6:18668:x1877760481063040:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 444us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772586.466979:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 30 00000100:00100000:1.0:1790772586.479715:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772586.479914:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481063168 00000100:00100000:2.0:1790772586.479927:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481063168 00000100:00100000:2.0:1790772586.480050:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 31 00000100:00100000:2.0:1790772586.480069:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf758ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+6:18668:x1877760481063168:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:2.0:1790772586.480095:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772586.480118:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9ad7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42c6e08168753b1c expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.480245:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9ade lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.480261:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9ade lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.480273:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9ade lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.480312:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561200/0x418ffb1c3bcc9ae5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.480320:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561200/0x418ffb1c3bcc9ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.480327:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561200/0x418ffb1c3bcc9ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.480425:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561e00/0x418ffb1c3bcc9aec lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.480434:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561e00/0x418ffb1c3bcc9aec lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.480440:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561e00/0x418ffb1c3bcc9aec lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772586.480491:0:22757:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790772586.480495:0:22757:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790772586.480520:0:22757:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561e00/0x418ffb1c3bcc9aec lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.480534:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9ade lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.480543:0:22757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9ade lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.480551:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9ade lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.480568:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc3560200 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:2.0:1790772586.480587:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9ade lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.480597:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9ade lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.480612:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eccc23b2d00) 00010000:00010000:2.0:1790772586.480616:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772586.480624:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9ade lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.480630:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9ade lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.480647:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561200/0x418ffb1c3bcc9ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.480653:0:22757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561200/0x418ffb1c3bcc9ae5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.480659:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561200/0x418ffb1c3bcc9ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.480664:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc3561200 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:2.0:1790772586.480667:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561200/0x418ffb1c3bcc9ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.480674:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561200/0x418ffb1c3bcc9ae5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.480694:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9eccc3658500) 00010000:00010000:2.0:1790772586.480696:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772586.480699:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561200/0x418ffb1c3bcc9ae5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.480706:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561200/0x418ffb1c3bcc9ae5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.480738:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9ad7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b1c expref: 8 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.480750:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561e00/0x418ffb1c3bcc9aec lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b1c expref: 7 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.480758:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9eccc3658e00) 00010000:00010000:2.0:1790772586.480761:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790772586.480764:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eccc3561e00, rc 0) 00000100:00100000:2.0:1790772586.480849:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf758ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+7:18668:x1877760481063168:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 789us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772586.480855:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 31 00000100:00100000:1.0:1790772586.491029:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772586.491339:0:22768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481063296 00000100:00100000:3.0:1790772586.491352:0:22768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481063296 00000100:00100000:3.0:1790772586.491418:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 6 00000100:00100000:3.0:1790772586.491430:0:22768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf758ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+5:18668:x1877760481063296:12345-192.168.206.14@tcp:900:lfs.0 00000100:00100000:3.0:1790772586.495616:0:22768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf758ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+5:18668:x1877760481063296:12345-192.168.206.14@tcp:900:lfs.0 Request processed in 4169us (4582us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772586.495647:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 6 00000100:00100000:3.0:1790772586.502545:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1790772586.507551:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481063552 00000100:00100000:0.0:1790772586.507583:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481063552 00000100:00100000:1.0:1790772586.512367:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 32 00000100:00100000:1.0:1790772586.512401:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfaa86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+7:18668:x1877760481063552:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:1.0:1790772586.512915:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772586.512948:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439e00/0x418ffb1c3bcc9af3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42c6e08168753b23 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772586.514426:0:22758:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1790772586.514588:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439e00/0x418ffb1c3bcc9af3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b23 expref: 9 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.514607:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eccc23b2d00) 00010000:00010000:1.0:1790772586.514611:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790772586.514618:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439e00/0x418ffb1c3bcc9af3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b23 expref: 9 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.514637:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdff439e00, rc 0) 00000100:00100000:1.0:1790772586.514736:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfaa86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+8:18668:x1877760481063552:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 2340us (12313us total) trans 12884901891 rc 301/301 00000100:00100000:1.0:1790772586.514746:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 32 00000100:00100000:1.0:1790772586.519288:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1790772586.519448:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481063808 00000100:00100000:0.0:1790772586.519460:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481063808 00000100:00100000:0.0:1790772586.519530:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 33 00000100:00100000:0.0:1790772586.519541:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf758c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+8:18668:x1877760481063808:12345-192.168.206.14@tcp:36:lfs.0 00010000:00010000:0.0:1790772586.519628:0:22756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772586.519665:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561e00/0x418ffb1c3bcc9aec lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b1c expref: 8 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.519688:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9eccc3658e00) 00010000:00010000:0.0:1790772586.519694:0:22756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790772586.519722:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013000/0x418ffb1c3bcc9b01 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.519759:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013000/0x418ffb1c3bcc9b01 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.519770:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013000/0x418ffb1c3bcc9b01 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790772586.520014:0:22756:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ddb50292 reply state 000000009b703edf transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013000/0x418ffb1c3bcc9b01 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.520029:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013000/0x418ffb1c3bcc9b01 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772586.520035:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9eccc3658e00) 00010000:00010000:0.0:1790772586.520038:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1790772586.520041:0:22756:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790772586.520049:0:22756:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1790772586.520150:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf758c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+9:18668:x1877760481063808:12345-192.168.206.14@tcp:36:lfs.0 Request processed in 610us (873us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1790772586.520158:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 33 00000100:00100000:3.0:1790772586.523945:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772586.525413:0:22760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481064064 00000100:00100000:2.0:1790772586.525482:0:22760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481064064 00000100:00100000:2.0:1790772586.525606:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 2 00000100:00100000:2.0:1790772586.525629:0:22760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfaa87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+9:18668:x1877760481064064:12345-192.168.206.14@tcp:35:lfs.0 00000100:00100000:2.0:1790772586.525928:0:22760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfaa87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+10:18668:x1877760481064064:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 300us (1996us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1790772586.525937:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 2 00000100:00100000:0.0:1790772586.536680:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772586.536930:0:25802:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481064320 00000100:00100000:3.0:1790772586.536942:0:25802:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481064320 00000100:00100000:3.0:1790772586.537021:0:25802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 34 00000100:00100000:3.0:1790772586.537034:0:25802:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf75b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+10:18668:x1877760481064320:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:3.0:1790772586.537383:0:25802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772586.537412:0:25802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9200/0x418ffb1c3bcc9b08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42c6e08168753b2a expref: -99 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.537635:0:25802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc9b0f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.537665:0:25802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc9b0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.537678:0:25802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc9b0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.537691:0:25802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9800/0x418ffb1c3bcc9b16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.537698:0:25802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9800/0x418ffb1c3bcc9b16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.537704:0:25802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9800/0x418ffb1c3bcc9b16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772586.537840:0:25802:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1790772586.537937:0:25802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc9b0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.537945:0:25802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc9b0f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.537952:0:25802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc9b0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.537958:0:25802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf4bd9e00 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:3.0:1790772586.537964:0:25802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc9b0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.537972:0:25802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc9b0f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.537996:0:25802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eccc23b2d00) 00010000:00010000:3.0:1790772586.539543:0:25802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772586.539562:0:25802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc9b0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.539582:0:25802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc9b0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.539606:0:25802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9800/0x418ffb1c3bcc9b16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.539613:0:25802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9800/0x418ffb1c3bcc9b16 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.539620:0:25802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9800/0x418ffb1c3bcc9b16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.539625:0:25802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf4bd9800 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:3.0:1790772586.539630:0:25802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9800/0x418ffb1c3bcc9b16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.539638:0:25802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9800/0x418ffb1c3bcc9b16 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.539652:0:25802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9eccc3658500) 00010000:00010000:3.0:1790772586.539655:0:25802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772586.539658:0:25802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9800/0x418ffb1c3bcc9b16 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.539663:0:25802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9800/0x418ffb1c3bcc9b16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.539749:0:25802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9200/0x418ffb1c3bcc9b08 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b2a expref: 12 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.539760:0:25802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eccc23b2d00) 00010000:00010000:3.0:1790772586.539763:0:25802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790772586.539766:0:25802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9200/0x418ffb1c3bcc9b08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b2a expref: 12 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.539775:0:25802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdf4bd9200, rc 0) 00000100:00100000:3.0:1790772586.539923:0:25802:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf75b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+11:18668:x1877760481064320:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 2889us (3256us total) trans 12884901894 rc 301/301 00000100:00100000:3.0:1790772586.539934:0:25802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 34 00000100:00100000:1.0:1790772586.551094:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772586.551219:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481064448 00000100:00100000:2.0:1790772586.551232:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481064448 00000100:00100000:2.0:1790772586.551295:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 35 00000100:00100000:2.0:1790772586.551306:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf758d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+11:18668:x1877760481064448:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:2.0:1790772586.551340:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772586.551366:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9b24 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42c6e08168753b31 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.551501:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561200/0x418ffb1c3bcc9b2b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.551518:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561200/0x418ffb1c3bcc9b2b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.551530:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561200/0x418ffb1c3bcc9b2b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772586.551557:0:22757:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790772586.551560:0:22757:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790772586.551591:0:22757:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561200/0x418ffb1c3bcc9b2b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.551628:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9b24 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b31 expref: 13 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.551645:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561200/0x418ffb1c3bcc9b2b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b31 expref: 12 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.551654:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9eccc3658e00) 00010000:00010000:2.0:1790772586.551658:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790772586.551678:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eccc3561200, rc 0) 00000100:00100000:2.0:1790772586.551756:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf758d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+12:18668:x1877760481064448:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 452us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772586.551764:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 35 00000100:00100000:1.0:1790772586.556991:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772586.557392:0:22759:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481064576 00000100:00100000:3.0:1790772586.557404:0:22759:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481064576 00000100:00100000:3.0:1790772586.557484:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 3 00000100:00100000:3.0:1790772586.557496:0:22759:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf758df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+12:18668:x1877760481064576:12345-192.168.206.14@tcp:37:lfs.0 00000100:00100000:0.0:1790772586.564525:0:22759:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf758df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+12:18668:x1877760481064576:12345-192.168.206.14@tcp:37:lfs.0 Request processed in 6910us (7427us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772586.564544:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 3 00000100:00100000:1.0:1790772586.568156:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772586.568390:0:22760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481064832 00000100:00100000:2.0:1790772586.568401:0:22760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481064832 00000100:00100000:0.0:1790772586.568584:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 4 00000100:00100000:0.0:1790772586.568596:0:22760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7201850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+12:18668:x1877760481064832:12345-192.168.206.14@tcp:35:lfs.0 00000100:00100000:0.0:1790772586.568960:0:22760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7201850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+13:18668:x1877760481064832:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 363us (816us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1790772586.568990:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 4 00010000:00010000:3.0:1790772586.646154:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772586.647196:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772586.647463:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481064960 00000100:00100000:1.0:1790772586.647478:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481064960 00000100:00100000:1.0:1790772586.647545:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 36 00000100:00100000:1.0:1790772586.647555:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf75b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+11:18674:x1877760481064960:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:1.0:1790772586.647592:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772586.647643:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439000/0x418ffb1c3bcc9b32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42c6e08168753b38 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.647723:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439a00/0x418ffb1c3bcc9b39 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.647741:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439a00/0x418ffb1c3bcc9b39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.647756:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439a00/0x418ffb1c3bcc9b39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.647768:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438400/0x418ffb1c3bcc9b40 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.647776:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438400/0x418ffb1c3bcc9b40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.647783:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438400/0x418ffb1c3bcc9b40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.647885:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438a00/0x418ffb1c3bcc9b47 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.647896:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438a00/0x418ffb1c3bcc9b47 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.647904:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438a00/0x418ffb1c3bcc9b47 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772586.647943:0:22758:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790772586.647947:0:22758:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790772586.647990:0:22758:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438a00/0x418ffb1c3bcc9b47 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.648010:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439a00/0x418ffb1c3bcc9b39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.648017:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439a00/0x418ffb1c3bcc9b39 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.648025:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439a00/0x418ffb1c3bcc9b39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.648031:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdff439a00 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:1.0:1790772586.648035:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439a00/0x418ffb1c3bcc9b39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.648044:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439a00/0x418ffb1c3bcc9b39 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.648057:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eccc23b2d00) 00010000:00010000:1.0:1790772586.648059:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772586.648064:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439a00/0x418ffb1c3bcc9b39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.648072:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439a00/0x418ffb1c3bcc9b39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.648087:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438400/0x418ffb1c3bcc9b40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.648094:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438400/0x418ffb1c3bcc9b40 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.648100:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438400/0x418ffb1c3bcc9b40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.648111:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdff438400 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:1.0:1790772586.648114:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438400/0x418ffb1c3bcc9b40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.648121:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438400/0x418ffb1c3bcc9b40 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.648130:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9eccc3658500) 00010000:00010000:1.0:1790772586.648132:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772586.648134:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438400/0x418ffb1c3bcc9b40 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.648140:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438400/0x418ffb1c3bcc9b40 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.648225:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439000/0x418ffb1c3bcc9b32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b38 expref: 13 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.648241:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438a00/0x418ffb1c3bcc9b47 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b38 expref: 12 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.648249:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9eccc3658e00) 00010000:00010000:1.0:1790772586.648252:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790772586.648254:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdff438a00, rc 0) 00000100:00100000:1.0:1790772586.648334:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf75b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+12:18674:x1877760481064960:12345-192.168.206.14@tcp:101:bash.0 Request processed in 779us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772586.648342:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 36 00000100:00100000:0.0:1790772586.655490:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772586.655586:0:22767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481065088 00000100:00100000:1.0:1790772586.655631:0:22767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481065088 00000100:00100000:1.0:1790772586.655698:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 7 00000100:00100000:1.0:1790772586.655712:0:22767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf75b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4f9f6919-1501-400a-bf51-76bbebf8064d+5:18674:x1877760481065088:12345-192.168.206.14@tcp:900:bash.0 00000100:00100000:1.0:1790772586.655818:0:22767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf75b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4f9f6919-1501-400a-bf51-76bbebf8064d+5:18674:x1877760481065088:12345-192.168.206.14@tcp:900:bash.0 Request processed in 109us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772586.655826:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 7 00000100:00100000:0.0:1790772586.658329:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772586.658431:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481065344 00000100:00100000:2.0:1790772586.658441:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481065344 00000100:00100000:2.0:1790772586.658497:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 37 00000100:00100000:2.0:1790772586.658506:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf75b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+12:18674:x1877760481065344:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:2.0:1790772586.658529:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772586.658551:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9b4e lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42c6e08168753b3f expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.658696:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9b55 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.658714:0:22757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561200/0x418ffb1c3bcc9b2b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b31 expref: 12 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.658725:0:22757:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9b55 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.658764:0:22757:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561200/0x418ffb1c3bcc9b2b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b31 expref: 12 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.658779:0:22757:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561200/0x418ffb1c3bcc9b2b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b31 expref: 12 pid: 22757 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772586.658818:0:22757:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc8843b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22757:1877760506345472:192.168.206.14@tcp:104: 00000100:00100000:2.0:1790772586.658925:0:22757:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdeedeb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772586.665320:0:22757:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc8843b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22757:1877760506345472:192.168.206.14@tcp:104: 00010000:00010000:2.0:1790772586.665361:0:22757:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9b55 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772586.672566:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772586.673136:0:22741:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481065472 00000100:00100000:3.0:1790772586.673152:0:22741:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481065472 00010000:00010000:3.0:1790772586.673256:0:22741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561200/0x418ffb1c3bcc9b2b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b31 expref: 13 pid: 22757 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772586.673296:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 16 00000100:00100000:3.0:1790772586.673307:0:22741:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf75b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+13:2393:x1877760481065472:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772586.673326:0:22741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772586.673351:0:22741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561200/0x418ffb1c3bcc9b2b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b31 expref: 13 pid: 22757 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.673367:0:22741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561200/0x418ffb1c3bcc9b2b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b31 expref: 13 pid: 22757 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.673393:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561200/0x418ffb1c3bcc9b2b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b31 expref: 13 pid: 22757 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.673411:0:22741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9eccc3658e00) 00010000:00010000:3.0:1790772586.673417:0:22741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9b55 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.673595:0:22741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9b55 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.673604:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9b55 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772586.673697:0:22741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772586.673777:0:22741:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf75b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+12:2393:x1877760481065472:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 471us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772586.673785:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 16 00010000:00010000:2.0:1790772586.684834:0:22757:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9b55 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.684858:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9b55 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.685037:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560600/0x418ffb1c3bcc9b5c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.685061:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560600/0x418ffb1c3bcc9b5c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.685073:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560600/0x418ffb1c3bcc9b5c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.685533:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9b63 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.685550:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9b63 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.685558:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9b63 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772586.685594:0:22757:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790772586.685616:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9b55 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.685623:0:22757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9b55 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.685630:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9b55 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.685636:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc3560200 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:2.0:1790772586.685640:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9b55 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.685648:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9b55 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.685659:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9eccc3658e00) 00010000:00010000:2.0:1790772586.685662:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772586.685666:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9b55 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.685672:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9b55 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790772586.685685:0:22757:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000cd514ac8 reply state 00000000dbbabe35 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560600/0x418ffb1c3bcc9b5c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.685694:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560600/0x418ffb1c3bcc9b5c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.685709:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9eccc23b2000) 00010000:00010000:2.0:1790772586.685711:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790772586.685714:0:22757:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790772586.685745:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9b4e lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b3f expref: 15 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.685769:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9b63 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b3f expref: 14 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.685776:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9eccc23b2400) 00010000:00010000:2.0:1790772586.685779:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1790772586.685781:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eccc3561400, rc 0) 00000100:00100000:2.0:1790772586.685851:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf75b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+15:18674:x1877760481065344:12345-192.168.206.14@tcp:101:bash.0 Request processed in 27344us (27533us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1790772586.685859:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 37 00000100:00100000:0.0:1790772586.704955:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772586.705085:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481065600 00000100:00100000:1.0:1790772586.705098:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481065600 00000100:00100000:1.0:1790772586.705205:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 38 00000100:00100000:1.0:1790772586.705216:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf75b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+15:18674:x1877760481065600:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:1.0:1790772586.705257:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772586.705285:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439000/0x418ffb1c3bcc9b71 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42c6e08168753b46 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.705368:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438400/0x418ffb1c3bcc9b78 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.705385:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438400/0x418ffb1c3bcc9b78 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.705400:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438400/0x418ffb1c3bcc9b78 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772586.705471:0:22758:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1790772586.705475:0:22758:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790772586.705506:0:22758:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438400/0x418ffb1c3bcc9b78 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.705517:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438400/0x418ffb1c3bcc9b78 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.705560:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439000/0x418ffb1c3bcc9b71 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b46 expref: 17 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.705591:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438400/0x418ffb1c3bcc9b78 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b46 expref: 16 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.705601:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9eccc23b2400) 00010000:00010000:1.0:1790772586.705604:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790772586.705617:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdff438400, rc 0) 00000100:00100000:1.0:1790772586.705697:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf75b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+16:18674:x1877760481065600:12345-192.168.206.14@tcp:101:bash.0 Request processed in 482us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772586.705704:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 38 00000100:00100000:0.0:1790772586.716347:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772586.716917:0:22759:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481065856 00000100:00100000:3.0:1790772586.716931:0:22759:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481065856 00000100:00100000:3.0:1790772586.717055:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 5 00000100:00100000:3.0:1790772586.717076:0:22759:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf75b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+16:18674:x1877760481065856:12345-192.168.206.14@tcp:35:bash.0 00000100:00100000:3.0:1790772586.717525:0:22759:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf75b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+17:18674:x1877760481065856:12345-192.168.206.14@tcp:35:bash.0 Request processed in 451us (1191us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1790772586.717564:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 5 00000100:00100000:0.0:1790772586.815763:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772586.815874:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481066112 00000100:00100000:2.0:1790772586.815886:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481066112 00000100:00100000:2.0:1790772586.815957:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 39 00000100:00100000:2.0:1790772586.815968:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf75b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+17:18684:x1877760481066112:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:2.0:1790772586.815999:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772586.816032:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9b7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42c6e08168753b4d expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772586.816401:0:22756:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790772586.816536:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9b7f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b4d expref: 19 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.816568:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eccc23b2d00) 00010000:00010000:2.0:1790772586.816581:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790772586.816588:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9b7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b4d expref: 19 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.816603:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eccc3561000, rc 0) 00000100:00100000:2.0:1790772586.816682:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf75b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+18:18684:x1877760481066112:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 716us (934us total) trans 12884901898 rc 301/301 00000100:00100000:2.0:1790772586.816690:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 39 00000100:00100000:1.0:1790772586.820477:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1790772586.820587:0:22760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481066368 00000100:00100000:0.0:1790772586.820599:0:22760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481066368 00000100:00100000:0.0:1790772586.820670:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 6 00000100:00100000:0.0:1790772586.820682:0:22760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf758fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+18:18684:x1877760481066368:12345-192.168.206.14@tcp:35:lfs.0 00000100:00100000:0.0:1790772586.820964:0:22760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf758fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+19:18684:x1877760481066368:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 283us (502us total) trans 12884901899 rc 0/0 00000100:00100000:0.0:1790772586.820973:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 6 00000100:00100000:0.0:1790772586.874532:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772586.874645:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481066624 00000100:00100000:1.0:1790772586.874656:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481066624 00000100:00100000:1.0:1790772586.874722:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 40 00000100:00100000:1.0:1790772586.874732:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf75b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+19:18687:x1877760481066624:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:1.0:1790772586.874764:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772586.874788:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438c00/0x418ffb1c3bcc9b8d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42c6e08168753b54 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.874911:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438000/0x418ffb1c3bcc9b94 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.874927:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438000/0x418ffb1c3bcc9b94 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.874960:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438000/0x418ffb1c3bcc9b94 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772586.874973:0:22758:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1790772586.875391:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438c00/0x418ffb1c3bcc9b8d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b54 expref: 22 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.875414:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438000/0x418ffb1c3bcc9b94 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b54 expref: 21 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.875424:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9eccc23b2400) 00010000:00010000:1.0:1790772586.875427:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790772586.875430:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdff438000, rc 0) 00000100:00100000:1.0:1790772586.875547:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf75b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+21:18687:x1877760481066624:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 815us (1025us total) trans 12884901900 rc 0/0 00000100:00100000:1.0:1790772586.875554:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 40 00000100:00100000:1.0:1790772586.886829:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772586.886986:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481066752 00000100:00100000:2.0:1790772586.886999:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481066752 00000100:00100000:2.0:1790772586.887084:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 41 00000100:00100000:2.0:1790772586.887108:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf758ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+21:18687:x1877760481066752:12345-192.168.206.14@tcp:54:lfs.0 00010000:00010000:2.0:1790772586.887241:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9ba2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.887263:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9ba2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.887278:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9ba2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.887324:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9ba2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.887332:0:22757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9ba2 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.887361:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9ba2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.887368:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc3561000 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:2.0:1790772586.887373:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9ba2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.887383:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9ba2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.887398:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9eccc23b2400) 00010000:00010000:2.0:1790772586.887401:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790772586.887407:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9ba2 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772586.887414:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9ba2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772586.887532:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf758ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+21:18687:x1877760481066752:12345-192.168.206.14@tcp:54:lfs.0 Request processed in 426us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772586.887548:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 41 00000100:00100000:0.0:1790772586.890678:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772586.890850:0:22743:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481066880 00000100:00100000:1.0:1790772586.890863:0:22743:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481066880 00000100:00100000:1.0:1790772586.890943:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 0 00000100:00100000:1.0:1790772586.890954:0:22743:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf75b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+21:2393:x1877760481066880:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772586.890974:0:22743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772586.891004:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438000/0x418ffb1c3bcc9b94 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b54 expref: 21 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772586.891027:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9eccc23b2400) 00010000:00010000:1.0:1790772586.891050:0:22743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772586.891143:0:22743:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf75b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+20:2393:x1877760481066880:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 190us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772586.891151:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 0 00000100:00100000:3.0:1790772586.894080:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1790772586.894752:0:22760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481067136 00000100:00100000:0.0:1790772586.894766:0:22760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481067136 00000100:00100000:0.0:1790772586.894839:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 7 00000100:00100000:0.0:1790772586.894850:0:22760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfaa85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+20:18687:x1877760481067136:12345-192.168.206.14@tcp:35:lfs.0 00000100:00100000:0.0:1790772586.895529:0:22760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfaa85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+21:18687:x1877760481067136:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 677us (1468us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1790772586.895549:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 7 00000040:00080000:1.0:1790772586.964992:0:23514:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1790772587.093159:0:22792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790772587.206869:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772587.207077:0:25802:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481067392 00000100:00100000:3.0:1790772587.207220:0:25802:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481067392 00000100:00100000:3.0:1790772587.207304:0:25802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 42 00000100:00100000:3.0:1790772587.207316:0:25802:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf75b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f9f6919-1501-400a-bf51-76bbebf8064d+21:18718:x1877760481067392:12345-192.168.206.14@tcp:101:cat.0 00010000:00010000:3.0:1790772587.207356:0:25802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772587.207381:0:25802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9200/0x418ffb1c3bcc9ba9 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42c6e08168753b5b expref: -99 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772587.208014:0:25802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9800/0x418ffb1c3bcc9bb0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772587.208033:0:25802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9800/0x418ffb1c3bcc9bb0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772587.208047:0:25802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9800/0x418ffb1c3bcc9bb0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772587.208062:0:25802:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1790772587.208242:0:25802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9200/0x418ffb1c3bcc9ba9 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b5b expref: 24 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772587.208265:0:25802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9800/0x418ffb1c3bcc9bb0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b5b expref: 23 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772587.208275:0:25802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9eccc23b2400) 00010000:00010000:3.0:1790772587.208278:0:25802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790772587.208297:0:25802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdf4bd9800, rc 0) 00000100:00100000:3.0:1790772587.208378:0:25802:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf75b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f9f6919-1501-400a-bf51-76bbebf8064d+23:18718:x1877760481067392:12345-192.168.206.14@tcp:101:cat.0 Request processed in 1064us (1523us total) trans 12884901902 rc 0/0 00000100:00100000:3.0:1790772587.208386:0:25802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 42 00000100:00100000:1.0:1790772587.214332:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772587.214563:0:22759:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481067648 00000100:00100000:3.0:1790772587.214586:0:22759:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481067648 00000100:00100000:3.0:1790772587.214646:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 8 00000100:00100000:3.0:1790772587.214657:0:22759:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf758d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+23:18718:x1877760481067648:12345-192.168.206.14@tcp:35:cat.0 00000100:00100000:3.0:1790772587.216021:0:22759:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf758d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+24:18718:x1877760481067648:12345-192.168.206.14@tcp:35:cat.0 Request processed in 1357us (1694us total) trans 12884901903 rc 0/0 00000100:00100000:3.0:1790772587.216035:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 8 00000100:00100000:1.0:1790772587.231681:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772587.243464:0:22742:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481067776 00000100:00100000:3.0:1790772587.243486:0:22742:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481067776 00000100:00100000:2.0:1790772587.243881:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 1 00000100:00100000:2.0:1790772587.243897:0:22741:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf758f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+24:2391:x1877760481067776:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772587.243918:0:22741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772587.243950:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9800/0x418ffb1c3bcc9bb0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b5b expref: 24 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772587.243975:0:22741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9eccc23b2400) 00010000:00010000:2.0:1790772587.243996:0:22741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772587.244351:0:22741:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf758f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+23:2391:x1877760481067776:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 458us (12683us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772587.244360:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 1 00000100:00100000:0.0:1790772587.393282:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772587.393382:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481068032 00000100:00100000:2.0:1790772587.393394:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481068032 00000100:00100000:2.0:1790772587.393469:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 43 00000100:00100000:2.0:1790772587.393480:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf75b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+23:18724:x1877760481068032:12345-192.168.206.14@tcp:101:dd.0 00010000:00010000:2.0:1790772587.393512:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772587.393537:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9bbe lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42c6e08168753b62 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772587.393691:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9bc5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772587.393710:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9bc5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772587.393724:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9bc5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772587.393737:0:22757:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790772587.394021:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9bbe lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b62 expref: 26 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772587.394045:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9bc5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b62 expref: 25 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772587.394064:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9eccc23b2400) 00010000:00010000:2.0:1790772587.394086:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790772587.394091:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eccc3560200, rc 0) 00000100:00100000:2.0:1790772587.394287:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf75b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+25:18724:x1877760481068032:12345-192.168.206.14@tcp:101:dd.0 Request processed in 808us (1018us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1790772587.394294:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 43 00000100:00100000:0.0:1790772587.407290:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1790772587.407337:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772587.407429:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481068160 00000100:00100000:2.0:1790772587.407442:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481068160 00000100:00100000:2.0:1790772587.407515:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 44 00000100:00100000:2.0:1790772587.407527:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf75b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+25:18724:x1877760481068160:12345-192.168.206.14@tcp:101:dd.0 00010000:00010000:2.0:1790772587.407557:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772587.407590:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561200/0x418ffb1c3bcc9bd3 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42c6e08168753b69 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772587.407633:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561e00/0x418ffb1c3bcc9bda lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772587.407650:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561e00/0x418ffb1c3bcc9bda lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772587.407662:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561e00/0x418ffb1c3bcc9bda lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772587.407811:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561200/0x418ffb1c3bcc9bd3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b69 expref: 27 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772587.407832:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561e00/0x418ffb1c3bcc9bda lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b69 expref: 26 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772587.407841:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9eccc23b2400) 00010000:00010000:2.0:1790772587.407851:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790772587.407855:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eccc3561e00, rc 0) 00000100:00100000:2.0:1790772587.407924:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf75b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+26:18724:x1877760481068160:12345-192.168.206.14@tcp:101:dd.0 Request processed in 399us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772587.407933:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 44 00000100:00100000:3.0:1790772587.408013:0:22743:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481068288 00000100:00100000:3.0:1790772587.408018:0:22743:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481068288 00000100:00100000:3.0:1790772587.408069:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 2 00000100:00100000:3.0:1790772587.408077:0:22743:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf75b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+26:2393:x1877760481068288:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772587.408088:0:22743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772587.408104:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9bc5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b62 expref: 26 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772587.408117:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9eccc23b2400) 00010000:00010000:3.0:1790772587.408121:0:22743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772587.408147:0:22743:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf75b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+25:2393:x1877760481068288:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 71us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772587.408154:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 2 00000100:00100000:0.0:1790772587.419808:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772587.425046:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481068544 00000100:00100000:2.0:1790772587.425078:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481068544 00000100:00100000:2.0:1790772587.425195:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 45 00000100:00100000:2.0:1790772587.425207:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf75b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+25:18724:x1877760481068544:12345-192.168.206.14@tcp:36:dd.0 00010000:00010000:2.0:1790772587.425309:0:22757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772587.425342:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438400/0x418ffb1c3bcc9b78 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b46 expref: 25 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772587.425367:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9eccc23b2400) 00010000:00010000:2.0:1790772587.425373:0:22757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790772587.425596:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561200/0x418ffb1c3bcc9be1 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772587.425788:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561200/0x418ffb1c3bcc9be1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772587.425801:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561200/0x418ffb1c3bcc9be1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790772587.425931:0:22757:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:2.0:1790772587.425960:0:22757:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007cf5f98f reply state 00000000a3c14400 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561200/0x418ffb1c3bcc9be1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772587.425974:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561200/0x418ffb1c3bcc9be1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772587.425992:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9eccc23b2400) 00010000:00010000:2.0:1790772587.425995:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790772587.425999:0:22757:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790772587.426255:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf75b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+27:18724:x1877760481068544:12345-192.168.206.14@tcp:36:dd.0 Request processed in 1047us (6456us total) trans 12884901906 rc 0/0 00000100:00100000:2.0:1790772587.426264:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 45 00000020:00080000:2.0:1790772587.426269:0:22757:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790772587.498362:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772587.498537:0:22760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481068800 00000100:00100000:1.0:1790772587.498548:0:22760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481068800 00000100:00100000:1.0:1790772587.498636:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 9 00000100:00100000:1.0:1790772587.498648:0:22760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf75b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+27:18724:x1877760481068800:12345-192.168.206.14@tcp:35:dd.0 00000100:00100000:1.0:1790772587.499268:0:22760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf75b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+28:18724:x1877760481068800:12345-192.168.206.14@tcp:35:dd.0 Request processed in 621us (918us total) trans 12884901907 rc 0/0 00000100:00100000:1.0:1790772587.499277:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 9 00010000:00010000:1.0:1790772587.668495:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772587.796820:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf758ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3645:1877760506345600:0@lo:400:kworker.0 00000100:00100000:1.0:1790772587.796923:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772587.796971:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf758f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1877760506346112:0@lo:400:kworker.0 00000100:00100000:1.0:1790772587.796998:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772587.797020:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1877760506346624:0@lo:400:kworker.0 00000100:00100000:1.0:1790772587.797039:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772587.797056:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc440e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1877760506347136:0@lo:400:kworker.0 00000100:00100000:1.0:1790772587.797078:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772587.797103:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1790772587.797108:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf758c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506345728:0@lo:400:kworker.0 00000100:00100000:1.0:1790772587.797192:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772587.797213:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf758df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506346240:0@lo:400:kworker.0 00000100:00100000:1.0:1790772587.797235:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772587.797251:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc440c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1877760506346752:0@lo:400:kworker.0 00000100:00100000:1.0:1790772587.797272:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772587.797304:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf758dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1877760506345856:0@lo:400:kworker.0 00000100:00100000:1.0:1790772587.797332:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772587.797349:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506346368:0@lo:400:kworker.0 00000100:00100000:1.0:1790772587.797371:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772587.797385:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc440f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1877760506346880:0@lo:400:kworker.0 00000100:00100000:1.0:1790772587.797405:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772587.797419:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1790772587.797424:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf758e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1877760506345984:0@lo:400:kworker.0 00000100:00100000:1.0:1790772587.797445:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772587.797462:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506346496:0@lo:400:kworker.0 00000100:00100000:1.0:1790772587.797482:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772587.797499:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc440d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1877760506347008:0@lo:400:kworker.0 00000100:00100000:1.0:1790772587.797519:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772587.797546:0:22761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506345728 00000100:00100000:1.0:1790772587.797556:0:22761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506345728 00000100:00100000:1.0:1790772587.797614:0:22761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506346240 00000100:00100000:1.0:1790772587.797617:0:22761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506346240 00000100:00100000:1.0:1790772587.797631:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790772587.797640:0:22761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff7e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1877760506345728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772587.797702:0:22761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff7e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1877760506345728:12345-0@lo:400:kworker.0 Request processed in 62us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772587.797717:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790772587.797736:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790772587.797741:0:22761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff7e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506346240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772587.797767:0:22761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff7e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506346240:12345-0@lo:400:kworker.0 Request processed in 26us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772587.797773:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790772587.797793:0:24262:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506345856 00000100:00100000:1.0:1790772587.797796:0:24262:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506345856 00000100:00100000:1.0:1790772587.797823:0:24262:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506346368 00000100:00100000:1.0:1790772587.797825:0:24262:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506346368 00000100:00100000:1.0:1790772587.797834:0:24262:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506345984 00000100:00100000:1.0:1790772587.797836:0:24262:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506345984 00000100:00100000:1.0:1790772587.797848:0:24262:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506346496 00000100:00100000:1.0:1790772587.797850:0:24262:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506346496 00000100:00100000:1.0:1790772587.797863:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790772587.797868:0:24262:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1877760506345856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772587.797898:0:24262:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1877760506345856:12345-0@lo:400:kworker.0 Request processed in 30us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772587.797904:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790772587.797914:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790772587.797919:0:24262:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc12af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506346368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772587.797940:0:24262:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc12af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506346368:12345-0@lo:400:kworker.0 Request processed in 22us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772587.797945:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790772587.797953:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790772587.797957:0:24262:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc12aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1877760506345984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772587.797989:0:24262:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc12aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1877760506345984:12345-0@lo:400:kworker.0 Request processed in 31us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772587.797995:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790772587.798006:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790772587.798011:0:24262:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506346496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772587.798033:0:24262:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506346496:12345-0@lo:400:kworker.0 Request processed in 22us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772587.798038:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790772587.798076:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf758e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1877760506345984:0@lo:400:kworker.0 00000100:00100000:1.0:1790772587.798086:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506346496:0@lo:400:kworker.0 00000100:00100000:1.0:1790772587.798094:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf758dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1877760506345856:0@lo:400:kworker.0 00000100:00100000:1.0:1790772587.798102:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506346368:0@lo:400:kworker.0 00000100:00100000:1.0:1790772587.798136:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf758c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506345728:0@lo:400:kworker.0 00000100:00100000:1.0:1790772587.798145:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf758df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506346240:0@lo:400:kworker.0 00000100:00100000:1.0:1790772587.798192:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506346112 00000100:00100000:1.0:1790772587.798196:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506346112 00000100:00100000:1.0:1790772587.798216:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506346624 00000100:00100000:1.0:1790772587.798219:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506346624 00000100:00100000:1.0:1790772587.798227:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506347136 00000100:00100000:1.0:1790772587.798229:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506347136 00000100:00100000:1.0:1790772587.798240:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506346752 00000100:00100000:1.0:1790772587.798242:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506346752 00000100:00100000:1.0:1790772587.798252:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506346880 00000100:00100000:1.0:1790772587.798255:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506346880 00000100:00100000:1.0:1790772587.798266:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506347008 00000100:00100000:1.0:1790772587.798277:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506347008 00000100:00100000:1.0:1790772587.798296:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790772587.798301:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc440dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1877760506346112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772587.798336:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc440dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1877760506346112:12345-0@lo:400:kworker.0 Request processed in 35us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772587.798342:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790772587.798353:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790772587.798358:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc440e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1877760506346624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772587.798382:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc440e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1877760506346624:12345-0@lo:400:kworker.0 Request processed in 25us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772587.798387:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790772587.798396:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790772587.798400:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff7e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1877760506347136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772587.798423:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff7e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1877760506347136:12345-0@lo:400:kworker.0 Request processed in 22us (1344us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772587.798428:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790772587.798437:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790772587.798442:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1877760506346752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772587.798464:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1877760506346752:12345-0@lo:400:kworker.0 Request processed in 22us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772587.798469:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790772587.798480:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790772587.798484:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc12ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877760506346880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772587.798512:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc12ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877760506346880:12345-0@lo:400:kworker.0 Request processed in 28us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772587.798526:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790772587.798537:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790772587.798543:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1877760506347008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772587.798586:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1877760506347008:12345-0@lo:400:kworker.0 Request processed in 44us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772587.798592:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790772587.798618:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc440d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1877760506347008:0@lo:400:kworker.0 00010000:00080000:1.0:1790772587.798631:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9eccc440f100 x1877760506346880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772587.798642:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc440f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1877760506346880:0@lo:400:kworker.0 00000100:00100000:1.0:1790772587.798669:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc440c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1877760506346752:0@lo:400:kworker.0 00000100:00100000:1.0:1790772587.798679:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf758f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1877760506346112:0@lo:400:kworker.0 00000100:00100000:1.0:1790772587.798688:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1877760506346624:0@lo:400:kworker.0 00010000:00080000:1.0:1790772587.798697:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9eccc440e300 x1877760506347136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772587.798706:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc440e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1877760506347136:0@lo:400:kworker.0 00000100:00100000:0.0:1790772587.798962:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790772587.798974:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf62e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506347264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790772587.799031:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772587.799067:0:24267:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506347264 00000100:00100000:0.0:1790772587.799072:0:24267:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506347264 00000100:00100000:0.0:1790772587.799102:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790772587.799109:0:24267:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1877760506347264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790772587.799148:0:24267:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790772587.799209:0:24267:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1877760506347264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772587.799215:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790772587.799251:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf62e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506347264:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1790772587.799391:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790772587.799403:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790772587.799406:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790772587.799408:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790772587.799734:0:22751:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506345600 00000100:00100000:2.0:1790772587.799739:0:22751:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506345600 00000100:00100000:2.0:1790772587.799769:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1790772587.799776:0:22751:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+24:3645:x1877760506345600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772587.799831:0:22751:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a371a4ff-c27a-4b58-b24c-92c8783ef87a+24:3645:x1877760506345600:12345-0@lo:400:kworker.0 Request processed in 56us (2908us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772587.799837:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1790772587.799960:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790772587.799973:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc8843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1877760506347392:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790772587.800004:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772587.800640:0:24267:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506347392 00000100:00100000:2.0:1790772587.800648:0:24267:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506347392 00000100:00100000:2.0:1790772587.800696:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790772587.800704:0:24267:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfaa86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877760506347392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790772587.800722:0:24267:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790772587.800775:0:24267:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfaa86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877760506347392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772587.800782:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790772587.800980:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc8843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1877760506347392:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790772587.802652:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf758ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3645:1877760506345600:0@lo:400:kworker.0 00000100:00100000:1.0:1790772587.877676:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1790772587.877790:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481068928 00000100:00100000:0.0:1790772587.877804:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481068928 00000100:00100000:0.0:1790772587.877884:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 46 00000100:00100000:0.0:1790772587.877895:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdff730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+28:18738:x1877760481068928:12345-192.168.206.14@tcp:101:stat.0 00010000:00010000:0.0:1790772587.877927:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772587.877951:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013200/0x418ffb1c3bcc9be8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42c6e08168753b70 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772587.878060:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012c00/0x418ffb1c3bcc9bef lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772587.878078:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012c00/0x418ffb1c3bcc9bef lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772587.878094:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012c00/0x418ffb1c3bcc9bef lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772587.878107:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012200/0x418ffb1c3bcc9bf6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772587.878115:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012200/0x418ffb1c3bcc9bf6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772587.878122:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012200/0x418ffb1c3bcc9bf6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772587.878261:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013a00/0x418ffb1c3bcc9bfd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772587.878270:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013a00/0x418ffb1c3bcc9bfd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772587.878276:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013a00/0x418ffb1c3bcc9bfd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772587.878326:0:22756:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1790772587.878330:0:22756:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790772587.878371:0:22756:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013a00/0x418ffb1c3bcc9bfd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772587.878393:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013a00/0x418ffb1c3bcc9bfd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772587.878401:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012c00/0x418ffb1c3bcc9bef lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772587.878408:0:22756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012c00/0x418ffb1c3bcc9bef lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772587.878415:0:22756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012c00/0x418ffb1c3bcc9bef lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772587.878421:0:22756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf5012c00 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:0.0:1790772587.878425:0:22756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012c00/0x418ffb1c3bcc9bef lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772587.878433:0:22756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012c00/0x418ffb1c3bcc9bef lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772587.878460:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9eccc3658e00) 00010000:00010000:0.0:1790772587.878463:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772587.878468:0:22756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012c00/0x418ffb1c3bcc9bef lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772587.878475:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012c00/0x418ffb1c3bcc9bef lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772587.878489:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012200/0x418ffb1c3bcc9bf6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772587.878495:0:22756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012200/0x418ffb1c3bcc9bf6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772587.878506:0:22756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012200/0x418ffb1c3bcc9bf6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772587.878511:0:22756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf5012200 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:0.0:1790772587.878515:0:22756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012200/0x418ffb1c3bcc9bf6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772587.878521:0:22756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012200/0x418ffb1c3bcc9bf6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772587.878528:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9eccc23b2000) 00010000:00010000:0.0:1790772587.878531:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772587.878534:0:22756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012200/0x418ffb1c3bcc9bf6 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772587.878540:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012200/0x418ffb1c3bcc9bf6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772587.878578:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013200/0x418ffb1c3bcc9be8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b70 expref: 30 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772587.878592:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013a00/0x418ffb1c3bcc9bfd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b70 expref: 29 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772587.878600:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9eccc23b2400) 00010000:00010000:0.0:1790772587.878602:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772587.878605:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdf5013a00, rc 0) 00000100:00100000:0.0:1790772587.878677:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdff730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+29:18738:x1877760481068928:12345-192.168.206.14@tcp:101:stat.0 Request processed in 783us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772587.878691:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 46 00000100:00100000:0.0:1790772587.983814:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772587.984068:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481069184 00000100:00100000:1.0:1790772587.984081:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481069184 00000100:00100000:1.0:1790772587.984158:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 47 00000100:00100000:1.0:1790772587.984208:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+29:18744:x1877760481069184:12345-192.168.206.14@tcp:36:truncate.0 00010000:00010000:1.0:1790772587.984283:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772587.984334:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013a00/0x418ffb1c3bcc9bfd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b70 expref: 29 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772587.984357:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9eccc23b2400) 00010000:00010000:1.0:1790772587.984363:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790772587.984594:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439000/0x418ffb1c3bcc9c04 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772587.984613:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439000/0x418ffb1c3bcc9c04 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772587.984624:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439000/0x418ffb1c3bcc9c04 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790772587.984689:0:22758:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:1.0:1790772587.984717:0:22758:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000027ed7c99 reply state 0000000028edf859 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439000/0x418ffb1c3bcc9c04 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772587.984731:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439000/0x418ffb1c3bcc9c04 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772587.984738:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9eccc23b2400) 00010000:00010000:1.0:1790772587.984740:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790772587.984743:0:22758:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790772587.985720:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+31:18744:x1877760481069184:12345-192.168.206.14@tcp:36:truncate.0 Request processed in 1544us (1913us total) trans 12884901909 rc 0/0 00000100:00100000:1.0:1790772587.985733:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 47 00000020:00080000:1.0:1790772587.985740:0:22758:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1790772588.255369:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1790772588.258978:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481069312 00000100:00100000:0.0:1790772588.259000:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481069312 00000100:00100000:0.0:1790772588.259211:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 48 00000100:00100000:0.0:1790772588.259226:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc8841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+31:18758:x1877760481069312:12345-192.168.206.14@tcp:101:stat.0 00010000:00010000:0.0:1790772588.259259:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772588.259285:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013200/0x418ffb1c3bcc9c0b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42c6e08168753b77 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772588.259372:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012200/0x418ffb1c3bcc9c12 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772588.259391:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012200/0x418ffb1c3bcc9c12 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772588.259403:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012200/0x418ffb1c3bcc9c12 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772588.259416:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012c00/0x418ffb1c3bcc9c19 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772588.259423:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012c00/0x418ffb1c3bcc9c19 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772588.259430:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012c00/0x418ffb1c3bcc9c19 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772588.259535:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013400/0x418ffb1c3bcc9c20 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772588.259574:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013400/0x418ffb1c3bcc9c20 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772588.259583:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013400/0x418ffb1c3bcc9c20 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772588.259652:0:22756:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1790772588.259657:0:22756:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790772588.259681:0:22756:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013400/0x418ffb1c3bcc9c20 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772588.259695:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013400/0x418ffb1c3bcc9c20 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772588.259704:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012200/0x418ffb1c3bcc9c12 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772588.259712:0:22756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012200/0x418ffb1c3bcc9c12 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772588.259719:0:22756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012200/0x418ffb1c3bcc9c12 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772588.259725:0:22756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf5012200 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:0.0:1790772588.259730:0:22756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012200/0x418ffb1c3bcc9c12 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772588.259739:0:22756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012200/0x418ffb1c3bcc9c12 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772588.259753:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9eccc3658e00) 00010000:00010000:0.0:1790772588.259761:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772588.259768:0:22756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012200/0x418ffb1c3bcc9c12 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772588.259775:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012200/0x418ffb1c3bcc9c12 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772588.259792:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012c00/0x418ffb1c3bcc9c19 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772588.259798:0:22756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012c00/0x418ffb1c3bcc9c19 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772588.259804:0:22756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012c00/0x418ffb1c3bcc9c19 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772588.259809:0:22756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf5012c00 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:0.0:1790772588.259812:0:22756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012c00/0x418ffb1c3bcc9c19 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772588.259829:0:22756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012c00/0x418ffb1c3bcc9c19 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772588.259838:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9eccc23b2000) 00010000:00010000:0.0:1790772588.259841:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772588.259844:0:22756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012c00/0x418ffb1c3bcc9c19 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772588.259850:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012c00/0x418ffb1c3bcc9c19 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772588.259882:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013200/0x418ffb1c3bcc9c0b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b77 expref: 33 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772588.259913:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013400/0x418ffb1c3bcc9c20 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b77 expref: 32 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772588.259920:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9eccc23b2400) 00010000:00010000:0.0:1790772588.259922:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772588.259925:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdf5013400, rc 0) 00000100:00100000:0.0:1790772588.260026:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc8841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+32:18758:x1877760481069312:12345-192.168.206.14@tcp:101:stat.0 Request processed in 805us (4671us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772588.260034:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 48 00000100:00080000:3.0:1790772588.260801:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772588.440637:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772588.440801:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481069568 00000100:00100000:2.0:1790772588.440885:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481069568 00000100:00100000:2.0:1790772588.441030:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 49 00000100:00100000:2.0:1790772588.441043:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfaa85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+32:18768:x1877760481069568:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:2.0:1790772588.441340:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772588.441442:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9c27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42c6e08168753b7e expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772588.442230:0:22757:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790772588.442440:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9c27 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b7e expref: 34 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772588.442469:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eccc23b2d00) 00010000:00010000:2.0:1790772588.442473:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790772588.442478:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9c27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b7e expref: 34 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772588.442498:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eccc3560200, rc 0) 00000100:00100000:2.0:1790772588.443625:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfaa85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+33:18768:x1877760481069568:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 2576us (3178us total) trans 12884901910 rc 301/301 00000100:00100000:2.0:1790772588.443638:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 49 00000100:00100000:2.0:1790772588.449115:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772588.449273:0:22759:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481069824 00000100:00100000:3.0:1790772588.449286:0:22759:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481069824 00000100:00100000:3.0:1790772588.449418:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 10 00000100:00100000:3.0:1790772588.449431:0:22759:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7202050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+33:18768:x1877760481069824:12345-192.168.206.14@tcp:35:lfs.0 00000100:00100000:3.0:1790772588.449768:0:22759:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7202050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+34:18768:x1877760481069824:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 332us (920us total) trans 12884901911 rc 0/0 00000100:00100000:3.0:1790772588.449777:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 10 00000100:00100000:0.0:1790772588.564595:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772588.573157:0:25802:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481070080 00000100:00100000:1.0:1790772588.573219:0:25802:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481070080 00000100:00100000:1.0:1790772588.573322:0:25802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 50 00000100:00100000:1.0:1790772588.573333:0:25802:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f9f6919-1501-400a-bf51-76bbebf8064d+34:18774:x1877760481070080:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:1.0:1790772588.573384:0:25802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772588.573409:0:25802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439600/0x418ffb1c3bcc9c35 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42c6e08168753b85 expref: -99 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772588.573544:0:25802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438800/0x418ffb1c3bcc9c3c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772588.573574:0:25802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9b63 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b3f expref: 35 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772588.573584:0:25802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013400/0x418ffb1c3bcc9c20 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b77 expref: 35 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772588.573593:0:25802:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438800/0x418ffb1c3bcc9c3c lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772588.573640:0:25802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013400/0x418ffb1c3bcc9c20 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b77 expref: 35 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772588.573656:0:25802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013400/0x418ffb1c3bcc9c20 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b77 expref: 35 pid: 22756 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772588.573672:0:25802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdeec50380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25802:1877760506347520:192.168.206.14@tcp:104: 00010000:00010000:1.0:1790772588.573822:0:25802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9b63 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b3f expref: 35 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772588.573832:0:25802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9b63 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b3f expref: 35 pid: 22757 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772588.573856:0:25802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc440e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25802:1877760506347648:192.168.206.14@tcp:104: 00000100:00100000:1.0:1790772588.573884:0:25802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc3ccab40 going to sleep for 11 seconds 00000100:00100000:1.0:1790772588.576905:0:25802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdeec50380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25802:1877760506347520:192.168.206.14@tcp:104: 00000100:00100000:1.0:1790772588.576920:0:25802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc440e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25802:1877760506347648:192.168.206.14@tcp:104: 00010000:00010000:1.0:1790772588.576956:0:25802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438800/0x418ffb1c3bcc9c3c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772588.580486:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772588.581314:0:22741:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481070208 00000100:00100000:2.0:1790772588.581329:0:22741:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481070208 00010000:00010000:2.0:1790772588.581382:0:22741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013400/0x418ffb1c3bcc9c20 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b77 expref: 36 pid: 22756 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772588.581469:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 17 00000100:00100000:2.0:1790772588.581480:0:22741:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfb40c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+36:2391:x1877760481070208:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772588.581497:0:22741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772588.581504:0:22741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013400/0x418ffb1c3bcc9c20 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b77 expref: 36 pid: 22756 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772588.581535:0:22741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013400/0x418ffb1c3bcc9c20 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b77 expref: 36 pid: 22756 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772588.581560:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013400/0x418ffb1c3bcc9c20 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b77 expref: 36 pid: 22756 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772588.581591:0:22741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9eccc23b2400) 00010000:00010000:2.0:1790772588.581597:0:22741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438800/0x418ffb1c3bcc9c3c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772588.581606:0:22741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438800/0x418ffb1c3bcc9c3c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772588.581614:0:22741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772588.581685:0:22741:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfb40c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+35:2391:x1877760481070208:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 207us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772588.581693:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 17 00000100:00100000:0.0:1790772588.585269:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772588.585830:0:22743:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481070336 00000100:00100000:3.0:1790772588.585843:0:22743:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481070336 00010000:00010000:3.0:1790772588.585895:0:22743:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9b63 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b3f expref: 35 pid: 22757 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772588.585944:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 18 00000100:00100000:3.0:1790772588.585955:0:22743:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7604a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+35:2390:x1877760481070336:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772588.585973:0:22743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772588.585980:0:22743:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9b63 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b3f expref: 35 pid: 22757 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772588.586184:0:22743:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9b63 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b3f expref: 35 pid: 22757 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772588.586211:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9b63 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b3f expref: 35 pid: 22757 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772588.586230:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9eccc23b2400) 00010000:00010000:3.0:1790772588.586237:0:22743:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438800/0x418ffb1c3bcc9c3c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772588.586248:0:22743:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438800/0x418ffb1c3bcc9c3c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772588.586257:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438800/0x418ffb1c3bcc9c3c lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772588.586353:0:22743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772588.586432:0:22743:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7604a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+34:2390:x1877760481070336:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 478us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772588.586441:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 18 00010000:00010000:1.0:1790772588.586490:0:25802:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438800/0x418ffb1c3bcc9c3c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772588.586499:0:25802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438800/0x418ffb1c3bcc9c3c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772588.586523:0:25802:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:1.0:1790772588.586872:0:25802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439600/0x418ffb1c3bcc9c35 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b85 expref: 35 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772588.586891:0:25802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438800/0x418ffb1c3bcc9c3c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b85 expref: 34 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772588.586899:0:25802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9eccc23b2400) 00010000:00010000:1.0:1790772588.586902:0:25802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790772588.586905:0:25802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdff438800, rc 0) 00000100:00100000:1.0:1790772588.586936:0:25802:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f9f6919-1501-400a-bf51-76bbebf8064d+34:18774:x1877760481070080:12345-192.168.206.14@tcp:101:bash.0 Request processed in 13605us (22357us total) trans 12884901912 rc 0/0 00000100:00100000:1.0:1790772588.586943:0:25802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 50 00000100:00100000:0.0:1790772588.593152:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772588.593399:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481070592 00000100:00100000:1.0:1790772588.593411:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481070592 00000100:00100000:1.0:1790772588.593511:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 51 00000100:00100000:1.0:1790772588.593522:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+34:18774:x1877760481070592:12345-192.168.206.14@tcp:36:bash.0 00010000:00010000:1.0:1790772588.593824:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439600/0x418ffb1c3bcc9c4a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772588.593845:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439600/0x418ffb1c3bcc9c4a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772588.593858:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439600/0x418ffb1c3bcc9c4a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790772588.593904:0:22758:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:1.0:1790772588.593951:0:22758:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b2aa6376 reply state 00000000974c0dd6 transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439600/0x418ffb1c3bcc9c4a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772588.593964:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439600/0x418ffb1c3bcc9c4a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772588.593972:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9eccc23b2400) 00010000:00010000:1.0:1790772588.593975:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790772588.593979:0:22758:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790772588.594087:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+37:18774:x1877760481070592:12345-192.168.206.14@tcp:36:bash.0 Request processed in 567us (953us total) trans 12884901914 rc 0/0 00000100:00100000:1.0:1790772588.594095:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 51 00000020:00080000:1.0:1790772588.594101:0:22758:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1790772588.596280:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772588.596415:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481070720 00000100:00100000:3.0:1790772588.596425:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481070720 00000100:00100000:3.0:1790772588.596486:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 52 00000100:00100000:3.0:1790772588.596495:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc8840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+37:18774:x1877760481070720:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:3.0:1790772588.596522:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772588.596543:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9200/0x418ffb1c3bcc9c51 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42c6e08168753b8c expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772588.596639:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9200/0x418ffb1c3bcc9c51 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b8c expref: 38 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772588.596655:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9200/0x418ffb1c3bcc9c51 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b8c expref: 38 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772588.596676:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9eccc23b2400) 00010000:00010000:3.0:1790772588.596679:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790772588.596683:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdf4bd9200, rc 0) 00000100:00100000:3.0:1790772588.596758:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc8840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+38:18774:x1877760481070720:12345-192.168.206.14@tcp:101:bash.0 Request processed in 264us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772588.596766:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 52 00000100:00100000:0.0:1790772588.603310:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772588.603818:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481070848 00000100:00100000:2.0:1790772588.603833:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481070848 00000100:00100000:2.0:1790772588.603906:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 53 00000100:00100000:2.0:1790772588.603917:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+38:18774:x1877760481070848:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:2.0:1790772588.603944:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772588.603968:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9c58 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42c6e08168753b93 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772588.604095:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9c5f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772588.604132:0:22757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438800/0x418ffb1c3bcc9c3c lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b85 expref: 39 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772588.604142:0:22757:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9c5f lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772588.604217:0:22757:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438800/0x418ffb1c3bcc9c3c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b85 expref: 39 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772588.604233:0:22757:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438800/0x418ffb1c3bcc9c3c lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b85 expref: 39 pid: 25802 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772588.604251:0:22757:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc8843b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22757:1877760506347776:192.168.206.14@tcp:104: 00000100:00100000:2.0:1790772588.604359:0:22757:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdeedeb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772588.610012:0:22757:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc8843b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22757:1877760506347776:192.168.206.14@tcp:104: 00010000:00010000:2.0:1790772588.610288:0:22757:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9c5f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772588.611393:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772588.611483:0:22742:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481070976 00000100:00100000:3.0:1790772588.611494:0:22742:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481070976 00010000:00010000:3.0:1790772588.611540:0:22742:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438800/0x418ffb1c3bcc9c3c lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b85 expref: 40 pid: 25802 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772588.611593:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 19 00000100:00100000:3.0:1790772588.611602:0:22742:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7606680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+40:2393:x1877760481070976:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772588.611618:0:22742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772588.611625:0:22742:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438800/0x418ffb1c3bcc9c3c lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b85 expref: 40 pid: 25802 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772588.611638:0:22742:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438800/0x418ffb1c3bcc9c3c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b85 expref: 40 pid: 25802 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772588.611682:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438800/0x418ffb1c3bcc9c3c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b85 expref: 40 pid: 25802 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772588.611700:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9eccc23b2400) 00010000:00010000:3.0:1790772588.611706:0:22742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9c5f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772588.611831:0:22742:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9c5f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772588.611839:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9c5f lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772588.611900:0:22742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772588.611965:0:22742:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7606680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+39:2393:x1877760481070976:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 364us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772588.611973:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 19 00010000:00010000:2.0:1790772588.612888:0:22757:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9c5f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772588.612902:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9c5f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772588.612970:0:22757:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1790772588.612975:0:22757:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790772588.613110:0:22757:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9c5f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772588.613242:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9c58 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b93 expref: 39 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772588.613265:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9c5f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b93 expref: 38 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772588.613275:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9eccc23b2400) 00010000:00010000:2.0:1790772588.613279:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790772588.613283:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eccc3561400, rc 0) 00000100:00100000:2.0:1790772588.613392:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+38:18774:x1877760481070848:12345-192.168.206.14@tcp:101:bash.0 Request processed in 9475us (10224us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772588.613400:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 53 00000100:00100000:0.0:1790772588.615875:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772588.615948:0:25784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481071232 00000100:00100000:2.0:1790772588.615960:0:25784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481071232 00000100:00100000:2.0:1790772588.616036:0:25784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 3 00000100:00100000:2.0:1790772588.616053:0:25784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7607480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f9f6919-1501-400a-bf51-76bbebf8064d+38:18774:x1877760481071232:12345-192.168.206.14@tcp:103:bash.0 00010000:00010000:2.0:1790772588.616070:0:25784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1790772588.616096:0:25784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9200/0x418ffb1c3bcc9c51 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b8c expref: 38 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772588.616120:0:25784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9c5f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b93 expref: 37 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772588.616132:0:25784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9eccc23b2400) 00010000:00010000:2.0:1790772588.616137:0:25784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772588.616218:0:25784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7607480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f9f6919-1501-400a-bf51-76bbebf8064d+36:18774:x1877760481071232:12345-192.168.206.14@tcp:103:bash.0 Request processed in 173us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772588.616242:0:25784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 3 00000100:00100000:0.0:1790772588.621789:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772588.622668:0:25802:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481071360 00000100:00100000:2.0:1790772588.622683:0:25802:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481071360 00000100:00100000:2.0:1790772588.622766:0:25802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 54 00000100:00100000:2.0:1790772588.622777:0:25802:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f9f6919-1501-400a-bf51-76bbebf8064d+36:18774:x1877760481071360:12345-192.168.206.14@tcp:58:bash.0 00010000:00010000:2.0:1790772588.622907:0:25802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9c66 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772588.622928:0:25802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9c66 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772588.622940:0:25802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9c66 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790772588.630801:0:25802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790772588.630834:0:25802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1790772588.631004:0:25802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1790772588.632412:0:25802:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f9f6919-1501-400a-bf51-76bbebf8064d+36:18774:x1877760481071360:12345-192.168.206.14@tcp:58:bash.0 Request processed in 9629us (10630us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772588.632425:0:25802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 54 00000100:00100000:0.0:1790772588.638104:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772588.638296:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481071488 00000100:00100000:3.0:1790772588.638307:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481071488 00000100:00100000:3.0:1790772588.638369:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 55 00000100:00100000:3.0:1790772588.638379:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+36:18774:x1877760481071488:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:3.0:1790772588.638401:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772588.638434:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc9c6d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42c6e08168753b9a expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772588.638496:0:22756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9c66 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772588.638525:0:22756:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc9c6d lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b9a expref: 37 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772588.638577:0:22756:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9c66 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772588.638591:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc9c6d lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b9a expref: 37 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772588.638604:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9eccc23b2400) 00010000:00010000:3.0:1790772588.638607:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790772588.638612:0:22756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc9c6d lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b9a expref: 37 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772588.638619:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdf4bd9e00, rc 0) 00000100:00100000:3.0:1790772588.638683:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+37:18774:x1877760481071488:12345-192.168.206.14@tcp:101:bash.0 Request processed in 304us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772588.638690:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 55 00010000:00010000:3.0:1790772588.692640:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790772589.142431:0:22792:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1790772589.142439:0:22792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790772589.142483:0:22792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1790772589.142490:0:22792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1790772589.142621:0:22792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf7607800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22792:1877760506347904:192.168.206.14@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790772589.142708:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc1ba8240 going to sleep for 11 seconds 00000100:00100000:0.0:1790772589.151497:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772589.151660:0:22792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf7607800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22792:1877760506347904:192.168.206.14@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790772589.151960:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481071616 00000100:00100000:2.0:1790772589.151970:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481071616 00000100:00100000:2.0:1790772589.152039:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 56 00000100:00100000:2.0:1790772589.152050:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+37:18776:x1877760481071616:12345-192.168.206.14@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790772589.152090:0:22758:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790772589.152305:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+37:18776:x1877760481071616:12345-192.168.206.14@tcp:53:lhsmtool_posix.0 Request processed in 257us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772589.152313:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 56 00000100:00100000:3.0:1790772589.166074:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1790772589.166615:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481071744 00000100:00100000:0.0:1790772589.166653:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481071744 00000100:00100000:0.0:1790772589.166742:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 57 00000100:00100000:0.0:1790772589.166754:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfaa85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+37:18776:x1877760481071744:12345-192.168.206.14@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1790772589.166867:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013a00/0x418ffb1c3bcc9c74 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.166889:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013a00/0x418ffb1c3bcc9c74 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.166906:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013a00/0x418ffb1c3bcc9c74 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.168840:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013e00/0x418ffb1c3bcc9c7b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.168865:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013e00/0x418ffb1c3bcc9c7b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.168879:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013e00/0x418ffb1c3bcc9c7b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.168912:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013c00/0x418ffb1c3bcc9c82 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.168922:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013c00/0x418ffb1c3bcc9c82 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.168929:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013c00/0x418ffb1c3bcc9c82 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772589.168980:0:22756:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1790772589.168984:0:22756:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790772589.169021:0:22756:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013c00/0x418ffb1c3bcc9c82 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.169034:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013a00/0x418ffb1c3bcc9c74 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.169041:0:22756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013a00/0x418ffb1c3bcc9c74 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.169048:0:22756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013a00/0x418ffb1c3bcc9c74 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.169053:0:22756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf5013a00 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:0.0:1790772589.169057:0:22756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013a00/0x418ffb1c3bcc9c74 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.169065:0:22756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013a00/0x418ffb1c3bcc9c74 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.169077:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eccc3658100) 00010000:00010000:0.0:1790772589.169081:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772589.169086:0:22756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013a00/0x418ffb1c3bcc9c74 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.169093:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013a00/0x418ffb1c3bcc9c74 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.169109:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013e00/0x418ffb1c3bcc9c7b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.169115:0:22756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013e00/0x418ffb1c3bcc9c7b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.169120:0:22756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013e00/0x418ffb1c3bcc9c7b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.169132:0:22756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf5013e00 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:0.0:1790772589.169135:0:22756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013e00/0x418ffb1c3bcc9c7b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.169142:0:22756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013e00/0x418ffb1c3bcc9c7b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.169150:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9eccc3658000) 00010000:00010000:0.0:1790772589.169153:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772589.169155:0:22756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013e00/0x418ffb1c3bcc9c7b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.169161:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013e00/0x418ffb1c3bcc9c7b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.169278:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013c00/0x418ffb1c3bcc9c82 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.169283:0:22756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013c00/0x418ffb1c3bcc9c82 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.169289:0:22756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013c00/0x418ffb1c3bcc9c82 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.169294:0:22756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf5013c00 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:0.0:1790772589.169297:0:22756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013c00/0x418ffb1c3bcc9c82 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.169303:0:22756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013c00/0x418ffb1c3bcc9c82 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.169323:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9eccc23b2400) 00010000:00010000:0.0:1790772589.169325:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772589.169328:0:22756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013c00/0x418ffb1c3bcc9c82 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.169334:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013c00/0x418ffb1c3bcc9c82 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772589.170070:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfaa85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+37:18776:x1877760481071744:12345-192.168.206.14@tcp:34:lhsmtool_posix.0 Request processed in 3313us (4008us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772589.170082:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 57 00000100:00100000:0.0:1790772589.173251:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772589.173622:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481072000 00000100:00100000:2.0:1790772589.173636:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481072000 00000100:00100000:2.0:1790772589.173723:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 58 00000100:00100000:2.0:1790772589.173735:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+37:18776:x1877760481072000:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790772589.173765:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772589.173791:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9c89 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42c6e08168753ba1 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.173953:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9c90 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.173974:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9c90 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.173988:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9c90 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772589.174001:0:22758:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790772589.174520:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9c90 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.174532:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9c90 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.174540:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9c90 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.174547:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc3561400 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:2.0:1790772589.174553:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9c90 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.174571:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9c90 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.174605:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9eccc23b2400) 00010000:00010000:2.0:1790772589.174608:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790772589.174614:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9c90 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.174621:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9c90 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.174680:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9c89 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753ba1 expref: 39 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.174692:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eccc3658100) 00010000:00010000:2.0:1790772589.174695:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790772589.174699:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9c89 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753ba1 expref: 39 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.174712:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eccc3560200, rc 0) 00000100:00100000:2.0:1790772589.174801:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+38:18776:x1877760481072000:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 1068us (1563us total) trans 12884901915 rc 301/301 00000100:00100000:2.0:1790772589.174811:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 58 00000100:00100000:2.0:1790772589.190335:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1790772589.190608:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481072128 00000100:00100000:0.0:1790772589.190621:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481072128 00000100:00100000:0.0:1790772589.190699:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 59 00000100:00100000:0.0:1790772589.190717:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc8843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+38:18776:x1877760481072128:12345-192.168.206.14@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790772589.190764:0:22757:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790772589.191035:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc8843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+38:18776:x1877760481072128:12345-192.168.206.14@tcp:53:lhsmtool_posix.0 Request processed in 319us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772589.191826:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 59 00000100:00100000:3.0:1790772589.193921:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772589.195838:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481072384 00000100:00100000:2.0:1790772589.195869:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481072384 00000100:00100000:2.0:1790772589.195947:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 60 00000100:00100000:2.0:1790772589.195959:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfaa87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+38:18776:x1877760481072384:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790772589.195986:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772589.196011:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9c9e lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42c6e08168753ba8 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790772589.204594:0:22758:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =59 00000004:00080000:2.0:1790772589.204610:0:22758:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+59 in llog 00000004:00080000:2.0:1790772589.204638:0:22758:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:2.0:1790772589.205049:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9ca5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.205071:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9ca5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.205084:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9ca5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.205205:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9c9e lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753ba8 expref: 41 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.205231:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9ca5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753ba8 expref: 40 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.205242:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9eccc23b2100) 00010000:00010000:2.0:1790772589.205245:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790772589.205249:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eccc3561400, rc 0) 00000100:00100000:2.0:1790772589.205376:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfaa87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+40:18776:x1877760481072384:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 9418us (11467us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1790772589.205386:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 60 00000100:00100000:1.0:1790772589.211780:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1790772589.211962:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481072640 00000100:00100000:0.0:1790772589.211976:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481072640 00000100:00100000:0.0:1790772589.212057:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 61 00000100:00100000:0.0:1790772589.212069:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc440e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+40:18776:x1877760481072640:12345-192.168.206.14@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790772589.212152:0:22757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772589.212274:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9ca5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753ba8 expref: 40 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.212617:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9eccc23b2100) 00010000:00010000:0.0:1790772589.212688:0:22757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790772589.213050:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013e00/0x418ffb1c3bcc9cb3 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.213070:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013e00/0x418ffb1c3bcc9cb3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.213083:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013e00/0x418ffb1c3bcc9cb3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.213428:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013a00/0x418ffb1c3bcc9cba lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x35e16335 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.213459:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013a00/0x418ffb1c3bcc9cba lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x35e16335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.213472:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013a00/0x418ffb1c3bcc9cba lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x35e16335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.213524:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013e00/0x418ffb1c3bcc9cb3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.213532:0:22757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013e00/0x418ffb1c3bcc9cb3 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.213540:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013e00/0x418ffb1c3bcc9cb3 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.213546:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf5013e00 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:0.0:1790772589.213551:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013e00/0x418ffb1c3bcc9cb3 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.213584:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013e00/0x418ffb1c3bcc9cb3 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.213597:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9eccc3658e00) 00010000:00010000:0.0:1790772589.213600:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772589.213605:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013e00/0x418ffb1c3bcc9cb3 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.213612:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013e00/0x418ffb1c3bcc9cb3 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.213627:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013a00/0x418ffb1c3bcc9cba lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x35e16335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.213634:0:22757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013a00/0x418ffb1c3bcc9cba lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x35e16335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.213640:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013a00/0x418ffb1c3bcc9cba lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x35e16335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.213646:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf5013a00 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:0.0:1790772589.213649:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013a00/0x418ffb1c3bcc9cba lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x35e16335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.213656:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013a00/0x418ffb1c3bcc9cba lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x35e16335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.213663:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x35e16335 (ffff9eccc3658000) 00010000:00010000:0.0:1790772589.213666:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772589.213668:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013a00/0x418ffb1c3bcc9cba lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x35e16335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.213684:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013a00/0x418ffb1c3bcc9cba lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x35e16335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772589.213791:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc440e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+39:18776:x1877760481072640:12345-192.168.206.14@tcp:36:lhsmtool_posix.0 Request processed in 1720us (2019us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790772589.213801:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 61 00000100:00100000:0.0:1790772589.218952:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772589.219472:0:25802:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481072768 00000100:00100000:1.0:1790772589.219498:0:25802:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481072768 00000100:00100000:1.0:1790772589.219797:0:25802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 62 00000100:00100000:1.0:1790772589.219809:0:25802:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f9f6919-1501-400a-bf51-76bbebf8064d+39:18776:x1877760481072768:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790772589.219831:0:25802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772589.219854:0:25802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439e00/0x418ffb1c3bcc9cc1 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42c6e08168753baf expref: -99 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772589.219890:0:25802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439200/0x418ffb1c3bcc9cc8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772589.219903:0:25802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439200/0x418ffb1c3bcc9cc8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772589.219913:0:25802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439200/0x418ffb1c3bcc9cc8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772589.220029:0:25802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439e00/0x418ffb1c3bcc9cc1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753baf expref: 41 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772589.220049:0:25802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439200/0x418ffb1c3bcc9cc8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753baf expref: 40 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772589.220058:0:25802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ecdc7796d00) 00010000:00010000:1.0:1790772589.220061:0:25802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790772589.220064:0:25802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdff439200, rc 0) 00000100:00100000:1.0:1790772589.220119:0:25802:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f9f6919-1501-400a-bf51-76bbebf8064d+40:18776:x1877760481072768:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 313us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772589.220127:0:25802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 62 00000100:00100000:3.0:1790772589.224493:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1790772589.225061:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481073024 00000100:00100000:0.0:1790772589.225077:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481073024 00000100:00100000:0.0:1790772589.225155:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 63 00000100:00100000:0.0:1790772589.225200:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfaa86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+40:18776:x1877760481073024:12345-192.168.206.14@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790772589.225310:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012600/0x418ffb1c3bcc9ccf lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.225328:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012600/0x418ffb1c3bcc9ccf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.225339:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012600/0x418ffb1c3bcc9ccf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790772589.225505:0:22756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:0.0:1790772589.225514:0:22756:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689524347921ns, next at 690524345385ns, rc = 0 00000004:00010000:0.0:1790772589.225570:0:22756:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001ce705f9 reply state 000000002f34a18a transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012600/0x418ffb1c3bcc9ccf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.225584:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012600/0x418ffb1c3bcc9ccf lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.225592:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ecdc7796d00) 00010000:00010000:0.0:1790772589.225601:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1790772589.225606:0:22756:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790772589.225700:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfaa86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+42:18776:x1877760481073024:12345-192.168.206.14@tcp:36:lhsmtool_posix.0 Request processed in 536us (1221us total) trans 12884901917 rc 0/0 00000100:00100000:0.0:1790772589.225707:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 63 00000100:00100000:0.0:1790772589.227963:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772589.228117:0:25802:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481073152 00000100:00100000:1.0:1790772589.228150:0:25802:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481073152 00000100:00100000:1.0:1790772589.228267:0:25802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 64 00000100:00100000:1.0:1790772589.228279:0:25802:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f9f6919-1501-400a-bf51-76bbebf8064d+42:18776:x1877760481073152:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790772589.228304:0:25802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772589.228322:0:25802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439e00/0x418ffb1c3bcc9cd6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42c6e08168753bb6 expref: -99 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772589.228389:0:25802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439e00/0x418ffb1c3bcc9cd6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bb6 expref: 43 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772589.228404:0:25802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439e00/0x418ffb1c3bcc9cd6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bb6 expref: 43 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772589.228421:0:25802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ecdc7796d00) 00010000:00010000:1.0:1790772589.228425:0:25802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790772589.228428:0:25802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdff439e00, rc 0) 00000100:00100000:1.0:1790772589.228483:0:25802:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f9f6919-1501-400a-bf51-76bbebf8064d+43:18776:x1877760481073152:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 207us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772589.228490:0:25802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 64 00000100:00100000:1.0:1790772589.232135:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772589.232351:0:24262:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481073280 00000100:00100000:2.0:1790772589.232364:0:24262:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481073280 00000100:00100000:2.0:1790772589.232447:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 24 00000100:00100000:2.0:1790772589.232459:0:24262:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc440c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+5:2393:x1877760481073280:12345-192.168.206.14@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1790772589.232786:0:24262:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc440c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+6:2393:x1877760481073280:12345-192.168.206.14@tcp:2:lhsmtool_posix.0 Request processed in 329us (666us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1790772589.232796:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 24 00000100:00080000:3.0:1790772589.232938:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790772589.235309:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772589.236002:0:22760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481073536 00000100:00100000:1.0:1790772589.236014:0:22760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481073536 00000100:00100000:1.0:1790772589.236092:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 11 00000100:00100000:1.0:1790772589.236103:0:22760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+43:18776:x1877760481073536:12345-192.168.206.14@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790772589.236439:0:22760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+44:18776:x1877760481073536:12345-192.168.206.14@tcp:35:lhsmtool_posix.0 Request processed in 336us (1140us total) trans 12884901918 rc 0/0 00000100:00100000:1.0:1790772589.236448:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 11 00000100:00100000:0.0:1790772589.238606:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772589.238697:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481073792 00000100:00100000:3.0:1790772589.238707:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481073792 00000100:00100000:3.0:1790772589.238773:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 65 00000100:00100000:3.0:1790772589.238784:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+44:18776:x1877760481073792:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790772589.238928:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+44:18776:x1877760481073792:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 Request processed in 145us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772589.238937:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 65 00000100:00100000:0.0:1790772589.240889:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772589.241202:0:25802:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481073920 00000100:00100000:1.0:1790772589.241213:0:25802:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481073920 00000100:00100000:1.0:1790772589.241276:0:25802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 66 00000100:00100000:1.0:1790772589.241287:0:25802:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f9f6919-1501-400a-bf51-76bbebf8064d+44:18776:x1877760481073920:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790772589.241310:0:25802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772589.241336:0:25802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438200/0x418ffb1c3bcc9cdd lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42c6e08168753bbd expref: -99 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772589.241451:0:25802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438800/0x418ffb1c3bcc9ce4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772589.241469:0:25802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438800/0x418ffb1c3bcc9ce4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772589.241483:0:25802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438800/0x418ffb1c3bcc9ce4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772589.241543:0:25802:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790772589.241577:0:25802:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438800/0x418ffb1c3bcc9ce4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772589.241608:0:25802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438200/0x418ffb1c3bcc9cdd lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bbd expref: 46 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772589.241631:0:25802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438800/0x418ffb1c3bcc9ce4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bbd expref: 45 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772589.241641:0:25802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ecdc7796d00) 00010000:00010000:1.0:1790772589.241644:0:25802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790772589.241648:0:25802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdff438800, rc 0) 00000100:00100000:1.0:1790772589.241727:0:25802:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f9f6919-1501-400a-bf51-76bbebf8064d+45:18776:x1877760481073920:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 441us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772589.241734:0:25802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 66 00000100:00100000:0.0:1790772589.246494:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772589.247408:0:24264:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481074048 00000100:00100000:2.0:1790772589.247423:0:24264:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481074048 00000100:00100000:3.0:1790772589.247624:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 25 00000100:00100000:3.0:1790772589.247638:0:24264:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+6:2392:x1877760481074048:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790772589.247663:0:24264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772589.247688:0:24264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fae2bea1/0x418ffb1c3bcc9ceb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x42c6e08168753bc4 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790772589.247718:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abd056c, blocks: 0x0 00010000:00010000:3.0:1790772589.247743:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=689s v=(0 0) 00010000:00010000:3.0:1790772589.247748:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772589.247759:0:24264:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fae2bea1/0x418ffb1c3bcc9ceb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bc4 expref: 7 pid: 24264 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.247782:0:24264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fae2bea1/0x418ffb1c3bcc9ceb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bc4 expref: 7 pid: 24264 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.247798:0:24264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdf4bd8800, rc 0) 00000100:00100000:3.0:1790772589.247883:0:24264:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+7:2392:x1877760481074048:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 248us (1402us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772589.247891:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 25 00000100:00100000:0.0:1790772589.257465:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772589.257557:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481074304 00000100:00100000:3.0:1790772589.257579:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481074304 00000100:00100000:3.0:1790772589.257652:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 67 00000100:00100000:3.0:1790772589.257683:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf62e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+45:18776:x1877760481074304:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790772589.257830:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf62e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+45:18776:x1877760481074304:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 Request processed in 149us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772589.257839:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 67 00000100:00100000:1.0:1790772589.266350:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772589.266541:0:25802:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481074432 00000100:00100000:2.0:1790772589.266553:0:25802:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481074432 00000100:00100000:2.0:1790772589.266635:0:25802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 68 00000100:00100000:2.0:1790772589.266647:0:25802:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc440f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f9f6919-1501-400a-bf51-76bbebf8064d+45:18776:x1877760481074432:12345-192.168.206.14@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1790772589.271198:0:22736:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:0.0:1790772589.271221:0:22736:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1790772589.271313:0:22736:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:2.0:1790772589.271418:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013000/0x418ffb1c3bcc9b01 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.271433:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013000/0x418ffb1c3bcc9b01 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.271454:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013000/0x418ffb1c3bcc9b01 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.271461:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf5013000 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:2.0:1790772589.271467:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013000/0x418ffb1c3bcc9b01 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.271477:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013000/0x418ffb1c3bcc9b01 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.271499:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9eccc3658e00) 00010000:00010000:2.0:1790772589.271503:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1790772589.271508:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013000/0x418ffb1c3bcc9b01 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.271538:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013000/0x418ffb1c3bcc9b01 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772589.271744:0:25802:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc440f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f9f6919-1501-400a-bf51-76bbebf8064d+20:18776:x1877760481074432:12345-192.168.206.14@tcp:44:lhsmtool_posix.0 Request processed in 5093us (5403us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772589.271757:0:25802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 68 00000100:00100000:2.0:1790772589.273657:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc440d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1877760506348032:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1790772589.273751:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772589.273930:0:24262:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506348032 00000100:00100000:1.0:1790772589.273940:0:24262:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506348032 00000100:00100000:1.0:1790772589.274011:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790772589.274022:0:24262:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc8843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877760506348032:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1790772589.274212:0:24262:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1790772589.274217:0:24262:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1790772589.274219:0:24262:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790772589.274221:0:24262:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1790772588 -> 1790772588 00002000:00010000:1.0:1790772589.274223:0:24262:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1790772589.274276:0:24262:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc8843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1877760506348032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 255us (524us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1790772589.274283:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1790772589.274309:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1790772589.274354:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eccc440d500/2, rc 0, transno 12884901892 00000100:00100000:1.0:1790772589.274360:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc440d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1877760506348032:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1790772589.276233:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9aa6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276255:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9aa6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276265:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9aa6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276273:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf5012800 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:3.0:1790772589.276280:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9aa6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276292:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9aa6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276314:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9eccc3658500) 00010000:00010000:3.0:1790772589.276318:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772589.276324:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9aa6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276332:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9aa6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276359:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013600/0x418ffb1c3bcc9aad lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276388:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013600/0x418ffb1c3bcc9aad lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276395:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013600/0x418ffb1c3bcc9aad lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276401:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf5013600 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:3.0:1790772589.276405:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013600/0x418ffb1c3bcc9aad lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276412:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013600/0x418ffb1c3bcc9aad lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276421:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9eccc3658e00) 00010000:00010000:3.0:1790772589.276424:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772589.276428:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013600/0x418ffb1c3bcc9aad lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276434:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013600/0x418ffb1c3bcc9aad lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276450:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560600/0x418ffb1c3bcc9b5c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276458:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560600/0x418ffb1c3bcc9b5c lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276464:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560600/0x418ffb1c3bcc9b5c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276469:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc3560600 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:3.0:1790772589.276478:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560600/0x418ffb1c3bcc9b5c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276486:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560600/0x418ffb1c3bcc9b5c lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276494:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9eccc23b2000) 00010000:00010000:3.0:1790772589.276498:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772589.276501:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560600/0x418ffb1c3bcc9b5c lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276508:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560600/0x418ffb1c3bcc9b5c lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276530:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561200/0x418ffb1c3bcc9be1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276537:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561200/0x418ffb1c3bcc9be1 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276544:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561200/0x418ffb1c3bcc9be1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276550:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc3561200 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:3.0:1790772589.276554:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561200/0x418ffb1c3bcc9be1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276574:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561200/0x418ffb1c3bcc9be1 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276583:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9eccc23b2400) 00010000:00010000:3.0:1790772589.276585:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772589.276598:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561200/0x418ffb1c3bcc9be1 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276604:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561200/0x418ffb1c3bcc9be1 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276628:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439000/0x418ffb1c3bcc9c04 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276635:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439000/0x418ffb1c3bcc9c04 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276643:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439000/0x418ffb1c3bcc9c04 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276649:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdff439000 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:3.0:1790772589.276847:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439000/0x418ffb1c3bcc9c04 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276856:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439000/0x418ffb1c3bcc9c04 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276866:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9eccc23b2400) 00010000:00010000:3.0:1790772589.276869:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772589.276872:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439000/0x418ffb1c3bcc9c04 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276878:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439000/0x418ffb1c3bcc9c04 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276892:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439600/0x418ffb1c3bcc9c4a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276900:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439600/0x418ffb1c3bcc9c4a lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276912:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439600/0x418ffb1c3bcc9c4a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276918:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdff439600 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:3.0:1790772589.276922:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439600/0x418ffb1c3bcc9c4a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276929:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439600/0x418ffb1c3bcc9c4a lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276938:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9eccc23b2400) 00010000:00010000:3.0:1790772589.276941:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772589.276943:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439600/0x418ffb1c3bcc9c4a lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276950:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439600/0x418ffb1c3bcc9c4a lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276963:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012600/0x418ffb1c3bcc9ccf lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276970:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012600/0x418ffb1c3bcc9ccf lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276976:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012600/0x418ffb1c3bcc9ccf lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.276981:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf5012600 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:3.0:1790772589.276985:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012600/0x418ffb1c3bcc9ccf lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.277001:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012600/0x418ffb1c3bcc9ccf lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.277011:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ecdc7796d00) 00010000:00010000:3.0:1790772589.277013:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790772589.277017:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012600/0x418ffb1c3bcc9ccf lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.277023:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012600/0x418ffb1c3bcc9ccf lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772589.277584:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772589.277779:0:24695:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481074560 00000100:00100000:3.0:1790772589.277791:0:24695:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481074560 00000100:00100000:3.0:1790772589.277853:0:24695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 27 00000100:00100000:3.0:1790772589.277864:0:24695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf763c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f9f6919-1501-400a-bf51-76bbebf8064d+7:2393:x1877760481074560:12345-192.168.206.14@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1790772589.278020:0:24695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf763c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f9f6919-1501-400a-bf51-76bbebf8064d+7:2393:x1877760481074560:12345-192.168.206.14@tcp:16:lhsmtool_posix.0 Request processed in 157us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772589.278028:0:24695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 27 00000100:00100000:0.0:1790772589.284229:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772589.284330:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481074816 00000100:00100000:3.0:1790772589.284343:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481074816 00000100:00100000:3.0:1790772589.284417:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 69 00000100:00100000:3.0:1790772589.284428:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf763d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+14:18776:x1877760481074816:12345-192.168.206.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790772589.284499:0:22756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772589.284531:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff438800/0x418ffb1c3bcc9ce4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bbd expref: 14 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.284555:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ecdc7796d00) 00010000:00010000:3.0:1790772589.284592:0:22756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790772589.284631:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9600/0x418ffb1c3bcc9cf2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.284648:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9600/0x418ffb1c3bcc9cf2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.284671:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9600/0x418ffb1c3bcc9cf2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790772589.284840:0:22756:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000afa79b0c reply state 0000000006906775 transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9600/0x418ffb1c3bcc9cf2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.284854:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9600/0x418ffb1c3bcc9cf2 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.284862:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ecdc7796d00) 00010000:00010000:3.0:1790772589.284865:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790772589.284868:0:22756:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790772589.284986:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf763d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+15:18776:x1877760481074816:12345-192.168.206.14@tcp:36:lhsmtool_posix.0 Request processed in 558us (770us total) trans 12884901919 rc 0/0 00000100:00100000:3.0:1790772589.284994:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 69 00000100:00100000:1.0:1790772589.286974:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772589.287087:0:24262:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481074944 00000100:00100000:2.0:1790772589.287099:0:24262:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481074944 00000100:00100000:2.0:1790772589.287160:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 28 00000100:00100000:2.0:1790772589.287210:0:24262:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdeec50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+7:18776:x1877760481074944:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790772589.287233:0:24262:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772589.287253:0:24262:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029b30956/0x418ffb1c3bcc9cf9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x42c6e08168753bcb expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.287298:0:24262:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fae2bea1/0x418ffb1c3bcc9ceb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bc4 expref: 8 pid: 24264 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.287308:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772589.287313:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772589.287320:0:24262:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029b30956/0x418ffb1c3bcc9cf9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bcb expref: 8 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.287374:0:24262:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fae2bea1/0x418ffb1c3bcc9ceb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bc4 expref: 8 pid: 24264 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.287411:0:24262:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fae2bea1/0x418ffb1c3bcc9ceb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bc4 expref: 8 pid: 24264 timeout: 789 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772589.287430:0:24262:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc8842a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:24262:1877760506348160:192.168.206.14@tcp:104: 00000100:00100000:2.0:1790772589.287523:0:24262:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdeedeb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772589.293643:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772589.293751:0:22741:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481075072 00000100:00100000:2.0:1790772589.293763:0:22741:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481075072 00010000:00010000:2.0:1790772589.293834:0:22741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fae2bea1/0x418ffb1c3bcc9ceb lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bc4 expref: 9 pid: 24264 timeout: 789 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772589.293843:0:24262:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc8842a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:24262:1877760506348160:192.168.206.14@tcp:104: 00010000:00010000:3.0:1790772589.293886:0:24262:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000029b30956/0x418ffb1c3bcc9cf9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bcb expref: 9 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772589.293893:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 20 00000100:00100000:2.0:1790772589.293909:0:22741:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf763df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+9:2393:x1877760481075072:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772589.293915:0:24262:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eccc3560200, rc 0) 00010000:00010000:2.0:1790772589.293930:0:22741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772589.293959:0:22741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fae2bea1/0x418ffb1c3bcc9ceb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bc4 expref: 9 pid: 24264 timeout: 789 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.293975:0:22741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fae2bea1/0x418ffb1c3bcc9ceb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bc4 expref: 9 pid: 24264 timeout: 789 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772589.293992:0:24262:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdeec50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+9:18776:x1877760481074944:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 6783us (7028us total) trans 0 rc 0/0 00010000:00010000:2.0:1790772589.294016:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fae2bea1/0x418ffb1c3bcc9ceb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bc4 expref: 9 pid: 24264 timeout: 789 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772589.294024:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 28 00010000:00010000:2.0:1790772589.294042:0:22741:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772589.294062:0:22741:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772589.294071:0:22741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000029b30956/0x418ffb1c3bcc9cf9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bcb expref: 7 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.294087:0:22741:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029b30956/0x418ffb1c3bcc9cf9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bcb expref: 7 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.294133:0:22741:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000029b30956/0x418ffb1c3bcc9cf9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bcb expref: 7 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772589.294151:0:22741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc8841180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:22741:1877760506348288:192.168.206.14@tcp:105: 00000100:00100000:2.0:1790772589.294283:0:22741:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdeedebe40 going to sleep for 11 seconds 00000100:00100000:0.0:1790772589.298768:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772589.298846:0:22741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc8841180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:22741:1877760506348288:192.168.206.14@tcp:105: 00000100:00100000:3.0:1790772589.298862:0:24695:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481075200 00000100:00100000:3.0:1790772589.298872:0:24695:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481075200 00010000:00010000:2.0:1790772589.298881:0:22741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772589.298939:0:24695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 29 00000100:00100000:3.0:1790772589.298950:0:24695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf763fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f9f6919-1501-400a-bf51-76bbebf8064d+8:2392:x1877760481075200:12345-192.168.206.14@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1790772589.298961:0:22741:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf763df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+8:2393:x1877760481075072:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 5053us (5332us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772589.298972:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 20 00002000:00010000:3.0:1790772589.299158:0:24695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1790772589.299162:0:24695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1790772587 00002000:00010000:3.0:1790772589.299187:0:24695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1790772585 00002000:00010000:3.0:1790772589.299190:0:24695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1790772588 -> 1790772587 00002000:00010000:3.0:1790772589.299193:0:24695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1790772589.299242:0:24695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf763fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f9f6919-1501-400a-bf51-76bbebf8064d+8:2392:x1877760481075200:12345-192.168.206.14@tcp:2:lhsmtool_posix.0 Request processed in 294us (603us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1790772589.299249:0:24695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 29 00000100:00100000:0.0:1790772589.304357:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1790772589.304476:0:24263:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481075328 00000100:00100000:1.0:1790772589.304492:0:24263:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481075328 00000100:00100000:1.0:1790772589.304582:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 30 00000100:00100000:1.0:1790772589.304593:0:24263:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf763ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+8:2390:x1877760481075328:12345-192.168.206.14@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1790772589.304795:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cd9284c9/0x418ffb1c3bcc9d00 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772589.304853:0:24263:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000029b30956/0x418ffb1c3bcc9cf9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bcb expref: 8 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772589.304863:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772589.304868:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790772589.304877:0:24263:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd9284c9/0x418ffb1c3bcc9d00 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772589.304930:0:24263:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000029b30956/0x418ffb1c3bcc9cf9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bcb expref: 8 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772589.304950:0:24263:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000029b30956/0x418ffb1c3bcc9cf9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bcb expref: 8 pid: 24262 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772589.304971:0:24263:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf8091500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:24263:1877760506348416:192.168.206.14@tcp:104: 00000100:00100000:1.0:1790772589.305081:0:24263:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eccc3cca600 going to sleep for 11 seconds 00000100:00100000:2.0:1790772589.308837:0:24263:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf8091500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:24263:1877760506348416:192.168.206.14@tcp:104: 00010000:00010000:2.0:1790772589.308889:0:24263:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cd9284c9/0x418ffb1c3bcc9d00 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772589.309274:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772589.309402:0:25784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481075456 00000100:00100000:2.0:1790772589.309412:0:25784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481075456 00010000:00010000:2.0:1790772589.309463:0:25784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000029b30956/0x418ffb1c3bcc9cf9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bcb expref: 9 pid: 24262 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772589.309532:0:25784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 21 00000100:00100000:2.0:1790772589.309543:0:25784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf763d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f9f6919-1501-400a-bf51-76bbebf8064d+9:2392:x1877760481075456:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772589.309573:0:25784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772589.309601:0:25784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000029b30956/0x418ffb1c3bcc9cf9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bcb expref: 9 pid: 24262 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.309627:0:25784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000029b30956/0x418ffb1c3bcc9cf9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bcb expref: 9 pid: 24262 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.309726:0:25784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029b30956/0x418ffb1c3bcc9cf9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bcb expref: 9 pid: 24262 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.309750:0:25784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790772589.309755:0:25784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790772589.309762:0:25784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cd9284c9/0x418ffb1c3bcc9d00 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.309774:0:25784:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd9284c9/0x418ffb1c3bcc9d00 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.309815:0:25784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772589.309888:0:25784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf763d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f9f6919-1501-400a-bf51-76bbebf8064d+8:2392:x1877760481075456:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 346us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772589.309897:0:25784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 21 00010000:00010000:1.0:1790772589.309999:0:24263:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cd9284c9/0x418ffb1c3bcc9d00 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772589.310010:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd9284c9/0x418ffb1c3bcc9d00 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772589.310034:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cd9284c9/0x418ffb1c3bcc9d00 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772589.310057:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd9284c9/0x418ffb1c3bcc9d00 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772589.310066:0:24263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd9284c9/0x418ffb1c3bcc9d00 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772589.310074:0:24263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdff438400 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:1.0:1790772589.310079:0:24263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd9284c9/0x418ffb1c3bcc9d00 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772589.310089:0:24263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd9284c9/0x418ffb1c3bcc9d00 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772589.310105:0:24263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd9284c9/0x418ffb1c3bcc9d00 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772589.310114:0:24263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd9284c9/0x418ffb1c3bcc9d00 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772589.310211:0:24263:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf763ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+7:2390:x1877760481075328:12345-192.168.206.14@tcp:1:lhsmtool_posix.0 Request processed in 5620us (5874us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772589.310220:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 30 00000100:00100000:1.0:1790772589.314513:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772589.314603:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481075712 00000100:00100000:3.0:1790772589.314733:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481075712 00000100:00100000:3.0:1790772589.314837:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 70 00000100:00100000:3.0:1790772589.314850:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf8093800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+15:18776:x1877760481075712:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790772589.314964:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd8600/0x418ffb1c3bcc9d07 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.314985:0:22758:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561e00/0x418ffb1c3bcc9bda lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b69 expref: 15 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.314996:0:22758:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd8600/0x418ffb1c3bcc9d07 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.315061:0:22758:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561e00/0x418ffb1c3bcc9bda lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b69 expref: 15 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.315079:0:22758:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561e00/0x418ffb1c3bcc9bda lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b69 expref: 15 pid: 22758 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772589.315098:0:22758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf75b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22758:1877760506348544:192.168.206.14@tcp:104: 00000100:00100000:3.0:1790772589.315240:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdef0fab40 going to sleep for 11 seconds 00000100:00100000:3.0:1790772589.322311:0:22758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf75b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22758:1877760506348544:192.168.206.14@tcp:104: 00010000:00010000:3.0:1790772589.322353:0:22758:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd8600/0x418ffb1c3bcc9d07 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772589.333760:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1790772589.336680:0:22742:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481075840 00000100:00100000:0.0:1790772589.336701:0:22742:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481075840 00010000:00010000:0.0:1790772589.336768:0:22742:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561e00/0x418ffb1c3bcc9bda lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b69 expref: 16 pid: 22758 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772589.336824:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 22 00000100:00100000:0.0:1790772589.336835:0:22742:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf8091500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+16:2392:x1877760481075840:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772589.336854:0:22742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772589.336879:0:22742:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561e00/0x418ffb1c3bcc9bda lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b69 expref: 16 pid: 22758 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.336893:0:22742:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561e00/0x418ffb1c3bcc9bda lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b69 expref: 16 pid: 22758 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.336919:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561e00/0x418ffb1c3bcc9bda lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b69 expref: 16 pid: 22758 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.336939:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9eccc23b2400) 00010000:00010000:0.0:1790772589.336946:0:22742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc9c6d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b9a expref: 15 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.336957:0:22742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd8600/0x418ffb1c3bcc9d07 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.336966:0:22742:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd8600/0x418ffb1c3bcc9d07 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.336974:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd8600/0x418ffb1c3bcc9d07 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.337011:0:22742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790772589.337099:0:22758:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd8600/0x418ffb1c3bcc9d07 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772589.337101:0:22742:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf8091500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+15:2392:x1877760481075840:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 267us (3353us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772589.337117:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 22 00010000:00010000:3.0:1790772589.337118:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd8600/0x418ffb1c3bcc9d07 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.337486:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9d0e lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.337500:0:22758:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439e00/0x418ffb1c3bcc9cd6 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bb6 expref: 15 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.337510:0:22758:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9d0e lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.337548:0:22758:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439e00/0x418ffb1c3bcc9cd6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bb6 expref: 15 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.337578:0:22758:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439e00/0x418ffb1c3bcc9cd6 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bb6 expref: 15 pid: 25802 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772589.337595:0:22758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc8841180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22758:1877760506348672:192.168.206.14@tcp:104: 00000100:00100000:2.0:1790772589.337673:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdeedeb480 going to sleep for 11 seconds 00000100:00100000:1.0:1790772589.341728:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772589.341768:0:22758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc8841180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22758:1877760506348672:192.168.206.14@tcp:104: 00010000:00010000:2.0:1790772589.341805:0:22758:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9d0e lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772589.342080:0:25784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481075968 00000100:00100000:0.0:1790772589.342092:0:25784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481075968 00010000:00010000:0.0:1790772589.342146:0:25784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439e00/0x418ffb1c3bcc9cd6 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bb6 expref: 16 pid: 25802 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772589.342224:0:25784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 23 00000100:00100000:0.0:1790772589.342239:0:25784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdfb40e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f9f6919-1501-400a-bf51-76bbebf8064d+16:2393:x1877760481075968:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772589.342261:0:25784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772589.342272:0:25784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439e00/0x418ffb1c3bcc9cd6 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bb6 expref: 16 pid: 25802 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.342290:0:25784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439e00/0x418ffb1c3bcc9cd6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bb6 expref: 16 pid: 25802 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.342324:0:25784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439e00/0x418ffb1c3bcc9cd6 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bb6 expref: 16 pid: 25802 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.342345:0:25784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ecdc7796d00) 00010000:00010000:0.0:1790772589.342351:0:25784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9d0e lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.342366:0:25784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9d0e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.342376:0:25784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9d0e lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.342412:0:25784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772589.342483:0:25784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdfb40e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f9f6919-1501-400a-bf51-76bbebf8064d+15:2393:x1877760481075968:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 249us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772589.342494:0:25784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 23 00010000:00010000:2.0:1790772589.342617:0:22758:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9d0e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.342625:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9d0e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790772589.342775:0:22758:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:2.0:1790772589.342933:0:22758:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:2.0:1790772589.342979:0:22758:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:2.0:1790772589.343112:0:22758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc8841180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22758:1877760506348800:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1790772589.343227:0:22758:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772589.343276:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdeedebcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772589.344229:0:22761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506348800 00000100:00100000:0.0:1790772589.344253:0:22761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506348800 00000100:00100000:0.0:1790772589.344313:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790772589.344322:0:22761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdc8842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22758:x1877760506348800:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1790772589.344474:0:22761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdc8842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22758:x1877760506348800:12345-0@lo:1000:mdt00_002.0 Request processed in 153us (1246us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772589.344485:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790772589.344668:0:22758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc8841180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22758:1877760506348800:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1790772589.345314:0:22758:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:2.0:1790772589.345399:0:22758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdc8841180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22758:1877760506348928:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1790772589.345453:0:22758:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772589.345483:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdeedeb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772589.345644:0:23497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506348928 00000100:00100000:0.0:1790772589.345651:0:23497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506348928 00000100:00100000:0.0:1790772589.345688:0:23497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790772589.345697:0:23497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf80e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22758:x1877760506348928:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1790772589.345845:0:23497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf80e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22758:x1877760506348928:12345-0@lo:1000:mdt00_002.0 Request processed in 148us (391us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1790772589.345853:0:23497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790772589.345927:0:22758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdc8841180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22758:1877760506348928:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1790772589.345968:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9d0e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.345979:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9d0e lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.345987:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9d0e lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.345994:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc3560200 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:2.0:1790772589.345999:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9d0e lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.346008:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9d0e lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.346025:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ecdc7796d00) 00010000:00010000:2.0:1790772589.346029:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790772589.346034:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9d0e lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.346070:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560200/0x418ffb1c3bcc9d0e lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.346112:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9c66 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.346119:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9c66 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.346126:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9c66 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.346131:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc3561000 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:2.0:1790772589.346134:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9c66 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.346141:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9c66 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.346150:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9eccc23b2400) 00010000:00010000:2.0:1790772589.346153:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790772589.346161:0:22758:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc9c6d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b9a expref: 18 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.346209:0:22758:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc9c6d lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b9a expref: 18 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.346219:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc9c6d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b9a expref: 18 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.346295:0:22758:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd9e00/0x418ffb1c3bcc9c6d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753b9a expref: 18 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772589.346309:0:22758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80ebb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22758:1877760506349056:192.168.206.14@tcp:105: 00000100:00100000:2.0:1790772589.346381:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ecdeedeb540 going to sleep for 11 seconds 00000100:00100000:1.0:1790772589.350616:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772589.350753:0:22758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80ebb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22758:1877760506349056:192.168.206.14@tcp:105: 00000100:00100000:0.0:1790772589.350769:0:22760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481076096 00000100:00100000:0.0:1790772589.350777:0:22760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481076096 00010000:00010000:2.0:1790772589.350791:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9c66 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.350803:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561000/0x418ffb1c3bcc9c66 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 25802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.350843:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561e00/0x418ffb1c3bcc9d15 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772589.350844:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 12 00000100:00100000:0.0:1790772589.350854:0:22760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf8091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+19:18774:x1877760481076096:12345-192.168.206.14@tcp:49:bash.0 00010000:00010000:2.0:1790772589.350859:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561e00/0x418ffb1c3bcc9d15 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.350871:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561e00/0x418ffb1c3bcc9d15 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.350881:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561e00/0x418ffb1c3bcc9d15 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.350888:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561e00/0x418ffb1c3bcc9d15 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.350894:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561e00/0x418ffb1c3bcc9d15 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.350919:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eccc3561e00 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:2.0:1790772589.350924:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561e00/0x418ffb1c3bcc9d15 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.350932:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561e00/0x418ffb1c3bcc9d15 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.350945:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9eccc23b2400) 00010000:00010000:2.0:1790772589.350947:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772589.350951:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561e00/0x418ffb1c3bcc9d15 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.350956:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561e00/0x418ffb1c3bcc9d15 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.350965:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd8600/0x418ffb1c3bcc9d07 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.350970:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd8600/0x418ffb1c3bcc9d07 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.350989:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd8600/0x418ffb1c3bcc9d07 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.350995:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf4bd8600 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:2.0:1790772589.350998:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd8600/0x418ffb1c3bcc9d07 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772589.351003:0:22760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf8091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+19:18774:x1877760481076096:12345-192.168.206.14@tcp:49:bash.0 Request processed in 151us (402us total) trans 0 rc 0/0 00010000:00010000:2.0:1790772589.351004:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd8600/0x418ffb1c3bcc9d07 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772589.351011:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 12 00010000:00010000:2.0:1790772589.351022:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9eccc23b2400) 00010000:00010000:2.0:1790772589.351024:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790772589.351027:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd8600/0x418ffb1c3bcc9d07 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.351034:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf4bd8600/0x418ffb1c3bcc9d07 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772589.351201:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf8093800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+18:18776:x1877760481075712:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 Request processed in 36353us (36701us total) trans 12884901924 rc 0/0 00000100:00100000:2.0:1790772589.351210:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 70 00000020:00080000:2.0:1790772589.351214:0:22758:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1790772589.351638:0:22792:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1790772589.351644:0:22792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790772589.351674:0:22792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1790772589.351683:0:22792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1790772589.355439:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1790772589.355482:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772589.355576:0:24695:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481076480 00000100:00100000:3.0:1790772589.355589:0:24695:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481076480 00000100:00100000:3.0:1790772589.355664:0:24695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 31 00000100:00100000:3.0:1790772589.355676:0:24695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf763d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f9f6919-1501-400a-bf51-76bbebf8064d+7:18774:x1877760481076480:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:3.0:1790772589.355699:0:24695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772589.355726:0:24695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fae2bea1/0x418ffb1c3bcc9d1c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x42c6e08168753bd2 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790772589.355756:0:24695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6abd056b, atime: 0x6abd0569, ctime: 0x6abd056b, blocks: 0x0 00010000:00010000:3.0:1790772589.355804:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=689s v=(0 0) 00010000:00010000:3.0:1790772589.355810:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772589.355822:0:24695:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fae2bea1/0x418ffb1c3bcc9d1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bd2 expref: 8 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.355844:0:24695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fae2bea1/0x418ffb1c3bcc9d1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bd2 expref: 8 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.355858:0:24695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ecdf4bd8800, rc 0) 00000100:00100000:3.0:1790772589.355937:0:24695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf763d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f9f6919-1501-400a-bf51-76bbebf8064d+8:18774:x1877760481076480:12345-192.168.206.14@tcp:101:bash.0 Request processed in 263us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772589.355946:0:24695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 31 00000100:00100000:1.0:1790772589.356551:0:22760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481076352 00000100:00100000:1.0:1790772589.356569:0:22760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481076352 00000100:00100000:1.0:1790772589.356621:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 13 00000100:00100000:1.0:1790772589.356630:0:22760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf763df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+18:18776:x1877760481076352:12345-192.168.206.14@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1790772589.357646:0:22760:0:(mdd_object.c:4189:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1790772589.357889:0:22760:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:1.0:1790772589.357933:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439000/0x418ffb1c3bcc9d23 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772589.357954:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439000/0x418ffb1c3bcc9d23 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772589.357967:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439000/0x418ffb1c3bcc9d23 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772589.357977:0:22760:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439000/0x418ffb1c3bcc9d23 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772589.357984:0:22760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439000/0x418ffb1c3bcc9d23 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772589.357991:0:22760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439000/0x418ffb1c3bcc9d23 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772589.358351:0:22760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790772589.358483:0:22760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf763df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+20:18776:x1877760481076352:12345-192.168.206.14@tcp:35:lhsmtool_posix.0 Request processed in 1849us (3053us total) trans 12884901926 rc 0/0 00000100:00100000:1.0:1790772589.358495:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 13 00000020:00080000:1.0:1790772589.358501:0:22760:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790772589.360146:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772589.360219:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481076608 00000100:00100000:2.0:1790772589.360230:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481076608 00000100:00100000:2.0:1790772589.360301:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 71 00000100:00100000:2.0:1790772589.360312:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf763f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+20:18774:x1877760481076608:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:2.0:1790772589.360336:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772589.360359:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560600/0x418ffb1c3bcc9d2a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42c6e08168753bd9 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.360402:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9d31 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.360418:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9d31 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.360430:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9d31 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.360617:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560600/0x418ffb1c3bcc9d2a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bd9 expref: 22 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.360644:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3561400/0x418ffb1c3bcc9d31 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753bd9 expref: 21 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.360654:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9eccc23b2400) 00010000:00010000:2.0:1790772589.360658:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790772589.360662:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eccc3561400, rc 0) 00000100:00100000:2.0:1790772589.360733:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf763f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+21:18774:x1877760481076608:12345-192.168.206.14@tcp:101:bash.0 Request processed in 424us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772589.360740:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 71 00010000:00010000:3.0:1790772589.361152:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772589.361176:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439000/0x418ffb1c3bcc9d23 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.361184:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdff439000 already unused, calling callback (ffffffffc0be7ac0) 00010000:00010000:3.0:1790772589.361189:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439000/0x418ffb1c3bcc9d23 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.361201:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439000/0x418ffb1c3bcc9d23 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.361215:0:22745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ecdc7796d00) 00010000:00010000:3.0:1790772589.361218:0:22745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790772589.361223:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439000/0x418ffb1c3bcc9d23 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.361229:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdff439000/0x418ffb1c3bcc9d23 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772589.361256:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772589.361258:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772589.361260:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772589.366077:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772589.366242:0:22759:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481076864 00000100:00100000:3.0:1790772589.366254:0:22759:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481076864 00000100:00100000:3.0:1790772589.366322:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 14 00000100:00100000:3.0:1790772589.366332:0:22759:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf80ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+21:18774:x1877760481076864:12345-192.168.206.14@tcp:35:bash.0 00000001:00080000:3.0:1790772589.366835:0:22759:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901927 00000001:00080000:3.0:1790772589.366971:0:22759:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901928 00000100:00100000:3.0:1790772589.367927:0:22759:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf80ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+24:18774:x1877760481076864:12345-192.168.206.14@tcp:35:bash.0 Request processed in 1590us (1890us total) trans 12884901929 rc 0/0 00000100:00100000:3.0:1790772589.367940:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 14 00000020:00080000:3.0:1790772589.367947:0:22759:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1790772589.527604:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772589.527823:0:25802:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481077120 00000100:00100000:2.0:1790772589.527836:0:25802:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481077120 00000100:00100000:2.0:1790772589.527920:0:25802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 72 00000100:00100000:2.0:1790772589.527932:0:25802:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf763ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f9f6919-1501-400a-bf51-76bbebf8064d+24:18786:x1877760481077120:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:2.0:1790772589.527966:0:25802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772589.528002:0:25802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560600/0x418ffb1c3bcc9d38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42c6e08168753be0 expref: -99 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772589.528145:0:25802:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790772589.528337:0:25802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560600/0x418ffb1c3bcc9d38 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753be0 expref: 26 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.528355:0:25802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eccc23b2d00) 00010000:00010000:2.0:1790772589.528374:0:25802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790772589.528381:0:25802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eccc3560600/0x418ffb1c3bcc9d38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x42c6e08168753be0 expref: 26 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772589.528400:0:25802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eccc3560600, rc 0) 00000100:00100000:2.0:1790772589.528473:0:25802:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf763ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f9f6919-1501-400a-bf51-76bbebf8064d+25:18786:x1877760481077120:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 542us (882us total) trans 12884901930 rc 301/301 00000100:00100000:2.0:1790772589.528483:0:25802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 72 00000100:00100000:1.0:1790772589.532582:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1790772589.532768:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481077248 00000100:00100000:0.0:1790772589.532781:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481077248 00000100:00100000:0.0:1790772589.532851:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 73 00000100:00100000:0.0:1790772589.532862:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf758f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+25:18786:x1877760481077248:12345-192.168.206.14@tcp:34:lfs.0 00010000:00010000:0.0:1790772589.532962:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9d46 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.532983:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9d46 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.533008:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9d46 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.533026:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012c00/0x418ffb1c3bcc9d4d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.533034:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012c00/0x418ffb1c3bcc9d4d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.533041:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012c00/0x418ffb1c3bcc9d4d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.533146:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013000/0x418ffb1c3bcc9d54 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.533155:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013000/0x418ffb1c3bcc9d54 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.533206:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013000/0x418ffb1c3bcc9d54 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790772589.533288:0:22756:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013000/0x418ffb1c3bcc9d54 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.533303:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9d46 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.533310:0:22756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9d46 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.533316:0:22756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9d46 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.533323:0:22756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf5012800 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:0.0:1790772589.533329:0:22756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9d46 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.533337:0:22756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9d46 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.533350:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9eccc3658e00) 00010000:00010000:0.0:1790772589.533354:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772589.533359:0:22756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9d46 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.533365:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012800/0x418ffb1c3bcc9d46 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.533382:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012c00/0x418ffb1c3bcc9d4d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.533388:0:22756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012c00/0x418ffb1c3bcc9d4d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.533401:0:22756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012c00/0x418ffb1c3bcc9d4d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.533406:0:22756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf5012c00 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:0.0:1790772589.533410:0:22756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012c00/0x418ffb1c3bcc9d4d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.533417:0:22756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012c00/0x418ffb1c3bcc9d4d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.533426:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9ecdfaa7f600) 00010000:00010000:0.0:1790772589.533428:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772589.533431:0:22756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012c00/0x418ffb1c3bcc9d4d lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.533437:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5012c00/0x418ffb1c3bcc9d4d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.533454:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013000/0x418ffb1c3bcc9d54 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.533461:0:22756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013000/0x418ffb1c3bcc9d54 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.533466:0:22756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013000/0x418ffb1c3bcc9d54 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.533471:0:22756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ecdf5013000 already unused, calling callback (ffffffffc18114f0) 00010000:00010000:0.0:1790772589.533474:0:22756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013000/0x418ffb1c3bcc9d54 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.533503:0:22756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013000/0x418ffb1c3bcc9d54 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.533512:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9eccc23b2400) 00010000:00010000:0.0:1790772589.533515:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772589.533518:0:22756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013000/0x418ffb1c3bcc9d54 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772589.533524:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ecdf5013000/0x418ffb1c3bcc9d54 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772589.534235:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf758f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+25:18786:x1877760481077248:12345-192.168.206.14@tcp:34:lfs.0 Request processed in 1368us (1669us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772589.534248:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 73 00000100:00100000:1.0:1790772589.537492:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1790772589.537588:0:22760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481077504 00000100:00100000:0.0:1790772589.537599:0:22760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481077504 00000100:00100000:0.0:1790772589.537670:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 15 00000100:00100000:0.0:1790772589.537679:0:22760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf758fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+25:18786:x1877760481077504:12345-192.168.206.14@tcp:35:lfs.0 00000100:00100000:0.0:1790772589.537955:0:22760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf758fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f9f6919-1501-400a-bf51-76bbebf8064d+26:18786:x1877760481077504:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 273us (485us total) trans 12884901931 rc 0/0 00000100:00100000:0.0:1790772589.537963:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 15 00010000:00010000:1.0:1790772589.719399:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772589.844975:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790772589.845006:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf758d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1877760506349184:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790772589.845099:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772589.845162:0:22762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506349184 00000100:00100000:1.0:1790772589.845194:0:22762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506349184 00000100:00100000:1.0:1790772589.845252:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790772589.845263:0:22762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf758ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1877760506349184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790772589.845314:0:22762:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790772589.845369:0:22762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf758ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1877760506349184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772589.845377:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790772589.845433:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf758d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1877760506349184:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790772589.848670:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790772589.848702:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf80ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506349312:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790772589.848796:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772589.848872:0:23497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506349312 00000100:00100000:0.0:1790772589.848881:0:23497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506349312 00000100:00100000:2.0:1790772589.849062:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf763c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506349440:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790772589.849103:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772589.849139:0:24267:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506349440 00000100:00100000:2.0:1790772589.849143:0:24267:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506349440 00000100:00100000:2.0:1790772589.849212:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790772589.849224:0:24267:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf80eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506349440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790772589.849272:0:24267:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1790772589.849336:0:24267:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf80eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506349440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772589.849347:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790772589.849402:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf763c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506349440:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790772589.849671:0:23497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790772589.849685:0:23497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf763dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506349312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790772589.849733:0:23497:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:0.0:1790772589.849832:0:23497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf763dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1877760506349312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 151us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772589.849839:0:23497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1790772589.850136:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790772589.854936:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf80ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1877760506349312:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1790772590.039031:0:23514:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790772590.740390:0:25002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772590.869680:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf75b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1877760506349568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790772590.869773:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772590.869890:0:24267:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506349568 00000100:00100000:3.0:1790772590.869903:0:24267:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506349568 00000100:00100000:3.0:1790772590.869981:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790772590.869992:0:24267:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf763e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877760506349568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790772590.870020:0:24267:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1790772590.870076:0:24267:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf763e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877760506349568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772590.870083:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1790772590.870147:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790772590.870222:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf75b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1877760506349568:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1790772591.353216:0:25839:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:3.0:1790772591.469495:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772591.469538:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772591.469575:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772591.469606:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772591.469626:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772591.469645:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772591.469666:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772591.469683:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772591.469718:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772591.469743:0:24262:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481078144 00000100:00100000:3.0:1790772591.469751:0:24262:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481078144 00000100:00100000:3.0:1790772591.469796:0:24262:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481078656 00000100:00100000:3.0:1790772591.469800:0:24262:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481078656 00000100:00100000:3.0:1790772591.469812:0:24262:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481078016 00000100:00100000:3.0:1790772591.469814:0:24262:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481078016 00000100:00100000:3.0:1790772591.469824:0:24262:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481078528 00000100:00100000:3.0:1790772591.469826:0:24262:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481078528 00000100:00100000:3.0:1790772591.469839:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 25 00000100:00100000:3.0:1790772591.469848:0:24262:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf75b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+8:2393:x1877760481078144:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1790772591.469913:0:24262:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf75b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+8:2393:x1877760481078144:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 65us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772591.469920:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 25 00000100:00100000:3.0:1790772591.469938:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 26 00000100:00100000:3.0:1790772591.469945:0:24262:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf75b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+5:2393:x1877760481078656:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1790772591.469966:0:24262:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf75b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+5:2393:x1877760481078656:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 22us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772591.469972:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 26 00000100:00100000:3.0:1790772591.469998:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 27 00000100:00100000:3.0:1790772591.470005:0:24262:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3e92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+5:2393:x1877760481078016:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1790772591.470024:0:24262:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3e92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+5:2393:x1877760481078016:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 20us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772591.470046:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 27 00000100:00100000:3.0:1790772591.470059:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 28 00000100:00100000:3.0:1790772591.470065:0:24262:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3e91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+5:2393:x1877760481078528:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1790772591.470087:0:24262:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3e91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+5:2393:x1877760481078528:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 23us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772591.470094:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 28 00000100:00100000:3.0:1790772591.470111:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481077888 00000100:00100000:3.0:1790772591.470114:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481077888 00000100:00100000:3.0:1790772591.470133:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481078400 00000100:00100000:3.0:1790772591.470135:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481078400 00000100:00100000:3.0:1790772591.470146:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481077760 00000100:00100000:3.0:1790772591.470148:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481077760 00000100:00100000:3.0:1790772591.470189:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481078272 00000100:00100000:3.0:1790772591.470192:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481078272 00000100:00100000:3.0:1790772591.470212:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 69 00000100:00100000:3.0:1790772591.470219:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf75b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+5:2393:x1877760481077888:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1790772591.470246:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf75b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+5:2393:x1877760481077888:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 28us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772591.470253:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 69 00000100:00100000:3.0:1790772591.470264:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 70 00000100:00100000:3.0:1790772591.470269:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf75b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+5:2393:x1877760481078400:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1790772591.470284:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf75b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+5:2393:x1877760481078400:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 16us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772591.470289:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 70 00000100:00100000:3.0:1790772591.470297:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 71 00000100:00100000:3.0:1790772591.470308:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf75b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+26:2393:x1877760481077760:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1790772591.470330:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf75b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f9f6919-1501-400a-bf51-76bbebf8064d+26:2393:x1877760481077760:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 23us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772591.470336:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 71 00000100:00100000:3.0:1790772591.470347:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 72 00000100:00100000:3.0:1790772591.470353:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+6:2393:x1877760481078272:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1790772591.470371:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc2e9335-a1da-404e-b3d3-c74e78c9d38a+6:2393:x1877760481078272:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 19us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772591.470377:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 72 00000100:00080000:3.0:1790772591.470407:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790772591.470412:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790772591.470414:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790772591.470416:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790772591.473122:0:22750:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481077632 00000100:00100000:0.0:1790772591.473134:0:22750:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481077632 00000100:00100000:0.0:1790772591.473220:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 169 00000100:00100000:0.0:1790772591.473229:0:22750:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddb76036-7f3a-437f-b993-ff4cd941bf15+13:2393:x1877760481077632:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:0.0:1790772591.473294:0:22750:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddb76036-7f3a-437f-b993-ff4cd941bf15+13:2393:x1877760481077632:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 67us (3809us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772591.473303:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 169 00010000:00010000:3.0:1790772591.764365:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772592.495984:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1790772592.496038:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1790772592.496090:0:24268:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481078784 00000100:00100000:2.0:1790772592.496101:0:24268:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481078784 00002000:00100000:2.0:1790772592.496146:0:24268:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x42:0x0] (0->8) req@ffff9eccc3e90380 x1877760481078784/t0(0) o4->4f9f6919-1501-400a-bf51-76bbebf8064d@192.168.206.14@tcp:183/0 lens 504/0 e 0 to 0 dl 1790772603 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1790772592.496157:0:24268:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eccc3e90380 with x1877760481078784 ext(0->8) 00002000:00010000:2.0:1790772592.496188:0:24268:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9eccc3e90380 00000100:00100000:2.0:1790772592.496232:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 0 00000100:00100000:2.0:1790772592.496243:0:24268:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3e90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+8:2392:x1877760481078784:12345-192.168.206.14@tcp:4:bash.0 00000100:00100000:1.0:1790772592.497093:0:24262:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760481078912 00000100:00100000:1.0:1790772592.497101:0:24262:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760481078912 00000100:00100000:1.0:1790772592.497149:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 32 00000100:00100000:1.0:1790772592.497157:0:24262:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3e93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+11:2392:x1877760481078912:12345-192.168.206.14@tcp:16:kworker.0 00000100:00100000:1.0:1790772592.498641:0:24268:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3e90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+11:2392:x1877760481078784:12345-192.168.206.14@tcp:4:bash.0 Request processed in 2394us (2660us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1790772592.498656:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 0 00002000:00100000:1.0:1790772592.498666:0:24268:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x42:0x0] (0->8) req@ffff9eccc3e90380 x1877760481078784/t12884901895(0) o4->4f9f6919-1501-400a-bf51-76bbebf8064d@192.168.206.14@tcp:183/0 lens 504/448 e 0 to 0 dl 1790772603 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1790772592.498676:0:24268:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eccc3e90380 with x1877760481078784 ext(0->8) 00002000:00010000:1.0:1790772592.498693:0:24268:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9eccc3e90380 00000001:00080000:3.0:1790772592.503084:0:25079:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00000001:00080000:3.0:1790772592.503101:0:25079:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00000100:00100000:3.0:1790772592.503255:0:24262:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3e93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f9f6919-1501-400a-bf51-76bbebf8064d+6:2392:x1877760481078912:12345-192.168.206.14@tcp:16:kworker.0 Request processed in 6093us (7210us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772592.503266:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 32 00010000:00010000:1.0:1790772592.791746:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772592.916489:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790772592.916521:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf758d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1877760506349696:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790772592.916638:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772592.916894:0:24267:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506349696 00000100:00100000:1.0:1790772592.916904:0:24267:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506349696 00000100:00100000:1.0:1790772592.916979:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790772592.916990:0:24267:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf7525c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1877760506349696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790772592.917021:0:24267:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923505152 avail 3691954176 00000100:00100000:1.0:1790772592.917085:0:24267:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf7525c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1877760506349696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772592.917092:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790772592.917149:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf758d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1877760506349696:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790772592.917358:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf758c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506350208:0@lo:400:kworker.0 00000100:00100000:1.0:1790772592.917392:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790772592.917673:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790772592.917851:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3546d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1877760506350720:0@lo:400:kworker.0 00000100:00100000:1.0:1790772592.917883:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772592.917899:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf6041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1877760506351232:0@lo:400:kworker.0 00000100:00100000:1.0:1790772592.917921:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772592.917952:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1790772592.917959:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf758d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3645:1877760506349824:0@lo:400:kworker.0 00000100:00100000:1.0:1790772592.917993:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772592.918017:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf758dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1877760506350336:0@lo:400:kworker.0 00000100:00100000:1.0:1790772592.918039:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772592.918058:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1877760506350848:0@lo:400:kworker.0 00000100:00100000:1.0:1790772592.918080:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772592.918100:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf7525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506351360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790772592.918155:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772592.918208:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf758f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1877760506349952:0@lo:400:kworker.0 00000100:00100000:1.0:1790772592.918236:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772592.918255:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf758e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506350464:0@lo:400:kworker.0 00000100:00100000:1.0:1790772592.918273:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772592.918287:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3547b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1877760506350976:0@lo:400:kworker.0 00000100:00100000:1.0:1790772592.918305:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772592.918316:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1790772592.918321:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ecdf758df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1877760506350080:0@lo:400:kworker.0 00000100:00100000:1.0:1790772592.918339:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772592.918357:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3547100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506350592:0@lo:400:kworker.0 00000100:00100000:1.0:1790772592.918374:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772592.918390:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eccc3546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1877760506351104:0@lo:400:kworker.0 00000100:00100000:1.0:1790772592.918426:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772592.918452:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506350720 00000100:00100000:1.0:1790772592.918458:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506350720 00000100:00100000:1.0:1790772592.918487:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506351232 00000100:00100000:1.0:1790772592.918489:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506351232 00000100:00100000:1.0:1790772592.918511:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506350336 00000100:00100000:1.0:1790772592.918514:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506350336 00000100:00100000:1.0:1790772592.918525:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506350848 00000100:00100000:1.0:1790772592.918527:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506350848 00000100:00100000:1.0:1790772592.918549:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506350976 00000100:00100000:1.0:1790772592.918551:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506350976 00000100:00100000:1.0:1790772592.918566:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506351104 00000100:00100000:1.0:1790772592.918568:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506351104 00000100:00100000:1.0:1790772592.918584:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790772592.918592:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf6041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1877760506350720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772592.918663:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf6041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1877760506350720:12345-0@lo:400:kworker.0 Request processed in 70us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772592.918670:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790772592.918686:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790772592.918692:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf6040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1877760506351232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772592.918719:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf6040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1877760506351232:12345-0@lo:400:kworker.0 Request processed in 28us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772592.918724:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790772592.918735:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790772592.918740:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf6040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1877760506350336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772592.918765:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf6040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1877760506350336:12345-0@lo:400:kworker.0 Request processed in 26us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772592.918771:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790772592.918781:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790772592.918787:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf6042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1877760506350848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772592.918815:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf6042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1877760506350848:12345-0@lo:400:kworker.0 Request processed in 29us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772592.918821:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790772592.918833:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790772592.918839:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3cdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877760506350976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772592.918871:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3cdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877760506350976:12345-0@lo:400:kworker.0 Request processed in 33us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772592.918877:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790772592.918890:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790772592.918896:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3cde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1877760506351104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772592.918952:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3cde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1877760506351104:12345-0@lo:400:kworker.0 Request processed in 56us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772592.918958:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790772592.918981:0:22749:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506349824 00000100:00100000:1.0:1790772592.918985:0:22749:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506349824 00000100:00100000:1.0:1790772592.919013:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1790772592.919018:0:22749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf1212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+24:3645:x1877760506349824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772592.919051:0:22749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf1212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a371a4ff-c27a-4b58-b24c-92c8783ef87a+24:3645:x1877760506349824:12345-0@lo:400:kworker.0 Request processed in 32us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772592.919057:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1790772592.919095:0:23497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506349952 00000100:00100000:1.0:1790772592.919099:0:23497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506349952 00000100:00100000:1.0:1790772592.919124:0:23497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506350464 00000100:00100000:1.0:1790772592.919127:0:23497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506350464 00000100:00100000:1.0:1790772592.919140:0:23497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790772592.919147:0:23497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3cde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1877760506349952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772592.919208:0:23497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3cde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1877760506349952:12345-0@lo:400:kworker.0 Request processed in 62us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772592.919215:0:23497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790772592.919228:0:23497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790772592.919234:0:23497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506350464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772592.919277:0:23497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506350464:12345-0@lo:400:kworker.0 Request processed in 44us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772592.919284:0:23497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790772592.919309:0:24264:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506350208 00000100:00100000:1.0:1790772592.919313:0:24264:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506350208 00000100:00100000:1.0:1790772592.919340:0:24264:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506350080 00000100:00100000:1.0:1790772592.919348:0:24264:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506350080 00000100:00100000:1.0:1790772592.919366:0:24264:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506350592 00000100:00100000:1.0:1790772592.919369:0:24264:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506350592 00000100:00100000:1.0:1790772592.919384:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790772592.919389:0:24264:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ecdf6043800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1877760506350208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772592.919424:0:24264:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ecdf6043800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1877760506350208:12345-0@lo:400:kworker.0 Request processed in 34us (2031us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772592.919429:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790772592.919439:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790772592.919444:0:24264:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1877760506350080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772592.919466:0:24264:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1877760506350080:12345-0@lo:400:kworker.0 Request processed in 22us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772592.919470:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790772592.919478:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790772592.919483:0:24264:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506350592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772592.919505:0:24264:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1877760506350592:12345-0@lo:400:kworker.0 Request processed in 22us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772592.919511:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1790772592.919538:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790772592.919560:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790772592.919563:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790772592.919566:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790772592.919578:0:24267:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760506351360 00000100:00100000:1.0:1790772592.919583:0:24267:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760506351360 00000100:00100000:1.0:1790772592.919606:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790772592.919611:0:24267:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9eccc3cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1877760506351360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790772592.919627:0:24267:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923505152 avail 3691954176 00000100:00100000:1.0:1790772592.919663:0:24267:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9eccc3cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1877760506351360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (1508us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772592.919675:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790772592.919721:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf758df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1877760506350080:0@lo:400:kworker.0 00000100:00100000:1.0:1790772592.919736:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3547100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506350592:0@lo:400:kworker.0 00000100:00100000:1.0:1790772592.919748:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1877760506351104:0@lo:400:kworker.0 00000100:00100000:1.0:1790772592.919758:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf758f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1877760506349952:0@lo:400:kworker.0 00000100:00100000:1.0:1790772592.919767:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf758e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1877760506350464:0@lo:400:kworker.0 00010000:00080000:1.0:1790772592.919780:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9eccc3547b80 x1877760506350976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772592.919790:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3547b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1877760506350976:0@lo:400:kworker.0 00000100:00100000:1.0:1790772592.919837:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf758d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a371a4ff-c27a-4b58-b24c-92c8783ef87a:3645:1877760506349824:0@lo:400:kworker.0 00000100:00100000:1.0:1790772592.919849:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf758dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1877760506350336:0@lo:400:kworker.0 00000100:00100000:1.0:1790772592.919860:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1877760506350848:0@lo:400:kworker.0 00000100:00100000:1.0:1790772592.919869:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:1.0:1790772592.919874:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eccc440d500, transno 12884901892 00000004:00080000:1.0:1790772592.919887:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:1.0:1790772592.919916:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf7525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506351360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790772592.919928:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf758c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1877760506350208:0@lo:400:kworker.0 00000100:00100000:1.0:1790772592.919939:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eccc3546d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1877760506350720:0@lo:400:kworker.0 00010000:00080000:1.0:1790772592.919951:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ecdf6041c00 x1877760506351232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772592.919975:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ecdf6041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1877760506351232:0@lo:400:kworker.0 Debug log: 14815 lines, 14815 kept, 0 dropped, 0 bad.